-- Logs begin at Thu 2022-04-14 20:57:37 UTC, end at Thu 2022-04-14 22:23:03 UTC. -- Apr 14 21:34:04.000125 dv-cinder-813229-9-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 14 21:34:04.015258 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 14 21:34:04.017501 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Apr 14 21:34:04 2022] *** Apr 14 21:34:04.017501 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 14 21:34:04.017501 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 14 21:34:04.017501 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: nodename: dv-cinder-813229-9-iscsi Apr 14 21:34:04.017501 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: machine: x86_64 Apr 14 21:34:04.017501 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: clock source: unix Apr 14 21:34:04.017501 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: pcre jit disabled Apr 14 21:34:04.017501 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: detected number of CPU cores: 4 Apr 14 21:34:04.017501 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: current working directory: / Apr 14 21:34:04.017501 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: detected binary path: /usr/bin/uwsgi-core Apr 14 21:34:04.017501 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: your processes number limit is 47680 Apr 14 21:34:04.017501 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: your memory page size is 4096 bytes Apr 14 21:34:04.017501 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: detected max file descriptor number: 2048 Apr 14 21:34:04.017501 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: lock engine: pthread robust mutexes Apr 14 21:34:04.018413 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: thunder lock: enabled Apr 14 21:34:04.018413 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 14 21:34:04.018413 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 14 21:34:04.067469 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: Python main interpreter initialized at 0x55a377f8f9c0 Apr 14 21:34:04.067469 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: python threads support enabled Apr 14 21:34:04.067469 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: your server socket listen backlog is limited to 100 connections Apr 14 21:34:04.067469 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: your mercy for graceful operations on workers is 90 seconds Apr 14 21:34:04.067830 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: mapped 403077 bytes (393 KB) for 2 cores Apr 14 21:34:04.067903 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: *** Operational MODE: preforking *** Apr 14 21:34:04.068538 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: *** uWSGI is running in multiple interpreter mode *** Apr 14 21:34:04.068538 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: spawned uWSGI master process (pid: 86755) Apr 14 21:34:04.068753 dv-cinder-813229-9-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 14 21:34:04.069858 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: spawned uWSGI worker 1 (pid: 86770, cores: 1) Apr 14 21:34:04.069858 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: spawned uWSGI worker 2 (pid: 86771, cores: 1) Apr 14 21:34:04.069858 dv-cinder-813229-9-iscsi devstack@keystone.service[86755]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 14 21:34:10.003420 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 14 21:34:10.003420 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: from cryptography.utils import int_from_bytes Apr 14 21:34:10.004066 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 14 21:34:10.004066 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: from cryptography.utils import int_from_bytes Apr 14 21:34:10.006921 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 14 21:34:10.006921 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: from cryptography.utils import int_from_bytes Apr 14 21:34:10.007432 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 14 21:34:10.007432 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: from cryptography.utils import int_from_bytes Apr 14 21:34:10.055945 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 14 21:34:10.056147 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 14 21:34:10.056338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] command line args: [] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 14 21:34:10.056633 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 14 21:34:10.056814 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ================================================================================ {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 14 21:34:10.057070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] admin_token = **** {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.057188 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 14 21:34:10.057317 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] config_dir = [] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.057402 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 14 21:34:10.057506 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.057585 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] command line args: [] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 14 21:34:10.057687 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] config_source = [] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.057826 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 14 21:34:10.057933 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] debug = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.058015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ================================================================================ {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 14 21:34:10.058086 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.058296 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] admin_token = **** {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.058420 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.058502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] config_dir = [] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.058597 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.058676 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.058824 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] config_source = [] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.058906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.059019 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] debug = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.059093 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.059216 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.059316 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] list_limit = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.059453 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] log_config_append = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.059529 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.059623 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.059706 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.059810 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] log_dir = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.059886 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.059980 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] log_file = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.060122 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.060208 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.060359 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] list_limit = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.060447 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.060537 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] log_config_append = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.060712 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.060793 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.060903 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] log_dir = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.061016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.061104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] log_file = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.061182 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.061263 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.061340 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.061521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.061618 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.061752 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.061837 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.061988 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.062069 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.062196 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.062259 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.062360 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.062553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.062720 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.062893 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.063070 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.063246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.063395 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.063568 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.063729 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.063896 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.064076 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.064076 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.064407 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.064547 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.064760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] publish_errors = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.064914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.065088 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.065262 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.065441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.065441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.065441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.065825 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.065940 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.066050 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] publish_errors = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.066204 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] standard_threads = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.066321 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.066521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.066644 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.066644 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.066908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.066908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.067133 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.067251 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] use_journal = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.067364 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.067486 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] use_json = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.067599 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] standard_threads = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.068724 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] use_stderr = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.068724 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] use_syslog = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.069049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.069165 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.069299 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.069299 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.069521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.069634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] use_journal = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.069746 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.069857 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] use_json = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.069857 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] use_stderr = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.070082 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.070207 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] use_syslog = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.070320 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.070320 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.070536 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 14 21:34:10.070657 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.070657 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.070912 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.071055 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.071167 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.071278 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.071400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.071514 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.071626 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.071737 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.071854 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.071971 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.072090 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.072203 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.072320 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.072438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.072550 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.072694 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.072884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.073005 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.073118 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.073229 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.073340 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.073451 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.073573 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.073687 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.073799 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.073910 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.074021 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.074132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.074251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.074369 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.074481 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.074598 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.074717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.074841 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.074954 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.075071 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.075183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.075295 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.075406 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.075525 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.075636 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.075749 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.075860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.075971 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.075971 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.076186 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.076304 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.076421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.076534 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.076651 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.076746 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.076854 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.076951 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.077044 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.077136 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.077229 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.077321 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.077421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.077516 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.077609 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.077720 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.077832 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.077952 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.078071 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.078214 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.078334 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.078447 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.078557 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.078669 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.078791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.078943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.079064 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.079177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.079300 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.079420 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.079545 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.079659 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.079771 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.079883 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.079996 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.080113 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.080234 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.080353 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.080474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.080619 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.080735 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.080847 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.080959 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.081084 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.081199 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.081312 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.081423 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.081535 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.081648 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.081771 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.081885 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.081997 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.082100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.082216 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.082329 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.082457 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.082571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.082689 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.082802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.082921 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.083034 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.083158 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.083275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.084381 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.084515 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.084646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.084779 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.084903 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.085018 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.085131 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.085246 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.085358 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.085471 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.085659 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.085781 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.085902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.086016 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.086129 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.086249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.086370 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.086484 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.086597 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.086720 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.086834 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.086952 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.087072 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.087192 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.087307 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.087767 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.087884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.087997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.088118 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.088232 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.088346 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.088458 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.088570 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.088737 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.088868 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.088993 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.089117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.089231 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.089344 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.089457 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.089569 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.089681 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.089801 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.089915 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.090027 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.090139 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.090251 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.090372 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.090486 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.090598 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.090711 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.090830 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.090943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.091066 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.091180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.091292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.091405 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.091518 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.091630 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.091750 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.091863 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.091976 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.092085 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.092197 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.092309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.092428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.092547 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.092688 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.092801 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.092801 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.093012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.093012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.093237 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.093237 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.093453 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.093453 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.093664 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.093784 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.093904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.094025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.094139 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.094250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.094362 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.094482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.094595 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.094713 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.094827 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] auth.external = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.094939 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.095051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.095171 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.095284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.095399 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.095511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.095629 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.095744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] auth.password = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.095864 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.095978 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] auth.token = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.096090 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.096228 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.096350 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.096465 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.096616 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] auth.external = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.096733 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.096858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.096974 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.096974 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.097187 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.097187 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.097399 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.097519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] auth.password = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.097639 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.097760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] auth.token = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.097875 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] credential.caching = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.097988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.098101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.098222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.098336 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.098450 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.098562 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.098683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.098797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.099219 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.099347 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.099541 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.099659 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.099773 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.099889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.100012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] credential.caching = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.100126 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.100332 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.100452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.100567 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.100698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.100825 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.100943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.101057 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.101175 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.101289 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.101402 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.101524 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.101646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.101761 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.101874 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.101988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.102101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] federation.caching = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.102101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.102101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.102440 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.102555 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.102668 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.102781 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.102901 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.103018 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.103132 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.103245 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.103245 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.103476 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.103592 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.103705 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.103819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.103932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.104045 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.104167 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] federation.caching = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.104282 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.104395 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.104508 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] identity.caching = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.104644 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.104760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.104885 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.105007 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.105123 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.105237 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.105350 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.105464 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.105588 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.105703 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.105817 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.105930 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.106055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.106170 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.106297 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.106412 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.106525 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.106638 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.106751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.106864 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.106988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] identity.caching = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.107116 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.107285 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.107403 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.107517 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.107630 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.107751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.107867 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.107980 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.108093 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.108206 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.108321 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.108443 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.108557 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.108688 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.108807 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.108921 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.109034 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.109160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.109275 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.109389 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.109508 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.109622 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.109736 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.109858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.109973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.110086 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.110205 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.110319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.110432 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.110553 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.110668 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.110781 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.110894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.111013 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.111128 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.111249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.111364 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.111484 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.111602 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.111722 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.111836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.111958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.112073 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.112189 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.112303 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.112416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.112529 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.112702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.112818 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.112931 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.113044 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.113157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.113269 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.113390 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.113507 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.113620 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.113733 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.113733 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.113956 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.114070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.114183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.114297 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.114410 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.114523 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.114649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.115238 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.115360 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.115474 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.115590 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.115704 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.115828 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.115828 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.116043 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.116157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.116270 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.116270 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.116491 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.116624 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.116741 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.116855 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.116967 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.117080 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.117208 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.117323 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.117437 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.117556 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.117671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.117785 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.117906 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.117906 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.118119 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.118232 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.118344 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.118457 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.118578 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.118693 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.118807 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.118920 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.119033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.119146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.119266 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.119381 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.119494 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.119607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.119719 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.119833 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.119954 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.120068 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.120182 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.120295 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.120408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.120520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.120723 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.120849 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.120963 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.121077 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.121190 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.121302 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.121423 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.121539 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.121652 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.121765 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.121879 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.121992 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.122176 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.122297 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.122410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.122523 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.122636 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.122748 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.122869 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.122985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.123098 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.123211 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.123323 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.123436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.123557 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.123672 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.123785 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.123898 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.124012 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.124125 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.124247 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.124368 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.124481 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.124612 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.124727 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.124840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.124966 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.125082 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.125195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.125308 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.125421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.125533 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.125655 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] resource.caching = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.125769 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.125882 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.125995 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.126109 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.126222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.126343 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.126457 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.126570 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.126684 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.126797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.126909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.127031 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.127146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.127259 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.127372 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.127485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.127598 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.127720 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.127834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.127948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] role.caching = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.128061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] resource.caching = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.128175 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] role.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.128288 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.128409 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.128524 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.128673 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.128787 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.128901 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.129027 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.129142 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.129256 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.129368 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.129482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.129594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.129716 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.129831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.129944 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.130057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.130671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.131025 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.131195 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] role.caching = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.131327 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.131452 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] role.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.131573 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.131691 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.131809 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.131937 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.132056 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.132174 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.132293 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.132413 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.132530 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.132679 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.132800 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.132917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.133033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.133150 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.133266 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.133393 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.133513 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.133630 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.133630 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.133847 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.133847 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.134097 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.134097 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.134317 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.134433 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.134550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.134550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.134776 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.134894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.135010 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.135126 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.135241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.135366 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.135483 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.135601 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.135722 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.135839 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.135955 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.136079 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.136196 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.136312 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.136428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.136543 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.136707 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.136836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.136954 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.137070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] token.caching = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.137185 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.137300 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.137415 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.137538 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.137657 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.137773 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.137888 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.138011 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.138128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.138252 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.138369 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.138485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.138600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.138717 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.138833 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.138957 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.139093 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.139215 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.139331 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.139446 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.139561 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] token.caching = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.139686 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.139805 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.139921 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.140038 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.140153 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.140269 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.140393 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.140511 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.140641 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.140760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.140881 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.140998 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.141126 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.141244 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.141366 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.connection = **** {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.141492 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.141618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.141735 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.141735 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.141962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.142080 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.142195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.142310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.142426 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.142541 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.142665 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.142665 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.142894 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.143011 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.143127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.143243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.143437 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.143557 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.143674 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.143790 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.143907 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.connection = **** {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.144032 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.144157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.144275 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.144400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.144517 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.144699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.144818 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.144934 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.145051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.145181 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.145299 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.145417 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.145533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.145649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.145765 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.146463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.146584 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 14 21:34:10.146702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.146702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.146702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.146702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.146702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.146702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.146702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.146702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.146702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.147638 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 14 21:34:10.147638 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 14 21:34:10.172002 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.172233 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.172454 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.173549 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.173779 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.174000 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.181135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.182624 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.210380 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.210605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.212074 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.212567 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.265242 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.265383 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.315352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.315582 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.315871 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.316106 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.384422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.384653 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.384746 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.384824 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.384899 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.385040 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.385125 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.385257 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.385342 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.385472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.385555 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.385684 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.409283 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.409516 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.409602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.409744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.409828 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.409970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.410054 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.410188 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.410273 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.410399 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.410515 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.410623 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.410699 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.410812 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.421936 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.422723 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.447622 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.447857 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.448035 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.448120 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.448267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.448423 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.448506 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.448599 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.448713 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.448796 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.448926 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.449021 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.449136 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.449347 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 14 21:34:10.467029 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.467241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 14 21:34:10.467573 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.467759 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.467842 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 14 21:34:10.467967 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 14 21:34:10.468049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.468269 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.468350 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.468482 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 14 21:34:10.468563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.468775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.468856 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.469031 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.469284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.469536 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.479928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.480200 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.480465 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.480562 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.480765 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.480848 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.481106 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.481385 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.488919 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.489436 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.492748 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.493133 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.493305 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.493419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.493683 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.493765 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.493962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.494043 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.494223 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.494305 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.494492 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.494572 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.494751 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.494832 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.495015 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.495099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.495284 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.495371 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.495549 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.495638 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.495816 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.496076 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.522846 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.522947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.524398 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.524483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.524698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.524782 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.529898 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.529988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.530173 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.530256 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.530448 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.530529 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.537781 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.537878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.538060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.538143 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.542616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.542743 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.542908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.543025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.543158 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.543301 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.543437 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.543577 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.543706 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.543846 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.543969 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.544117 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.544228 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.544383 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.544487 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.544667 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.563680 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.563951 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.564047 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.564273 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.569092 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.569449 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.572730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.573020 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.573115 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.573367 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.578008 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.578364 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.583084 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.583602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.586746 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.587040 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.587266 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.587618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.587835 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.587919 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.588116 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.588199 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.588386 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.588501 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.588684 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.588962 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.710967 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.711255 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.711521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.711784 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.712081 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.712654 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.712925 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.713190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.719849 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.721053 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.721551 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.721821 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.722739 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.723010 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.725459 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.725735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.726182 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.726461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.726679 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.726783 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.726958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.727415 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.727697 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.727975 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.739920 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.740196 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.740471 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.740769 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.741048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.741333 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.741606 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.741688 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.741937 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.742215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.742501 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.742781 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.743069 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.743344 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.759794 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.761623 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.763039 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.764876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.766346 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.767928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.768183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.769699 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.769785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.769975 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.770252 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.772281 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.772556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.772907 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.778314 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.779896 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.780119 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.781750 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.783096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.783379 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.783663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.783931 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.784986 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.785274 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.785564 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.785837 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.793823 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.794104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.794386 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.795642 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.795928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.796215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.802530 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.802948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.803367 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.803691 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.803959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.804224 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 14 21:34:10.804309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.804493 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.804593 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.804793 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.804889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.805068 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.805150 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.805403 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.805484 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.805700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.805784 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.805965 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.806045 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.806226 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.806316 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.806480 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.806562 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.806855 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.807141 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.807412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.807678 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.807937 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 14 21:34:10.845286 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a377f8f9c0 pid: 86770 (default app) Apr 14 21:34:10.847432 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a377f8f9c0 pid: 86771 (default app) Apr 14 21:34:10.848778 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697347f-2d9f-447a-a5d9-e833b91ed621 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:10.849094 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697347f-2d9f-447a-a5d9-e833b91ed621 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:10.849372 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697347f-2d9f-447a-a5d9-e833b91ed621 None None] PATH_INFO: `/v3` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:10.853618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Thu Apr 14 21:34:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:20.233439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892af71e-2ffd-4ca3-8713-9bd82fc280ad None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:20.233990 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892af71e-2ffd-4ca3-8713-9bd82fc280ad None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:20.233990 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892af71e-2ffd-4ca3-8713-9bd82fc280ad None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:20.238365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:20.243680 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7a3c-ec7e-4d12-9961-70d4ffeb7970 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:20.244112 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7a3c-ec7e-4d12-9961-70d4ffeb7970 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:20.244233 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7a3c-ec7e-4d12-9961-70d4ffeb7970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:20.274711 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG oslo_db.sqlalchemy.engines [None req-c9bb7a3c-ec7e-4d12-9961-70d4ffeb7970 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 14 21:34:20.457213 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG passlib.handlers.bcrypt [None req-c9bb7a3c-ec7e-4d12-9961-70d4ffeb7970 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86770) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 14 21:34:20.457636 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG passlib.handlers.bcrypt [None req-c9bb7a3c-ec7e-4d12-9961-70d4ffeb7970 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86770) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 14 21:34:20.513580 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-c9bb7a3c-ec7e-4d12-9961-70d4ffeb7970 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:20.515132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c9bb7a3c-ec7e-4d12-9961-70d4ffeb7970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:20.637778 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 14 21:34:20.775345 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892af71e-2ffd-4ca3-8713-9bd82fc280ad None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:20.808793 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG oslo_db.sqlalchemy.engines [None req-892af71e-2ffd-4ca3-8713-9bd82fc280ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 14 21:34:20.938103 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892af71e-2ffd-4ca3-8713-9bd82fc280ad None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:20.942368 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb29d6-7d81-43b0-a743-5d7106c4f036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:20.944190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb29d6-7d81-43b0-a743-5d7106c4f036 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:20.944190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb29d6-7d81-43b0-a743-5d7106c4f036 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:20.944190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb29d6-7d81-43b0-a743-5d7106c4f036 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:20.952344 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb29d6-7d81-43b0-a743-5d7106c4f036 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:21.002882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.common.rbac_enforcer.enforcer [None req-77cb29d6-7d81-43b0-a743-5d7106c4f036 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 14 21:34:21.003231 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb29d6-7d81-43b0-a743-5d7106c4f036 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:21.013676 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1324 bytes} [Thu Apr 14 21:34:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 14 21:34:21.021586 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb7a3c-ec7e-4d12-9961-70d4ffeb7970 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:21.035758 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb7a3c-ec7e-4d12-9961-70d4ffeb7970 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:21.040246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9b36d-f4ac-4ba7-970a-f31a60ee0e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:21.041393 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9b36d-f4ac-4ba7-970a-f31a60ee0e46 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:21.041674 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9b36d-f4ac-4ba7-970a-f31a60ee0e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:21.041953 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9b36d-f4ac-4ba7-970a-f31a60ee0e46 admin admin] PATH_INFO: `/v3/projects/a2a4691b0f66431db71e4f1cd4001c61` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:21.043485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9b36d-f4ac-4ba7-970a-f31a60ee0e46 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2a4691b0f66431db71e4f1cd4001c61)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:21.096750 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.common.rbac_enforcer.enforcer [None req-05a9b36d-f4ac-4ba7-970a-f31a60ee0e46 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 14 21:34:21.097101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9b36d-f4ac-4ba7-970a-f31a60ee0e46 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:21.101930 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 3/5] 10.222.0.52 () {56 vars in 1207 bytes} [Thu Apr 14 21:34:21 2022] GET /identity/v3/projects/a2a4691b0f66431db71e4f1cd4001c61 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:23.364121 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d08db-c857-440a-962b-f47e9c4f4435 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:23.364667 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d08db-c857-440a-962b-f47e9c4f4435 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:23.364757 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d08db-c857-440a-962b-f47e9c4f4435 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:23.369360 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 3/6] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:34:23.374806 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3456cd-f70b-4513-8eaa-eecf56e836f1 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:23.375228 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3456cd-f70b-4513-8eaa-eecf56e836f1 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:23.375354 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3456cd-f70b-4513-8eaa-eecf56e836f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:23.393550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-9a3456cd-f70b-4513-8eaa-eecf56e836f1 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:23.395045 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-9a3456cd-f70b-4513-8eaa-eecf56e836f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:23.402836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Apr 14 21:34:23.424791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d08db-c857-440a-962b-f47e9c4f4435 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:23.437394 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d08db-c857-440a-962b-f47e9c4f4435 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:23.441563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c55b59-2783-4f9c-bbf4-aaf77e084ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:23.442189 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c55b59-2783-4f9c-bbf4-aaf77e084ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:23.442565 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c55b59-2783-4f9c-bbf4-aaf77e084ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:23.442968 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c55b59-2783-4f9c-bbf4-aaf77e084ee0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:23.450519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c55b59-2783-4f9c-bbf4-aaf77e084ee0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:23.452295 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c55b59-2783-4f9c-bbf4-aaf77e084ee0 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:23.461020 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1324 bytes} [Thu Apr 14 21:34:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 14 21:34:23.467813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3456cd-f70b-4513-8eaa-eecf56e836f1 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:23.477496 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3456cd-f70b-4513-8eaa-eecf56e836f1 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:23.481833 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c01c9-d5ed-4824-affc-aef2a870a7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:23.482680 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c01c9-d5ed-4824-affc-aef2a870a7cc admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:23.482957 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c01c9-d5ed-4824-affc-aef2a870a7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:23.483224 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c01c9-d5ed-4824-affc-aef2a870a7cc admin admin] PATH_INFO: `/v3/users/251b9783da7b448e9c5a7980e4095700` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:23.484647 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c01c9-d5ed-4824-affc-aef2a870a7cc admin admin] RBAC: Authorizing `identity:get_user(user_id=251b9783da7b448e9c5a7980e4095700)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:23.486483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c01c9-d5ed-4824-affc-aef2a870a7cc admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:23.488027 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 5/9] 10.222.0.52 () {56 vars in 1198 bytes} [Thu Apr 14 21:34:23 2022] GET /identity/v3/users/251b9783da7b448e9c5a7980e4095700 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:25.857002 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c10904-85c3-4d20-816e-b8c70b93c74c None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:25.857525 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c10904-85c3-4d20-816e-b8c70b93c74c None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:25.857610 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c10904-85c3-4d20-816e-b8c70b93c74c None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:25.858902 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:25.863963 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fd1ca-7de5-43af-b464-26245d6cff8c None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:25.864411 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fd1ca-7de5-43af-b464-26245d6cff8c None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:25.864600 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fd1ca-7de5-43af-b464-26245d6cff8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:25.881138 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-f54fd1ca-7de5-43af-b464-26245d6cff8c None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:25.882339 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f54fd1ca-7de5-43af-b464-26245d6cff8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:25.885941 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371efbc-e248-43af-a0b0-b380495f092f None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:25.886228 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371efbc-e248-43af-a0b0-b380495f092f None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:25.886507 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371efbc-e248-43af-a0b0-b380495f092f None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:25.887834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 6/11] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:34:25.892962 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c9a73-491f-4d62-a4f5-39d2aca6aaa4 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:25.893247 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c9a73-491f-4d62-a4f5-39d2aca6aaa4 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:25.893521 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c9a73-491f-4d62-a4f5-39d2aca6aaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:25.935930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG passlib.handlers.bcrypt [None req-b55c9a73-491f-4d62-a4f5-39d2aca6aaa4 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86771) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 14 21:34:25.936349 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG passlib.handlers.bcrypt [None req-b55c9a73-491f-4d62-a4f5-39d2aca6aaa4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86771) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 14 21:34:25.966240 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:25.983989 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-b55c9a73-491f-4d62-a4f5-39d2aca6aaa4 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:25.985661 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b55c9a73-491f-4d62-a4f5-39d2aca6aaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:25.991194 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fd1ca-7de5-43af-b464-26245d6cff8c None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:26.082251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:34:26.087944 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fd1ca-7de5-43af-b464-26245d6cff8c None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:26.105575 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c9a73-491f-4d62-a4f5-39d2aca6aaa4 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:26.122083 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965b982-4ac1-4d6a-852f-ea4930220982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:26.122815 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965b982-4ac1-4d6a-852f-ea4930220982 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:26.123095 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965b982-4ac1-4d6a-852f-ea4930220982 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:26.123367 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965b982-4ac1-4d6a-852f-ea4930220982 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:26.134398 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965b982-4ac1-4d6a-852f-ea4930220982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:26.141223 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-1965b982-4ac1-4d6a-852f-ea4930220982 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:34:26.142410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 7/14] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:34:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:34:26.148863 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965b982-4ac1-4d6a-852f-ea4930220982 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:26.203758 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c9a73-491f-4d62-a4f5-39d2aca6aaa4 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:26.238195 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223a4a6-33cd-4336-bd63-c2fdd9eec900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:26.239115 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223a4a6-33cd-4336-bd63-c2fdd9eec900 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:26.239402 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223a4a6-33cd-4336-bd63-c2fdd9eec900 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:26.239687 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223a4a6-33cd-4336-bd63-c2fdd9eec900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:26.244209 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965b982-4ac1-4d6a-852f-ea4930220982 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:26.277394 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d36a9-875a-4852-85dc-f41367b31d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:26.278057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d36a9-875a-4852-85dc-f41367b31d17 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:26.278334 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d36a9-875a-4852-85dc-f41367b31d17 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:26.278607 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d36a9-875a-4852-85dc-f41367b31d17 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:26.279354 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d36a9-875a-4852-85dc-f41367b31d17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:26.279658 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d36a9-875a-4852-85dc-f41367b31d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:26.281090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d36a9-875a-4852-85dc-f41367b31d17 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:26.292738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 8/15] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:34:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:34:26.298102 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d36a9-875a-4852-85dc-f41367b31d17 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:26.304909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223a4a6-33cd-4336-bd63-c2fdd9eec900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:26.306438 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223a4a6-33cd-4336-bd63-c2fdd9eec900 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:26.399775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d36a9-875a-4852-85dc-f41367b31d17 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:26.403628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 8/16] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:34:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 14 21:34:26.410517 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223a4a6-33cd-4336-bd63-c2fdd9eec900 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:26.431809 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a094d0-8de2-46ea-be12-b448170ea202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:26.432704 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a094d0-8de2-46ea-be12-b448170ea202 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:26.432984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a094d0-8de2-46ea-be12-b448170ea202 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:26.433264 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a094d0-8de2-46ea-be12-b448170ea202 None admin] PATH_INFO: `/v3/users/251b9783da7b448e9c5a7980e4095700` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:26.434466 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a094d0-8de2-46ea-be12-b448170ea202 None admin] RBAC: Authorizing `identity:get_user(user_id=251b9783da7b448e9c5a7980e4095700)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:26.435922 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a094d0-8de2-46ea-be12-b448170ea202 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:26.437561 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 9/17] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:26 2022] GET /identity/v3/users/251b9783da7b448e9c5a7980e4095700 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:34:26.443539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a094d0-8de2-46ea-be12-b448170ea202 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:26.503603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223a4a6-33cd-4336-bd63-c2fdd9eec900 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:26.536792 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a34316-275b-45ad-945c-daa7a9570b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:26.537815 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a34316-275b-45ad-945c-daa7a9570b04 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:26.538100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a34316-275b-45ad-945c-daa7a9570b04 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:26.538380 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a34316-275b-45ad-945c-daa7a9570b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:26.539374 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a094d0-8de2-46ea-be12-b448170ea202 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:26.556960 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a34316-275b-45ad-945c-daa7a9570b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:26.558434 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a34316-275b-45ad-945c-daa7a9570b04 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:26.573196 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740a760-c8e0-4b16-aa18-0cdedd7fb8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:26.573985 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a760-c8e0-4b16-aa18-0cdedd7fb8bf None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:26.574263 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a760-c8e0-4b16-aa18-0cdedd7fb8bf None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:26.574534 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a760-c8e0-4b16-aa18-0cdedd7fb8bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:26.575587 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-f0a34316-275b-45ad-945c-daa7a9570b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:34:26.575694 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740a760-c8e0-4b16-aa18-0cdedd7fb8bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:26.576865 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 9/18] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:34:26.577179 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740a760-c8e0-4b16-aa18-0cdedd7fb8bf None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:26.580661 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 10/19] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:34:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:34:26.582445 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a34316-275b-45ad-945c-daa7a9570b04 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:26.584321 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740a760-c8e0-4b16-aa18-0cdedd7fb8bf None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:26.679686 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a34316-275b-45ad-945c-daa7a9570b04 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:26.679873 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740a760-c8e0-4b16-aa18-0cdedd7fb8bf None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:26.711988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7fbd7-bc20-4770-b1d0-58698067a7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:26.712446 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67130d3-0361-4dc8-8e5a-f76d01a0d82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:26.712937 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7fbd7-bc20-4770-b1d0-58698067a7ec None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:26.713037 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67130d3-0361-4dc8-8e5a-f76d01a0d82b None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:26.713221 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7fbd7-bc20-4770-b1d0-58698067a7ec None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:26.713319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67130d3-0361-4dc8-8e5a-f76d01a0d82b None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:26.713500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7fbd7-bc20-4770-b1d0-58698067a7ec None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:26.713587 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67130d3-0361-4dc8-8e5a-f76d01a0d82b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:26.714227 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7fbd7-bc20-4770-b1d0-58698067a7ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:26.714335 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67130d3-0361-4dc8-8e5a-f76d01a0d82b None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.domain.id=default, user.id=251b9783da7b448e9c5a7980e4095700) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:26.714536 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7fbd7-bc20-4770-b1d0-58698067a7ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:26.714635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67130d3-0361-4dc8-8e5a-f76d01a0d82b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:26.715971 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7fbd7-bc20-4770-b1d0-58698067a7ec None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:26.716127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67130d3-0361-4dc8-8e5a-f76d01a0d82b None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:26.722762 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 11/20] 10.222.0.52 () {56 vars in 1322 bytes} [Thu Apr 14 21:34:26 2022] GET /identity/v3/role_assignments?user.id=251b9783da7b448e9c5a7980e4095700&scope.domain.id=default&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 233 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:26.734110 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 10/21] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:29.499623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa04cca-faf6-4234-979f-9436d9ddc732 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:29.500686 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa04cca-faf6-4234-979f-9436d9ddc732 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:29.501179 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa04cca-faf6-4234-979f-9436d9ddc732 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:29.503134 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 12/22] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:29.508909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858da34-c797-4f43-ba85-8f91dae72573 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:29.509785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858da34-c797-4f43-ba85-8f91dae72573 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:29.510258 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858da34-c797-4f43-ba85-8f91dae72573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:29.537618 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-5858da34-c797-4f43-ba85-8f91dae72573 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:29.539180 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5858da34-c797-4f43-ba85-8f91dae72573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:29.619130 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 11/23] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:29.649648 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa04cca-faf6-4234-979f-9436d9ddc732 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:29.776646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa04cca-faf6-4234-979f-9436d9ddc732 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:29.821012 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53add9-bf9a-4c3d-aff1-436493241283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:29.821818 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53add9-bf9a-4c3d-aff1-436493241283 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:29.822095 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53add9-bf9a-4c3d-aff1-436493241283 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:29.822364 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53add9-bf9a-4c3d-aff1-436493241283 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:29.844363 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53add9-bf9a-4c3d-aff1-436493241283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:29.852165 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-cf53add9-bf9a-4c3d-aff1-436493241283 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:34:29.853694 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 13/24] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:34:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:29.859290 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858da34-c797-4f43-ba85-8f91dae72573 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:30.016907 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858da34-c797-4f43-ba85-8f91dae72573 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:30.066786 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3f5b5-e34b-46be-ab0a-2e6e05d73621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:30.067590 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3f5b5-e34b-46be-ab0a-2e6e05d73621 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:30.067884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3f5b5-e34b-46be-ab0a-2e6e05d73621 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:30.068167 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3f5b5-e34b-46be-ab0a-2e6e05d73621 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:30.068966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3f5b5-e34b-46be-ab0a-2e6e05d73621 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:30.069281 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3f5b5-e34b-46be-ab0a-2e6e05d73621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:30.070684 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3f5b5-e34b-46be-ab0a-2e6e05d73621 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:30.088716 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 12/25] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:34:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:30.095274 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53add9-bf9a-4c3d-aff1-436493241283 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:30.138694 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744ad69-9ac3-4d82-97be-a0b844fe186d None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:30.139208 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744ad69-9ac3-4d82-97be-a0b844fe186d None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:30.139657 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744ad69-9ac3-4d82-97be-a0b844fe186d None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:30.141288 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 13/26] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:30.147397 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93643-9403-4695-ba3b-09a1abdc61fe None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:30.147881 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93643-9403-4695-ba3b-09a1abdc61fe None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:30.148322 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93643-9403-4695-ba3b-09a1abdc61fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:30.173616 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-c3a93643-9403-4695-ba3b-09a1abdc61fe None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:30.175083 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c3a93643-9403-4695-ba3b-09a1abdc61fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:30.272602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 14/27] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:34:30.272602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e6fc8-2747-4978-a1cb-4b5fac6ca740 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:30.272602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e6fc8-2747-4978-a1cb-4b5fac6ca740 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:30.273104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e6fc8-2747-4978-a1cb-4b5fac6ca740 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:30.274703 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 15/28] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:30.275815 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf585ac-2dea-45ce-b217-e1dfdd69dc52 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:30.276097 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf585ac-2dea-45ce-b217-e1dfdd69dc52 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:30.276372 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf585ac-2dea-45ce-b217-e1dfdd69dc52 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:30.277893 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 16/29] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:30.286801 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1b4e1-8d5d-41bb-a857-243f74e050e8 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:30.287456 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1b4e1-8d5d-41bb-a857-243f74e050e8 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:30.287883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1b4e1-8d5d-41bb-a857-243f74e050e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:30.292772 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53add9-bf9a-4c3d-aff1-436493241283 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:30.312739 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-13f1b4e1-8d5d-41bb-a857-243f74e050e8 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:30.314196 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-13f1b4e1-8d5d-41bb-a857-243f74e050e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:30.331967 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff387-5c97-4f91-a5e6-0055be42bc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:30.333893 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff387-5c97-4f91-a5e6-0055be42bc11 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:30.334327 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff387-5c97-4f91-a5e6-0055be42bc11 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:30.334761 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff387-5c97-4f91-a5e6-0055be42bc11 None admin] PATH_INFO: `/v3/users/251b9783da7b448e9c5a7980e4095700` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:30.336179 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ff387-5c97-4f91-a5e6-0055be42bc11 None admin] RBAC: Authorizing `identity:get_user(user_id=251b9783da7b448e9c5a7980e4095700)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:30.338132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ff387-5c97-4f91-a5e6-0055be42bc11 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:30.339943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 14/30] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:30 2022] GET /identity/v3/users/251b9783da7b448e9c5a7980e4095700 => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:30.345560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb406bc-b15e-44a0-ab2f-83c08ad65a81 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:30.346088 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb406bc-b15e-44a0-ab2f-83c08ad65a81 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:30.346588 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb406bc-b15e-44a0-ab2f-83c08ad65a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:30.366141 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-5eb406bc-b15e-44a0-ab2f-83c08ad65a81 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:30.367677 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-5eb406bc-b15e-44a0-ab2f-83c08ad65a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:30.400860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 17/31] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:30.405291 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1b4e1-8d5d-41bb-a857-243f74e050e8 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:30.461713 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 15/32] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:30.463167 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb406bc-b15e-44a0-ab2f-83c08ad65a81 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:30.556245 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1b4e1-8d5d-41bb-a857-243f74e050e8 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:30.584748 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb406bc-b15e-44a0-ab2f-83c08ad65a81 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:30.593932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b194b-472e-43b8-a0fb-51055658d8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:30.595033 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b194b-472e-43b8-a0fb-51055658d8fa None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:30.595529 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b194b-472e-43b8-a0fb-51055658d8fa None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:30.595999 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b194b-472e-43b8-a0fb-51055658d8fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:30.607773 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b194b-472e-43b8-a0fb-51055658d8fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:30.609580 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b194b-472e-43b8-a0fb-51055658d8fa None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:30.621423 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8bf7a-7ce8-447c-9c3d-142749f048a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:30.622238 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8bf7a-7ce8-447c-9c3d-142749f048a5 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:30.622517 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8bf7a-7ce8-447c-9c3d-142749f048a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:30.622790 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8bf7a-7ce8-447c-9c3d-142749f048a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:30.623994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8bf7a-7ce8-447c-9c3d-142749f048a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:30.625476 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8bf7a-7ce8-447c-9c3d-142749f048a5 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:30.629291 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-bf5b194b-472e-43b8-a0fb-51055658d8fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:34:30.631966 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 16/34] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:34:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:30.633048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8bf7a-7ce8-447c-9c3d-142749f048a5 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:30.635616 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 18/34] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:30.636658 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b194b-472e-43b8-a0fb-51055658d8fa None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:30.734819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8bf7a-7ce8-447c-9c3d-142749f048a5 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:30.743398 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b194b-472e-43b8-a0fb-51055658d8fa None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:30.771046 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5b9b9-0d32-4ee3-946d-01cdcaad21a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:30.771999 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b9b9-0d32-4ee3-946d-01cdcaad21a5 None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:30.772441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b9b9-0d32-4ee3-946d-01cdcaad21a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:30.772879 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b9b9-0d32-4ee3-946d-01cdcaad21a5 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:30.773779 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5b9b9-0d32-4ee3-946d-01cdcaad21a5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:30.775332 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5b9b9-0d32-4ee3-946d-01cdcaad21a5 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:30.779584 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe2c9f-93ed-4655-a42e-52f888946b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:30.780538 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe2c9f-93ed-4655-a42e-52f888946b7b None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:30.781046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe2c9f-93ed-4655-a42e-52f888946b7b None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:30.781537 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe2c9f-93ed-4655-a42e-52f888946b7b None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:30.782600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe2c9f-93ed-4655-a42e-52f888946b7b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:30.784183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe2c9f-93ed-4655-a42e-52f888946b7b None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:30.994888 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 17/35] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Apr 14 21:34:30 2022] POST /identity/v3/roles => generated 219 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:34:30.995841 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5b9b9-0d32-4ee3-946d-01cdcaad21a5 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:31.040609 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 19/36] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Apr 14 21:34:30 2022] POST /identity/v3/roles => generated 225 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:34:31.040609 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe2c9f-93ed-4655-a42e-52f888946b7b None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:31.133234 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5b9b9-0d32-4ee3-946d-01cdcaad21a5 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:31.173219 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a6684-6239-4007-99a1-aa922287874d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:31.174345 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a6684-6239-4007-99a1-aa922287874d None admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:31.174759 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a6684-6239-4007-99a1-aa922287874d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:31.175140 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a6684-6239-4007-99a1-aa922287874d None admin] PATH_INFO: `/v3/domains/default/users/251b9783da7b448e9c5a7980e4095700/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:31.178227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a6684-6239-4007-99a1-aa922287874d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=251b9783da7b448e9c5a7980e4095700, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:31.180127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a6684-6239-4007-99a1-aa922287874d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:31.181976 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe2c9f-93ed-4655-a42e-52f888946b7b None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:31.227311 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b59f4-5ad8-4a9e-bf6f-950890deec99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:31.228009 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b59f4-5ad8-4a9e-bf6f-950890deec99 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:31.228296 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b59f4-5ad8-4a9e-bf6f-950890deec99 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:31.228636 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b59f4-5ad8-4a9e-bf6f-950890deec99 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:31.229451 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b59f4-5ad8-4a9e-bf6f-950890deec99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:31.229763 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b59f4-5ad8-4a9e-bf6f-950890deec99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:31.231311 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b59f4-5ad8-4a9e-bf6f-950890deec99 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:31.245500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 20/37] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:31.247002 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4fed5-9041-4956-87df-210a1465f598 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:31.247297 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4fed5-9041-4956-87df-210a1465f598 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:31.247630 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4fed5-9041-4956-87df-210a1465f598 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:31.248935 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 21/38] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:31.250265 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497ba7-57e2-4041-8bf7-c652c5016241 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:31.250562 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497ba7-57e2-4041-8bf7-c652c5016241 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:31.250909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497ba7-57e2-4041-8bf7-c652c5016241 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:31.252342 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 22/39] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:31.253025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2497ba7-57e2-4041-8bf7-c652c5016241 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:31.302825 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 18/40] 10.222.0.52 () {58 vars in 1361 bytes} [Thu Apr 14 21:34:30 2022] PUT /identity/v3/domains/default/users/251b9783da7b448e9c5a7980e4095700/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:34:31.304270 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814568-12a5-4a12-ae4c-de456a6ee3c6 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:31.304596 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814568-12a5-4a12-ae4c-de456a6ee3c6 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:31.304875 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814568-12a5-4a12-ae4c-de456a6ee3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:31.324202 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-51814568-12a5-4a12-ae4c-de456a6ee3c6 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:31.326079 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-51814568-12a5-4a12-ae4c-de456a6ee3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:31.372604 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2497ba7-57e2-4041-8bf7-c652c5016241 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:31.408074 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987d2cc-8655-4ebb-95b8-2debf1e5b136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:31.408749 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 19/41] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:31.409016 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987d2cc-8655-4ebb-95b8-2debf1e5b136 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:31.409314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987d2cc-8655-4ebb-95b8-2debf1e5b136 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:31.409596 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987d2cc-8655-4ebb-95b8-2debf1e5b136 None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:31.411230 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987d2cc-8655-4ebb-95b8-2debf1e5b136 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:31.412161 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb0000-3f70-414e-a712-1af156dbfdb8 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:31.412687 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb0000-3f70-414e-a712-1af156dbfdb8 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:31.412804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987d2cc-8655-4ebb-95b8-2debf1e5b136 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:31.413266 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb0000-3f70-414e-a712-1af156dbfdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:31.434450 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-38fb0000-3f70-414e-a712-1af156dbfdb8 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:31.435766 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-38fb0000-3f70-414e-a712-1af156dbfdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:31.507657 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 20/42] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:31.508437 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb0000-3f70-414e-a712-1af156dbfdb8 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:31.531131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 23/43] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Apr 14 21:34:31 2022] POST /identity/v3/projects => generated 301 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:34:31.532674 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987d2cc-8655-4ebb-95b8-2debf1e5b136 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:31.637460 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb0000-3f70-414e-a712-1af156dbfdb8 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:31.652423 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987d2cc-8655-4ebb-95b8-2debf1e5b136 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:31.684416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a64f8-780f-4536-854c-aa0c5758cc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:31.685268 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a64f8-780f-4536-854c-aa0c5758cc77 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:31.685553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a64f8-780f-4536-854c-aa0c5758cc77 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:31.685827 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a64f8-780f-4536-854c-aa0c5758cc77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:31.687697 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a64f8-780f-4536-854c-aa0c5758cc77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:31.690089 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a64f8-780f-4536-854c-aa0c5758cc77 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:31.693917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 21/44] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:34:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:31.699487 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933273a-1939-4db9-9658-0487ae836a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:31.700191 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933273a-1939-4db9-9658-0487ae836a07 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:31.700471 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933273a-1939-4db9-9658-0487ae836a07 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:31.700768 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933273a-1939-4db9-9658-0487ae836a07 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:31.701511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a64f8-780f-4536-854c-aa0c5758cc77 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:31.701619 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933273a-1939-4db9-9658-0487ae836a07 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:31.703074 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933273a-1939-4db9-9658-0487ae836a07 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:31.796147 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 24/45] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Apr 14 21:34:31 2022] POST /identity/v3/roles => generated 223 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:34:31.816953 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a64f8-780f-4536-854c-aa0c5758cc77 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:31.855049 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48032a0-7bd2-47bd-a168-133689190fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:31.855776 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48032a0-7bd2-47bd-a168-133689190fad None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:31.856062 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48032a0-7bd2-47bd-a168-133689190fad None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:31.856339 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48032a0-7bd2-47bd-a168-133689190fad None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:31.857124 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48032a0-7bd2-47bd-a168-133689190fad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:31.858634 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48032a0-7bd2-47bd-a168-133689190fad None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:31.969230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 22/46] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Apr 14 21:34:31 2022] POST /identity/v3/projects => generated 312 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:34:33.658134 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd230d72-fa87-482d-81cd-1ece814005cd None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:33.658681 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd230d72-fa87-482d-81cd-1ece814005cd None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:33.658681 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd230d72-fa87-482d-81cd-1ece814005cd None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:33.660049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 25/47] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:33.666524 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e86af3-d100-4a36-9b67-183d7b3551ba None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:33.666915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e86af3-d100-4a36-9b67-183d7b3551ba None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:33.667244 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e86af3-d100-4a36-9b67-183d7b3551ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:33.683686 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-c4e86af3-d100-4a36-9b67-183d7b3551ba None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:33.684912 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c4e86af3-d100-4a36-9b67-183d7b3551ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:33.749251 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 23/48] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:33.774624 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd230d72-fa87-482d-81cd-1ece814005cd None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:33.873088 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd230d72-fa87-482d-81cd-1ece814005cd None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:33.907655 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6557d8-5428-43be-8e2d-0ebf677bbce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:33.908536 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6557d8-5428-43be-8e2d-0ebf677bbce7 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:33.908796 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6557d8-5428-43be-8e2d-0ebf677bbce7 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:33.909072 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6557d8-5428-43be-8e2d-0ebf677bbce7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:33.923492 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6557d8-5428-43be-8e2d-0ebf677bbce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:33.931107 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-6d6557d8-5428-43be-8e2d-0ebf677bbce7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:34:33.932367 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 26/49] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:34:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:33.938146 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e86af3-d100-4a36-9b67-183d7b3551ba None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:34.036029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e86af3-d100-4a36-9b67-183d7b3551ba None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:34.068830 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6ba6c-fa34-4a58-a9ff-69d4604bc4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:34.069505 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6ba6c-fa34-4a58-a9ff-69d4604bc4b7 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:34.069793 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6ba6c-fa34-4a58-a9ff-69d4604bc4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:34.070073 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6ba6c-fa34-4a58-a9ff-69d4604bc4b7 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:34.070833 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6ba6c-fa34-4a58-a9ff-69d4604bc4b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:34.071145 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6ba6c-fa34-4a58-a9ff-69d4604bc4b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:34.072540 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6ba6c-fa34-4a58-a9ff-69d4604bc4b7 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:34.080321 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 24/50] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:34:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:34.086133 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6557d8-5428-43be-8e2d-0ebf677bbce7 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:34.183728 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6557d8-5428-43be-8e2d-0ebf677bbce7 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:34.215937 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ccc34-9c69-4dfb-a478-fd0069b1be0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:34.216848 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ccc34-9c69-4dfb-a478-fd0069b1be0d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:34.217129 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ccc34-9c69-4dfb-a478-fd0069b1be0d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:34.217408 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ccc34-9c69-4dfb-a478-fd0069b1be0d None admin] PATH_INFO: `/v3/users/251b9783da7b448e9c5a7980e4095700` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:34.218846 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ccc34-9c69-4dfb-a478-fd0069b1be0d None admin] RBAC: Authorizing `identity:get_user(user_id=251b9783da7b448e9c5a7980e4095700)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:34.220313 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ccc34-9c69-4dfb-a478-fd0069b1be0d None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:34.222168 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 27/51] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:34 2022] GET /identity/v3/users/251b9783da7b448e9c5a7980e4095700 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:34.227714 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6ba6c-fa34-4a58-a9ff-69d4604bc4b7 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:34.276463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ea14b-b8c2-4286-8c61-e0562bbccdd1 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:34.276778 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ea14b-b8c2-4286-8c61-e0562bbccdd1 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:34.277057 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ea14b-b8c2-4286-8c61-e0562bbccdd1 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:34.278416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 28/52] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:34:34.283387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912759e-1462-454f-9adc-0023f0a0b119 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:34.283768 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912759e-1462-454f-9adc-0023f0a0b119 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:34.284087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912759e-1462-454f-9adc-0023f0a0b119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:34.300761 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-2912759e-1462-454f-9adc-0023f0a0b119 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:34.303174 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-2912759e-1462-454f-9adc-0023f0a0b119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:34.323283 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6ba6c-fa34-4a58-a9ff-69d4604bc4b7 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:34.354852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ecb33-2669-4176-9413-b781dd8ae3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:34.355645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ecb33-2669-4176-9413-b781dd8ae3eb None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:34.355931 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ecb33-2669-4176-9413-b781dd8ae3eb None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:34.356209 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ecb33-2669-4176-9413-b781dd8ae3eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:34.357426 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ecb33-2669-4176-9413-b781dd8ae3eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:34.358902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ecb33-2669-4176-9413-b781dd8ae3eb None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:34.360527 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 25/53] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:34:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:34.366947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ecb33-2669-4176-9413-b781dd8ae3eb None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:34.367498 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 29/54] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:34:34.392099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912759e-1462-454f-9adc-0023f0a0b119 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:34.461459 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ecb33-2669-4176-9413-b781dd8ae3eb None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:34.484819 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912759e-1462-454f-9adc-0023f0a0b119 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:34.494081 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb2cab-8ec6-429a-a733-9b9591d9c437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:34.494820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb2cab-8ec6-429a-a733-9b9591d9c437 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:34.495112 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb2cab-8ec6-429a-a733-9b9591d9c437 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:34.495392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb2cab-8ec6-429a-a733-9b9591d9c437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:34.496231 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb2cab-8ec6-429a-a733-9b9591d9c437 None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.domain.id=default, user.id=251b9783da7b448e9c5a7980e4095700) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:34.496548 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb2cab-8ec6-429a-a733-9b9591d9c437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:34.498044 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb2cab-8ec6-429a-a733-9b9591d9c437 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:34.503959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 26/55] 10.222.0.52 () {56 vars in 1322 bytes} [Thu Apr 14 21:34:34 2022] GET /identity/v3/role_assignments?user.id=251b9783da7b448e9c5a7980e4095700&scope.domain.id=default&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 530 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:34:34.518082 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40026145-5945-463d-aa32-57b0c1f52c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:34.518911 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40026145-5945-463d-aa32-57b0c1f52c21 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:34.519197 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40026145-5945-463d-aa32-57b0c1f52c21 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:34.519474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40026145-5945-463d-aa32-57b0c1f52c21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:34.520819 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40026145-5945-463d-aa32-57b0c1f52c21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:34.522330 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40026145-5945-463d-aa32-57b0c1f52c21 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:34.524061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 30/56] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:34:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:34:34.530069 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb2cab-8ec6-429a-a733-9b9591d9c437 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:34.632701 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb2cab-8ec6-429a-a733-9b9591d9c437 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:34.666389 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83175ada-6ff2-4091-b9c8-536e84db2350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:34.667090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83175ada-6ff2-4091-b9c8-536e84db2350 None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:34.667635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83175ada-6ff2-4091-b9c8-536e84db2350 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:34.667635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83175ada-6ff2-4091-b9c8-536e84db2350 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:34.668338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83175ada-6ff2-4091-b9c8-536e84db2350 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:34.669847 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83175ada-6ff2-4091-b9c8-536e84db2350 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:34.787656 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 27/57] 10.222.0.52 () {60 vars in 1140 bytes} [Thu Apr 14 21:34:34 2022] POST /identity/v3/projects => generated 298 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:34:37.071617 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb747-927c-417d-87e7-c4fc7f4f899d None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:37.072127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb747-927c-417d-87e7-c4fc7f4f899d None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:37.072318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb747-927c-417d-87e7-c4fc7f4f899d None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:37.073631 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 31/58] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:37.078754 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65968f96-47e6-4bd4-b49d-8709da98ac0a None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:37.079170 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65968f96-47e6-4bd4-b49d-8709da98ac0a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:37.079321 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65968f96-47e6-4bd4-b49d-8709da98ac0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:37.096458 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-65968f96-47e6-4bd4-b49d-8709da98ac0a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:37.097692 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-65968f96-47e6-4bd4-b49d-8709da98ac0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:37.162381 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 28/59] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:37.188084 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fb747-927c-417d-87e7-c4fc7f4f899d None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:37.286082 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fb747-927c-417d-87e7-c4fc7f4f899d None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:37.319640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baabf43-a5e1-4c28-96c7-162a64e311b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:37.320416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baabf43-a5e1-4c28-96c7-162a64e311b8 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:37.320729 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baabf43-a5e1-4c28-96c7-162a64e311b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:37.321004 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baabf43-a5e1-4c28-96c7-162a64e311b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:37.322228 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baabf43-a5e1-4c28-96c7-162a64e311b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:37.323682 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baabf43-a5e1-4c28-96c7-162a64e311b8 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:37.325308 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 32/60] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:34:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:37.330798 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65968f96-47e6-4bd4-b49d-8709da98ac0a None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:37.422607 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65968f96-47e6-4bd4-b49d-8709da98ac0a None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:37.455596 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186a088-aca6-492e-bd6f-4f148b21ee4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:37.456259 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186a088-aca6-492e-bd6f-4f148b21ee4c None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:37.456540 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186a088-aca6-492e-bd6f-4f148b21ee4c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:37.456843 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186a088-aca6-492e-bd6f-4f148b21ee4c None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:37.457586 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186a088-aca6-492e-bd6f-4f148b21ee4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:37.459021 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186a088-aca6-492e-bd6f-4f148b21ee4c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:37.588247 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 29/61] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:34:37 2022] POST /identity/v3/users => generated 275 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:34:41.009478 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bc2ca-e8ca-4bb7-b013-d149a97fbd74 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:41.011033 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bc2ca-e8ca-4bb7-b013-d149a97fbd74 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:41.011507 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bc2ca-e8ca-4bb7-b013-d149a97fbd74 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:41.013486 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 33/62] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:41.018466 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f210e-d96e-4455-8515-53366f0c7db7 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:41.019275 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f210e-d96e-4455-8515-53366f0c7db7 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:41.019792 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f210e-d96e-4455-8515-53366f0c7db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:41.040795 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-560f210e-d96e-4455-8515-53366f0c7db7 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:41.042293 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-560f210e-d96e-4455-8515-53366f0c7db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:41.126950 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 30/63] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:41.164051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bc2ca-e8ca-4bb7-b013-d149a97fbd74 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:41.220403 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e915c88-b92f-4828-a2de-656184c591f1 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:41.220403 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e915c88-b92f-4828-a2de-656184c591f1 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:41.220403 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e915c88-b92f-4828-a2de-656184c591f1 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:41.220403 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 31/64] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:34:41.227240 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc503c-f349-4eb4-aceb-0a194530fee7 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:41.227789 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc503c-f349-4eb4-aceb-0a194530fee7 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:41.228283 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc503c-f349-4eb4-aceb-0a194530fee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:41.246442 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-a3fc503c-f349-4eb4-aceb-0a194530fee7 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:41.247885 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-a3fc503c-f349-4eb4-aceb-0a194530fee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:41.295499 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bc2ca-e8ca-4bb7-b013-d149a97fbd74 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:41.321846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 32/65] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:34:41.323437 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a3281-5ae5-4e70-9c05-024e6da531c0 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:41.323866 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a3281-5ae5-4e70-9c05-024e6da531c0 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:41.324294 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a3281-5ae5-4e70-9c05-024e6da531c0 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:41.325973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 33/66] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:41.331198 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400fdc4-4196-4692-9174-216c71c6f1c2 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:41.331668 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400fdc4-4196-4692-9174-216c71c6f1c2 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:41.332234 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400fdc4-4196-4692-9174-216c71c6f1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:41.349298 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a209f7-85d7-4fc5-8a8d-7e3d326775d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:41.350120 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a209f7-85d7-4fc5-8a8d-7e3d326775d6 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:41.350403 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a209f7-85d7-4fc5-8a8d-7e3d326775d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:41.350679 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a209f7-85d7-4fc5-8a8d-7e3d326775d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:41.351457 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-c400fdc4-4196-4692-9174-216c71c6f1c2 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:41.353034 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c400fdc4-4196-4692-9174-216c71c6f1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:41.362578 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a209f7-85d7-4fc5-8a8d-7e3d326775d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:41.370923 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-b4a209f7-85d7-4fc5-8a8d-7e3d326775d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:34:41.372786 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 34/67] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:34:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:41.375004 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a209f7-85d7-4fc5-8a8d-7e3d326775d6 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:41.433696 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 34/68] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:34:41.442481 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400fdc4-4196-4692-9174-216c71c6f1c2 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:41.481175 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a209f7-85d7-4fc5-8a8d-7e3d326775d6 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:41.516015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29134e66-8366-42de-982c-90a3cc417a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:41.517145 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29134e66-8366-42de-982c-90a3cc417a44 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:41.517572 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29134e66-8366-42de-982c-90a3cc417a44 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:41.517988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29134e66-8366-42de-982c-90a3cc417a44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:41.528863 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29134e66-8366-42de-982c-90a3cc417a44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:41.537236 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-29134e66-8366-42de-982c-90a3cc417a44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 14 21:34:41.539050 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 35/69] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:34:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:41.539963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29134e66-8366-42de-982c-90a3cc417a44 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:41.556813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400fdc4-4196-4692-9174-216c71c6f1c2 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:41.600231 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79966c6e-05da-4399-ba94-1fa62eb5fe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:41.601622 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79966c6e-05da-4399-ba94-1fa62eb5fe2a None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:41.602064 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79966c6e-05da-4399-ba94-1fa62eb5fe2a None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:41.602346 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79966c6e-05da-4399-ba94-1fa62eb5fe2a None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:41.603117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79966c6e-05da-4399-ba94-1fa62eb5fe2a None admin] RBAC: Adding query filter params (name=member) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:41.603423 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79966c6e-05da-4399-ba94-1fa62eb5fe2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:41.604849 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79966c6e-05da-4399-ba94-1fa62eb5fe2a None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:41.613802 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 35/70] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:34:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:41.614607 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79966c6e-05da-4399-ba94-1fa62eb5fe2a None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:41.657634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29134e66-8366-42de-982c-90a3cc417a44 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:41.691746 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d40cef-4f5c-4cda-8bcf-5166f7f8f9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:41.692635 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d40cef-4f5c-4cda-8bcf-5166f7f8f9a9 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:41.692915 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d40cef-4f5c-4cda-8bcf-5166f7f8f9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:41.693186 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d40cef-4f5c-4cda-8bcf-5166f7f8f9a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:41.703476 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d40cef-4f5c-4cda-8bcf-5166f7f8f9a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:41.711466 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-90d40cef-4f5c-4cda-8bcf-5166f7f8f9a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:34:41.713533 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 36/71] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:34:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:41.713836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79966c6e-05da-4399-ba94-1fa62eb5fe2a None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:41.714932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91fc5c-dbb8-4552-af8e-4cc4d82f3e8d None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:41.715217 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91fc5c-dbb8-4552-af8e-4cc4d82f3e8d None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:41.715499 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91fc5c-dbb8-4552-af8e-4cc4d82f3e8d None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:41.716819 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 37/72] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:41.717648 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91fc5c-dbb8-4552-af8e-4cc4d82f3e8d None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:41.756160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee6179-61d5-42dc-88c5-e3c68f01a4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:41.756871 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6179-61d5-42dc-88c5-e3c68f01a4f6 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:41.757311 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6179-61d5-42dc-88c5-e3c68f01a4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:41.757753 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6179-61d5-42dc-88c5-e3c68f01a4f6 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:41.758699 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee6179-61d5-42dc-88c5-e3c68f01a4f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:41.759148 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee6179-61d5-42dc-88c5-e3c68f01a4f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:41.760698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee6179-61d5-42dc-88c5-e3c68f01a4f6 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:41.768948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:34:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:41.770612 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee6179-61d5-42dc-88c5-e3c68f01a4f6 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:41.833695 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91fc5c-dbb8-4552-af8e-4cc4d82f3e8d None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:41.866450 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaab369-160b-4210-92d8-e418b66df14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:41.867325 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaab369-160b-4210-92d8-e418b66df14a None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:41.867609 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaab369-160b-4210-92d8-e418b66df14a None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:41.867886 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaab369-160b-4210-92d8-e418b66df14a None admin] PATH_INFO: `/v3/users/70c226c0c5ea45f29547a5be6433762e` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:41.869362 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee6179-61d5-42dc-88c5-e3c68f01a4f6 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:41.882268 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaab369-160b-4210-92d8-e418b66df14a None admin] RBAC: Authorizing `identity:get_user(user_id=70c226c0c5ea45f29547a5be6433762e)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:41.883730 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaab369-160b-4210-92d8-e418b66df14a None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:41.885435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 38/74] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:41 2022] GET /identity/v3/users/70c226c0c5ea45f29547a5be6433762e => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:41.886717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff534254-b982-4537-b0ce-1b15c18c7b57 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:41.887006 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff534254-b982-4537-b0ce-1b15c18c7b57 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:41.887284 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff534254-b982-4537-b0ce-1b15c18c7b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:41.901171 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e5598-e251-43c0-b6d1-c33534dfc888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:41.901843 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e5598-e251-43c0-b6d1-c33534dfc888 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:41.902127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e5598-e251-43c0-b6d1-c33534dfc888 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:41.902405 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e5598-e251-43c0-b6d1-c33534dfc888 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:41.903159 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e5598-e251-43c0-b6d1-c33534dfc888 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:41.903466 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e5598-e251-43c0-b6d1-c33534dfc888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:41.904554 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-ff534254-b982-4537-b0ce-1b15c18c7b57 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:41.904862 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e5598-e251-43c0-b6d1-c33534dfc888 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:41.905770 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ff534254-b982-4537-b0ce-1b15c18c7b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:41.913313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:34:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:41.914105 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e5598-e251-43c0-b6d1-c33534dfc888 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:41.975176 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 39/76] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:41.976597 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fcf4c-9c23-4dc0-ba6a-e023eea368db None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:41.976907 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fcf4c-9c23-4dc0-ba6a-e023eea368db None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:41.977192 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fcf4c-9c23-4dc0-ba6a-e023eea368db None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:41.978466 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 40/77] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:41.979305 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fcf4c-9c23-4dc0-ba6a-e023eea368db None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:42.013747 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e5598-e251-43c0-b6d1-c33534dfc888 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:42.045690 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030c447-3c1e-4c8f-bc8f-4a6196b78724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:42.046488 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030c447-3c1e-4c8f-bc8f-4a6196b78724 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:42.046767 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030c447-3c1e-4c8f-bc8f-4a6196b78724 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:42.047040 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030c447-3c1e-4c8f-bc8f-4a6196b78724 None admin] PATH_INFO: `/v3/users/70c226c0c5ea45f29547a5be6433762e` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:42.048224 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030c447-3c1e-4c8f-bc8f-4a6196b78724 None admin] RBAC: Authorizing `identity:get_user(user_id=70c226c0c5ea45f29547a5be6433762e)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:42.049721 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030c447-3c1e-4c8f-bc8f-4a6196b78724 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:42.051529 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 38/78] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:41 2022] GET /identity/v3/users/70c226c0c5ea45f29547a5be6433762e => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:42.052284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030c447-3c1e-4c8f-bc8f-4a6196b78724 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:42.084477 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fcf4c-9c23-4dc0-ba6a-e023eea368db None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:42.116485 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206aebb0-e1d9-4419-a519-906876b654eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:42.117159 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aebb0-e1d9-4419-a519-906876b654eb None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:42.117444 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aebb0-e1d9-4419-a519-906876b654eb None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:42.117733 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aebb0-e1d9-4419-a519-906876b654eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:42.146834 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030c447-3c1e-4c8f-bc8f-4a6196b78724 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:42.177911 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa832cab-c76c-4757-b8d5-bce6952864fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:42.178764 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832cab-c76c-4757-b8d5-bce6952864fd None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:42.179043 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832cab-c76c-4757-b8d5-bce6952864fd None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:42.179312 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832cab-c76c-4757-b8d5-bce6952864fd None admin] PATH_INFO: `/v3/users/251b9783da7b448e9c5a7980e4095700` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:42.180504 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa832cab-c76c-4757-b8d5-bce6952864fd None admin] RBAC: Authorizing `identity:get_user(user_id=251b9783da7b448e9c5a7980e4095700)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:42.181521 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206aebb0-e1d9-4419-a519-906876b654eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:42.181985 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa832cab-c76c-4757-b8d5-bce6952864fd None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:42.182981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206aebb0-e1d9-4419-a519-906876b654eb None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:42.183771 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 39/79] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:42 2022] GET /identity/v3/users/251b9783da7b448e9c5a7980e4095700 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:42.184912 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266b87a-5b08-42c7-8abf-113d4d0feaa5 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:42.185203 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266b87a-5b08-42c7-8abf-113d4d0feaa5 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:42.185485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266b87a-5b08-42c7-8abf-113d4d0feaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:42.202491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-8266b87a-5b08-42c7-8abf-113d4d0feaa5 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:42.203679 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8266b87a-5b08-42c7-8abf-113d4d0feaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:42.266929 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 40/80] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:42.267959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266b87a-5b08-42c7-8abf-113d4d0feaa5 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:42.288894 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 41/81] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:34:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:34:42.289755 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206aebb0-e1d9-4419-a519-906876b654eb None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:42.367857 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266b87a-5b08-42c7-8abf-113d4d0feaa5 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:42.384231 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206aebb0-e1d9-4419-a519-906876b654eb None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:42.400188 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa35bd-db81-4611-a398-b9c71a71b71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:42.401012 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa35bd-db81-4611-a398-b9c71a71b71e None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:42.401291 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa35bd-db81-4611-a398-b9c71a71b71e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:42.401560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa35bd-db81-4611-a398-b9c71a71b71e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:42.412479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa35bd-db81-4611-a398-b9c71a71b71e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:42.417575 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ceb63e-b659-408d-b800-d5d97aeae9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:42.418223 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ceb63e-b659-408d-b800-d5d97aeae9ba None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:42.418505 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ceb63e-b659-408d-b800-d5d97aeae9ba None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:42.418780 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ceb63e-b659-408d-b800-d5d97aeae9ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:42.420598 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-a3fa35bd-db81-4611-a398-b9c71a71b71e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:34:42.421834 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 41/82] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:34:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:42.422604 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa35bd-db81-4611-a398-b9c71a71b71e None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:42.483864 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ceb63e-b659-408d-b800-d5d97aeae9ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:42.485365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ceb63e-b659-408d-b800-d5d97aeae9ba None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:42.517552 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa35bd-db81-4611-a398-b9c71a71b71e None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:42.549924 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae748819-2dd2-447d-b8cc-7ce2bcbd6751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:42.550587 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae748819-2dd2-447d-b8cc-7ce2bcbd6751 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:42.550894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae748819-2dd2-447d-b8cc-7ce2bcbd6751 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:42.551171 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae748819-2dd2-447d-b8cc-7ce2bcbd6751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:42.577821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 42/83] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:34:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:34:42.578666 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ceb63e-b659-408d-b800-d5d97aeae9ba None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:42.617449 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae748819-2dd2-447d-b8cc-7ce2bcbd6751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:42.618984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae748819-2dd2-447d-b8cc-7ce2bcbd6751 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:42.674604 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ceb63e-b659-408d-b800-d5d97aeae9ba None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:42.709719 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d78239-0fad-456c-9306-cd7d3dc10ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:42.710520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78239-0fad-456c-9306-cd7d3dc10ff8 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:42.710807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78239-0fad-456c-9306-cd7d3dc10ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:42.711086 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78239-0fad-456c-9306-cd7d3dc10ff8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:42.712539 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d78239-0fad-456c-9306-cd7d3dc10ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:42.714036 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d78239-0fad-456c-9306-cd7d3dc10ff8 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:42.715689 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 43/84] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:34:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:42.716445 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d78239-0fad-456c-9306-cd7d3dc10ff8 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:42.725252 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 42/85] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:34:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:34:42.726700 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae748819-2dd2-447d-b8cc-7ce2bcbd6751 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:42.815029 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d78239-0fad-456c-9306-cd7d3dc10ff8 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:42.825944 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae748819-2dd2-447d-b8cc-7ce2bcbd6751 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:42.849404 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8177-1353-4ffc-a1bb-9674d2a5badb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:42.850260 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8177-1353-4ffc-a1bb-9674d2a5badb None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:42.850548 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8177-1353-4ffc-a1bb-9674d2a5badb None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:42.850815 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8177-1353-4ffc-a1bb-9674d2a5badb None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:42.852015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb8177-1353-4ffc-a1bb-9674d2a5badb None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:42.853489 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb8177-1353-4ffc-a1bb-9674d2a5badb None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:42.855184 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 44/86] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:34:42 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:42.856066 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8177-1353-4ffc-a1bb-9674d2a5badb None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:42.865795 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec7819-9f87-44f5-bf28-34485d1a564a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:42.866560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec7819-9f87-44f5-bf28-34485d1a564a None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:42.866849 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec7819-9f87-44f5-bf28-34485d1a564a None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:42.867166 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec7819-9f87-44f5-bf28-34485d1a564a None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:42.867924 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec7819-9f87-44f5-bf28-34485d1a564a None admin] RBAC: Adding query filter params (name=member) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:42.868239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec7819-9f87-44f5-bf28-34485d1a564a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:42.869722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec7819-9f87-44f5-bf28-34485d1a564a None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:42.879760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 43/87] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:34:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:42.884409 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec7819-9f87-44f5-bf28-34485d1a564a None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:42.961709 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8177-1353-4ffc-a1bb-9674d2a5badb None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:42.981130 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec7819-9f87-44f5-bf28-34485d1a564a None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:42.994431 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920f2cd-e525-4dd1-8f75-c892e6e2bb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:42.995291 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f2cd-e525-4dd1-8f75-c892e6e2bb25 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:42.995567 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f2cd-e525-4dd1-8f75-c892e6e2bb25 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:42.995839 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f2cd-e525-4dd1-8f75-c892e6e2bb25 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:42.997059 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920f2cd-e525-4dd1-8f75-c892e6e2bb25 None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:42.998494 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920f2cd-e525-4dd1-8f75-c892e6e2bb25 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:43.000201 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 45/88] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:34:42 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:43.001040 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920f2cd-e525-4dd1-8f75-c892e6e2bb25 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:43.013227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914a7ec-2bba-4abd-a81a-c4c4f51dbacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:43.013906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914a7ec-2bba-4abd-a81a-c4c4f51dbacc None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:43.014189 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914a7ec-2bba-4abd-a81a-c4c4f51dbacc None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:43.014468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914a7ec-2bba-4abd-a81a-c4c4f51dbacc None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:43.015180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914a7ec-2bba-4abd-a81a-c4c4f51dbacc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:43.016658 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914a7ec-2bba-4abd-a81a-c4c4f51dbacc None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:43.099848 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920f2cd-e525-4dd1-8f75-c892e6e2bb25 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:43.124824 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 44/89] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:34:42 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:34:43.125655 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914a7ec-2bba-4abd-a81a-c4c4f51dbacc None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:43.133859 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0f8d9-4918-405f-9897-b482667810e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:43.134751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0f8d9-4918-405f-9897-b482667810e4 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:43.135030 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0f8d9-4918-405f-9897-b482667810e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:43.135422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0f8d9-4918-405f-9897-b482667810e4 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:43.136770 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0f8d9-4918-405f-9897-b482667810e4 None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:43.138661 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0f8d9-4918-405f-9897-b482667810e4 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:43.145238 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 46/90] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:34:43 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:43.145238 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0f8d9-4918-405f-9897-b482667810e4 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:43.232436 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914a7ec-2bba-4abd-a81a-c4c4f51dbacc None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:43.252240 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0f8d9-4918-405f-9897-b482667810e4 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:43.270249 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c26f0-462a-43d9-b597-d4aabcd80cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:43.270924 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c26f0-462a-43d9-b597-d4aabcd80cbf None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:43.271212 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c26f0-462a-43d9-b597-d4aabcd80cbf None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:43.271492 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c26f0-462a-43d9-b597-d4aabcd80cbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:43.272344 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c26f0-462a-43d9-b597-d4aabcd80cbf None admin] RBAC: Adding query filter params (role.id=4a3588df731c452fba80b071fc342f78, scope.project.id=830f37ab382049b4b39840d0c29b05c0, user.id=70c226c0c5ea45f29547a5be6433762e) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:43.272719 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c26f0-462a-43d9-b597-d4aabcd80cbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:43.274260 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c26f0-462a-43d9-b597-d4aabcd80cbf None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:43.288952 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 45/91] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:34:43 2022] GET /identity/v3/role_assignments?user.id=70c226c0c5ea45f29547a5be6433762e&scope.project.id=830f37ab382049b4b39840d0c29b05c0&role.id=4a3588df731c452fba80b071fc342f78 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:43.288952 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c26f0-462a-43d9-b597-d4aabcd80cbf None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:43.289198 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288d858-722a-4742-b66e-7657aac77736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:43.289198 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288d858-722a-4742-b66e-7657aac77736 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:43.289556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288d858-722a-4742-b66e-7657aac77736 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:43.289734 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288d858-722a-4742-b66e-7657aac77736 None admin] PATH_INFO: `/v3/users/70c226c0c5ea45f29547a5be6433762e` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:43.291068 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288d858-722a-4742-b66e-7657aac77736 None admin] RBAC: Authorizing `identity:get_user(user_id=70c226c0c5ea45f29547a5be6433762e)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:43.292614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288d858-722a-4742-b66e-7657aac77736 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:43.294431 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 47/92] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:43 2022] GET /identity/v3/users/70c226c0c5ea45f29547a5be6433762e => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:43.295243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288d858-722a-4742-b66e-7657aac77736 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:43.413495 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c26f0-462a-43d9-b597-d4aabcd80cbf None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:43.433809 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288d858-722a-4742-b66e-7657aac77736 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:43.454748 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab5d0c-2756-478b-841b-5984c049e1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:43.455426 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab5d0c-2756-478b-841b-5984c049e1ba None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:43.455704 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab5d0c-2756-478b-841b-5984c049e1ba None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:43.455980 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab5d0c-2756-478b-841b-5984c049e1ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:43.456928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab5d0c-2756-478b-841b-5984c049e1ba None admin] RBAC: Adding query filter params (role.id=c25cb9d119a74c7281a986fa76a92af6, scope.project.id=830f37ab382049b4b39840d0c29b05c0, user.id=70c226c0c5ea45f29547a5be6433762e) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:43.457247 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab5d0c-2756-478b-841b-5984c049e1ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:43.459042 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab5d0c-2756-478b-841b-5984c049e1ba None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:43.466291 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 46/93] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:34:43 2022] GET /identity/v3/role_assignments?user.id=70c226c0c5ea45f29547a5be6433762e&scope.project.id=830f37ab382049b4b39840d0c29b05c0&role.id=c25cb9d119a74c7281a986fa76a92af6 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:43.467208 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab5d0c-2756-478b-841b-5984c049e1ba None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:43.489842 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b322e-6978-4f97-af7a-c0d7d6d748dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:43.490873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b322e-6978-4f97-af7a-c0d7d6d748dd None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:43.491337 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b322e-6978-4f97-af7a-c0d7d6d748dd None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:43.491789 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b322e-6978-4f97-af7a-c0d7d6d748dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:43.492890 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b322e-6978-4f97-af7a-c0d7d6d748dd None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=830f37ab382049b4b39840d0c29b05c0, user.id=251b9783da7b448e9c5a7980e4095700) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:43.493393 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b322e-6978-4f97-af7a-c0d7d6d748dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:43.495075 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b322e-6978-4f97-af7a-c0d7d6d748dd None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:43.510370 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 48/94] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:34:43 2022] GET /identity/v3/role_assignments?user.id=251b9783da7b448e9c5a7980e4095700&scope.project.id=830f37ab382049b4b39840d0c29b05c0&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:43.592070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab5d0c-2756-478b-841b-5984c049e1ba None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:43.636015 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebb31b-a397-4a35-a2df-41798349c5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:43.636718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebb31b-a397-4a35-a2df-41798349c5c3 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:43.637008 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebb31b-a397-4a35-a2df-41798349c5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:43.637288 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebb31b-a397-4a35-a2df-41798349c5c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:43.730060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebb31b-a397-4a35-a2df-41798349c5c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:43.731618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebb31b-a397-4a35-a2df-41798349c5c3 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:43.840096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 47/95] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:34:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:34:43.845800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b322e-6978-4f97-af7a-c0d7d6d748dd None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:44.032414 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b322e-6978-4f97-af7a-c0d7d6d748dd None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:44.080164 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385fd27-3466-4b0d-80b8-920fae1102be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:44.081071 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385fd27-3466-4b0d-80b8-920fae1102be None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:44.081358 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385fd27-3466-4b0d-80b8-920fae1102be None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:44.081638 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385fd27-3466-4b0d-80b8-920fae1102be None admin] PATH_INFO: `/v3/projects/0af3727abdcc46e899512dd46876421c` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:44.082887 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385fd27-3466-4b0d-80b8-920fae1102be None admin] RBAC: Authorizing `identity:get_project(project_id=0af3727abdcc46e899512dd46876421c)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:44.084356 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385fd27-3466-4b0d-80b8-920fae1102be None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:44.086416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 49/96] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:34:43 2022] GET /identity/v3/projects/0af3727abdcc46e899512dd46876421c => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:44.092359 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebb31b-a397-4a35-a2df-41798349c5c3 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:44.236330 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebb31b-a397-4a35-a2df-41798349c5c3 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:44.285582 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47628ed1-bf6b-4af9-a673-10f2edaf483c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:44.286596 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47628ed1-bf6b-4af9-a673-10f2edaf483c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:44.287238 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47628ed1-bf6b-4af9-a673-10f2edaf483c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:44.287727 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47628ed1-bf6b-4af9-a673-10f2edaf483c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:44.288836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47628ed1-bf6b-4af9-a673-10f2edaf483c None admin] RBAC: Adding query filter params (role.id=4a3588df731c452fba80b071fc342f78, scope.project.id=0af3727abdcc46e899512dd46876421c, user.id=70c226c0c5ea45f29547a5be6433762e) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:44.289366 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47628ed1-bf6b-4af9-a673-10f2edaf483c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:44.291038 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47628ed1-bf6b-4af9-a673-10f2edaf483c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:44.301183 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 48/97] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:34:44 2022] GET /identity/v3/role_assignments?user.id=70c226c0c5ea45f29547a5be6433762e&scope.project.id=0af3727abdcc46e899512dd46876421c&role.id=4a3588df731c452fba80b071fc342f78 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:46.475914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670abc05-85b4-4b72-a8e0-0f8ac4aeb993 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:46.476482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670abc05-85b4-4b72-a8e0-0f8ac4aeb993 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:46.476482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670abc05-85b4-4b72-a8e0-0f8ac4aeb993 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:46.478056 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 50/98] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:46.483924 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83bd7f-dcb2-434f-9889-989e542b9e9a None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:46.484851 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83bd7f-dcb2-434f-9889-989e542b9e9a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:46.485341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83bd7f-dcb2-434f-9889-989e542b9e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:46.510044 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-cb83bd7f-dcb2-434f-9889-989e542b9e9a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:46.511654 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-cb83bd7f-dcb2-434f-9889-989e542b9e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:46.611375 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 49/99] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:46.650258 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670abc05-85b4-4b72-a8e0-0f8ac4aeb993 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:46.747337 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e70eda-7e9a-4825-b6c1-dbf4eb2f8b55 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:46.747941 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e70eda-7e9a-4825-b6c1-dbf4eb2f8b55 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:46.748463 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e70eda-7e9a-4825-b6c1-dbf4eb2f8b55 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:46.750441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 50/100] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:34:46.757844 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ee404-1bd6-455d-bd25-a30f75e83a2a None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:46.758412 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ee404-1bd6-455d-bd25-a30f75e83a2a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:46.758910 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ee404-1bd6-455d-bd25-a30f75e83a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:46.780493 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670abc05-85b4-4b72-a8e0-0f8ac4aeb993 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:46.797133 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-eb8ee404-1bd6-455d-bd25-a30f75e83a2a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:46.798335 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-eb8ee404-1bd6-455d-bd25-a30f75e83a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:46.845257 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8c1d8-ae38-4b33-b060-8fddd75171ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:46.846066 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8c1d8-ae38-4b33-b060-8fddd75171ef None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:46.846350 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8c1d8-ae38-4b33-b060-8fddd75171ef None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:46.846621 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8c1d8-ae38-4b33-b060-8fddd75171ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:46.863561 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8c1d8-ae38-4b33-b060-8fddd75171ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:46.871471 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-5ef8c1d8-ae38-4b33-b060-8fddd75171ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:34:46.874353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 51/101] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:34:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:46.875906 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e4428-aa18-4c10-aa57-75c0dc6c63e4 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:46.876455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e4428-aa18-4c10-aa57-75c0dc6c63e4 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:46.876966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e4428-aa18-4c10-aa57-75c0dc6c63e4 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:46.879756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 52/102] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:46.884952 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e4428-aa18-4c10-aa57-75c0dc6c63e4 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:46.911958 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 51/103] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:34:46.913750 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36036a35-7c4c-4944-b057-6a3ee2cc7ea9 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:46.914243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36036a35-7c4c-4944-b057-6a3ee2cc7ea9 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:46.914732 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36036a35-7c4c-4944-b057-6a3ee2cc7ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:46.937495 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-36036a35-7c4c-4944-b057-6a3ee2cc7ea9 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:46.939050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-36036a35-7c4c-4944-b057-6a3ee2cc7ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:47.026819 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e4428-aa18-4c10-aa57-75c0dc6c63e4 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:47.029216 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 52/104] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:47.030896 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2efe44-9535-4a79-a31c-f645ca1b5348 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:47.031399 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2efe44-9535-4a79-a31c-f645ca1b5348 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:47.031891 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2efe44-9535-4a79-a31c-f645ca1b5348 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:47.033656 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 53/105] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:47.034649 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2efe44-9535-4a79-a31c-f645ca1b5348 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:47.079408 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596c36a-fd3c-4a44-862c-c2f2193feb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:47.080094 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596c36a-fd3c-4a44-862c-c2f2193feb7e None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:47.080408 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596c36a-fd3c-4a44-862c-c2f2193feb7e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:47.080726 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596c36a-fd3c-4a44-862c-c2f2193feb7e None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:47.081989 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596c36a-fd3c-4a44-862c-c2f2193feb7e None admin] RBAC: Adding query filter params (name=member) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:47.082367 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596c36a-fd3c-4a44-862c-c2f2193feb7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:47.083753 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596c36a-fd3c-4a44-862c-c2f2193feb7e None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:47.092902 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 53/106] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:34:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:47.093956 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fe83b-1b48-4a59-8e5d-b3cb677564f0 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:47.094497 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fe83b-1b48-4a59-8e5d-b3cb677564f0 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:47.094849 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fe83b-1b48-4a59-8e5d-b3cb677564f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:47.111194 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d15fe83b-1b48-4a59-8e5d-b3cb677564f0 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:47.112410 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d15fe83b-1b48-4a59-8e5d-b3cb677564f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:47.143667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2efe44-9535-4a79-a31c-f645ca1b5348 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:47.176892 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 54/107] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:47.178716 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78156be9-db41-43c7-aebc-521edc570ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:47.179516 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78156be9-db41-43c7-aebc-521edc570ac7 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:47.179801 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78156be9-db41-43c7-aebc-521edc570ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:47.180075 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78156be9-db41-43c7-aebc-521edc570ac7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:47.181281 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78156be9-db41-43c7-aebc-521edc570ac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:47.182746 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78156be9-db41-43c7-aebc-521edc570ac7 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:47.184459 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 54/108] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:34:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:47.185928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223c511-42af-4bb5-923e-1e306bec8f7a None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:47.186223 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223c511-42af-4bb5-923e-1e306bec8f7a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:47.186501 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223c511-42af-4bb5-923e-1e306bec8f7a None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:47.187812 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 55/109] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:47 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:47.189588 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78156be9-db41-43c7-aebc-521edc570ac7 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:47.189756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223c511-42af-4bb5-923e-1e306bec8f7a None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:47.297147 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78156be9-db41-43c7-aebc-521edc570ac7 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:47.306892 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223c511-42af-4bb5-923e-1e306bec8f7a None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:47.330686 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae5e76-4cab-4d65-967e-3aaabfc70c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:47.331496 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae5e76-4cab-4d65-967e-3aaabfc70c47 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:47.331963 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae5e76-4cab-4d65-967e-3aaabfc70c47 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:47.332462 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae5e76-4cab-4d65-967e-3aaabfc70c47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:47.340020 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd80c7-d03f-4f5e-b678-a97650ecd3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:47.340932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd80c7-d03f-4f5e-b678-a97650ecd3fc None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:47.341213 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd80c7-d03f-4f5e-b678-a97650ecd3fc None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:47.341486 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd80c7-d03f-4f5e-b678-a97650ecd3fc None admin] PATH_INFO: `/v3/users/70c226c0c5ea45f29547a5be6433762e` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:47.342683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd80c7-d03f-4f5e-b678-a97650ecd3fc None admin] RBAC: Authorizing `identity:get_user(user_id=70c226c0c5ea45f29547a5be6433762e)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:47.343394 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae5e76-4cab-4d65-967e-3aaabfc70c47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:47.344139 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd80c7-d03f-4f5e-b678-a97650ecd3fc None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:47.345975 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 56/110] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:47 2022] GET /identity/v3/users/70c226c0c5ea45f29547a5be6433762e => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:47.346627 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd80c7-d03f-4f5e-b678-a97650ecd3fc None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:47.351957 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-94ae5e76-4cab-4d65-967e-3aaabfc70c47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:34:47.353347 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 55/111] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:34:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:47.354647 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a52d78-0dfe-4880-ad6f-105436c45749 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:47.354935 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a52d78-0dfe-4880-ad6f-105436c45749 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:47.355208 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a52d78-0dfe-4880-ad6f-105436c45749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:47.373898 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-21a52d78-0dfe-4880-ad6f-105436c45749 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:47.375089 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-21a52d78-0dfe-4880-ad6f-105436c45749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:47.441183 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 56/112] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:47.444807 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a52d78-0dfe-4880-ad6f-105436c45749 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:47.468110 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd80c7-d03f-4f5e-b678-a97650ecd3fc None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:47.502038 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4362f-fdce-4490-b324-0be6f14950f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:47.502687 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4362f-fdce-4490-b324-0be6f14950f6 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:47.502968 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4362f-fdce-4490-b324-0be6f14950f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:47.503241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4362f-fdce-4490-b324-0be6f14950f6 None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:47.504300 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4362f-fdce-4490-b324-0be6f14950f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:47.505849 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4362f-fdce-4490-b324-0be6f14950f6 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:47.539744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a52d78-0dfe-4880-ad6f-105436c45749 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:47.573718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38907ed6-5c1c-490d-b1b4-a00eebde05af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:47.574442 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38907ed6-5c1c-490d-b1b4-a00eebde05af None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:47.574726 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38907ed6-5c1c-490d-b1b4-a00eebde05af None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:47.575002 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38907ed6-5c1c-490d-b1b4-a00eebde05af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:47.586068 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38907ed6-5c1c-490d-b1b4-a00eebde05af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:47.593369 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-38907ed6-5c1c-490d-b1b4-a00eebde05af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 14 21:34:47.594587 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 57/113] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:34:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:47.596331 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38907ed6-5c1c-490d-b1b4-a00eebde05af None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:47.607859 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 57/114] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Apr 14 21:34:47 2022] POST /identity/v3/projects => generated 302 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:34:47.608744 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4362f-fdce-4490-b324-0be6f14950f6 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:47.719069 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4362f-fdce-4490-b324-0be6f14950f6 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:47.719290 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38907ed6-5c1c-490d-b1b4-a00eebde05af None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:47.757589 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889d021-4696-4f59-b578-a744f3d1bc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:47.758264 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889d021-4696-4f59-b578-a744f3d1bc32 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:47.758555 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889d021-4696-4f59-b578-a744f3d1bc32 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:47.758831 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889d021-4696-4f59-b578-a744f3d1bc32 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:47.759375 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c085b3-4c43-4342-befd-6bd0690630f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:47.759603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889d021-4696-4f59-b578-a744f3d1bc32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:47.759913 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889d021-4696-4f59-b578-a744f3d1bc32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:47.760862 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c085b3-4c43-4342-befd-6bd0690630f9 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:47.761335 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c085b3-4c43-4342-befd-6bd0690630f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:47.761440 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889d021-4696-4f59-b578-a744f3d1bc32 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:47.761909 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c085b3-4c43-4342-befd-6bd0690630f9 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:47.763429 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c085b3-4c43-4342-befd-6bd0690630f9 None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:47.765257 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c085b3-4c43-4342-befd-6bd0690630f9 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:47.767391 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 58/115] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:34:47 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:47.768394 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c085b3-4c43-4342-befd-6bd0690630f9 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:47.771919 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 58/116] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:34:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:47.772711 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889d021-4696-4f59-b578-a744f3d1bc32 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:47.882817 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c085b3-4c43-4342-befd-6bd0690630f9 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:47.884336 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889d021-4696-4f59-b578-a744f3d1bc32 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:47.926923 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80549153-dd70-4978-a616-783d1d6f8bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:47.927315 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4879844-0270-4479-82f6-4a7b0842536b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:47.927749 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549153-dd70-4978-a616-783d1d6f8bc1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:47.927980 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4879844-0270-4479-82f6-4a7b0842536b None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:47.928078 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549153-dd70-4978-a616-783d1d6f8bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:47.928266 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4879844-0270-4479-82f6-4a7b0842536b None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:47.928356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549153-dd70-4978-a616-783d1d6f8bc1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:47.928539 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4879844-0270-4479-82f6-4a7b0842536b None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:47.929506 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4879844-0270-4479-82f6-4a7b0842536b None admin] RBAC: Adding query filter params (name=reader) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:47.929810 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4879844-0270-4479-82f6-4a7b0842536b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:47.931190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4879844-0270-4479-82f6-4a7b0842536b None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:47.940645 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 59/117] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:34:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:47.940645 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4879844-0270-4479-82f6-4a7b0842536b None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:47.949571 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80549153-dd70-4978-a616-783d1d6f8bc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:47.957495 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-80549153-dd70-4978-a616-783d1d6f8bc1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 14 21:34:47.958834 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 59/118] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:34:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:47.959640 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80549153-dd70-4978-a616-783d1d6f8bc1 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:48.061327 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4879844-0270-4479-82f6-4a7b0842536b None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:48.072352 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80549153-dd70-4978-a616-783d1d6f8bc1 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:48.093596 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a797d3-fc6a-4666-8108-e8afab0ea94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:48.094480 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a797d3-fc6a-4666-8108-e8afab0ea94f None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:48.094758 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a797d3-fc6a-4666-8108-e8afab0ea94f None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:48.095033 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a797d3-fc6a-4666-8108-e8afab0ea94f None admin] PATH_INFO: `/v3/users/251b9783da7b448e9c5a7980e4095700` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:48.096227 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a797d3-fc6a-4666-8108-e8afab0ea94f None admin] RBAC: Authorizing `identity:get_user(user_id=251b9783da7b448e9c5a7980e4095700)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:48.098308 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a797d3-fc6a-4666-8108-e8afab0ea94f None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:48.099910 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 60/119] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:47 2022] GET /identity/v3/users/251b9783da7b448e9c5a7980e4095700 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:48.100682 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a797d3-fc6a-4666-8108-e8afab0ea94f None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:48.112407 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b926e0-f536-4757-bc33-75843f2d61f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:48.114138 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b926e0-f536-4757-bc33-75843f2d61f0 None admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:48.114421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b926e0-f536-4757-bc33-75843f2d61f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:48.114705 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b926e0-f536-4757-bc33-75843f2d61f0 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0/users/70c226c0c5ea45f29547a5be6433762e/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:48.116775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b926e0-f536-4757-bc33-75843f2d61f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=830f37ab382049b4b39840d0c29b05c0, user_id=70c226c0c5ea45f29547a5be6433762e, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:48.118239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b926e0-f536-4757-bc33-75843f2d61f0 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:48.197046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a797d3-fc6a-4666-8108-e8afab0ea94f None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:48.210526 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 60/120] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:34:47 2022] PUT /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0/users/70c226c0c5ea45f29547a5be6433762e/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:34:48.221669 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b926e0-f536-4757-bc33-75843f2d61f0 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:48.230989 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc8514-2a53-4384-a4f7-a144e71631bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:48.231886 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc8514-2a53-4384-a4f7-a144e71631bf None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:48.232192 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc8514-2a53-4384-a4f7-a144e71631bf None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:48.232474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc8514-2a53-4384-a4f7-a144e71631bf None admin] PATH_INFO: `/v3/users/6b55c5bbe8fb4f7489165b3d0659f253` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:48.251524 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc8514-2a53-4384-a4f7-a144e71631bf None admin] RBAC: Authorizing `identity:get_user(user_id=6b55c5bbe8fb4f7489165b3d0659f253)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:48.253051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc8514-2a53-4384-a4f7-a144e71631bf None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:48.260337 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 61/121] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:48 2022] GET /identity/v3/users/6b55c5bbe8fb4f7489165b3d0659f253 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:48.261925 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116fd2f-a8db-4d0e-8b8f-83248394f919 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:48.262217 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116fd2f-a8db-4d0e-8b8f-83248394f919 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:48.262496 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116fd2f-a8db-4d0e-8b8f-83248394f919 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:48.263884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 62/122] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:48.264958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116fd2f-a8db-4d0e-8b8f-83248394f919 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:48.361073 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b926e0-f536-4757-bc33-75843f2d61f0 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:48.375249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116fd2f-a8db-4d0e-8b8f-83248394f919 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:48.400424 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb3403-5fd3-4839-bac0-e82cca636d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:48.401841 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb3403-5fd3-4839-bac0-e82cca636d26 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:48.402135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb3403-5fd3-4839-bac0-e82cca636d26 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:48.402421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb3403-5fd3-4839-bac0-e82cca636d26 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:48.403439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb3403-5fd3-4839-bac0-e82cca636d26 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:48.404119 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb3403-5fd3-4839-bac0-e82cca636d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:48.406034 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb3403-5fd3-4839-bac0-e82cca636d26 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:48.412781 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397778db-99f0-45ce-8388-bfc01bf12d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:48.413659 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397778db-99f0-45ce-8388-bfc01bf12d1a None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:48.413943 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397778db-99f0-45ce-8388-bfc01bf12d1a None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:48.414222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397778db-99f0-45ce-8388-bfc01bf12d1a None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:48.415491 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397778db-99f0-45ce-8388-bfc01bf12d1a None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:48.417012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397778db-99f0-45ce-8388-bfc01bf12d1a None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:48.418748 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 63/123] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:34:48 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:48.419241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 61/124] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:34:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:48.420682 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8b209-b604-4a44-a21b-90a5b4ab6716 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:48.420982 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8b209-b604-4a44-a21b-90a5b4ab6716 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:48.421317 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8b209-b604-4a44-a21b-90a5b4ab6716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:48.421426 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397778db-99f0-45ce-8388-bfc01bf12d1a None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:48.438925 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-edf8b209-b604-4a44-a21b-90a5b4ab6716 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:48.440115 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-edf8b209-b604-4a44-a21b-90a5b4ab6716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:48.520471 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 62/125] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:48.521758 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8b209-b604-4a44-a21b-90a5b4ab6716 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:48.532330 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397778db-99f0-45ce-8388-bfc01bf12d1a None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:48.568319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f278bbb-ed3b-471f-82f6-e3aef9498db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:48.569019 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278bbb-ed3b-471f-82f6-e3aef9498db7 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:48.569311 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278bbb-ed3b-471f-82f6-e3aef9498db7 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:48.569605 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278bbb-ed3b-471f-82f6-e3aef9498db7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:48.629412 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8b209-b604-4a44-a21b-90a5b4ab6716 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:48.639934 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f278bbb-ed3b-471f-82f6-e3aef9498db7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:48.641459 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f278bbb-ed3b-471f-82f6-e3aef9498db7 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:48.669416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cb858-a8aa-4647-85b1-18c2f254a8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:48.670348 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cb858-a8aa-4647-85b1-18c2f254a8ca None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:48.670634 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cb858-a8aa-4647-85b1-18c2f254a8ca None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:48.670910 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cb858-a8aa-4647-85b1-18c2f254a8ca None admin] PATH_INFO: `/v3/users/70c226c0c5ea45f29547a5be6433762e` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:48.672114 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cb858-a8aa-4647-85b1-18c2f254a8ca None admin] RBAC: Authorizing `identity:get_user(user_id=70c226c0c5ea45f29547a5be6433762e)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:48.673699 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cb858-a8aa-4647-85b1-18c2f254a8ca None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:48.675698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 63/126] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:48 2022] GET /identity/v3/users/70c226c0c5ea45f29547a5be6433762e => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:48.676568 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cb858-a8aa-4647-85b1-18c2f254a8ca None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:48.745789 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 64/127] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:34:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:34:48.746480 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f278bbb-ed3b-471f-82f6-e3aef9498db7 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:48.777411 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cb858-a8aa-4647-85b1-18c2f254a8ca None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:48.811513 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de8b94-2461-48df-8773-f62f5cf006e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:48.812472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de8b94-2461-48df-8773-f62f5cf006e3 None admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:48.812785 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de8b94-2461-48df-8773-f62f5cf006e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:48.813260 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de8b94-2461-48df-8773-f62f5cf006e3 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0/users/251b9783da7b448e9c5a7980e4095700/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:48.816602 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de8b94-2461-48df-8773-f62f5cf006e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=830f37ab382049b4b39840d0c29b05c0, user_id=251b9783da7b448e9c5a7980e4095700, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:48.819058 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de8b94-2461-48df-8773-f62f5cf006e3 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:48.855201 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f278bbb-ed3b-471f-82f6-e3aef9498db7 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:48.889261 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1703501-1036-47f4-9311-c87b09b5e89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:48.890123 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1703501-1036-47f4-9311-c87b09b5e89c None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:48.890412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1703501-1036-47f4-9311-c87b09b5e89c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:48.890696 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1703501-1036-47f4-9311-c87b09b5e89c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:48.901849 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1703501-1036-47f4-9311-c87b09b5e89c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:48.924078 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-c1703501-1036-47f4-9311-c87b09b5e89c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:34:48.924078 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 65/128] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:34:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:48.924078 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1703501-1036-47f4-9311-c87b09b5e89c None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:48.951658 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 64/129] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:34:48 2022] PUT /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0/users/251b9783da7b448e9c5a7980e4095700/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:34:48.951658 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de8b94-2461-48df-8773-f62f5cf006e3 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:49.026850 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1703501-1036-47f4-9311-c87b09b5e89c None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:49.063036 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4db5a-b285-4ddc-8102-6d4f899961a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:49.063348 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de8b94-2461-48df-8773-f62f5cf006e3 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:49.063827 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4db5a-b285-4ddc-8102-6d4f899961a4 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:49.064109 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4db5a-b285-4ddc-8102-6d4f899961a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:49.064385 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4db5a-b285-4ddc-8102-6d4f899961a4 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:49.065640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4db5a-b285-4ddc-8102-6d4f899961a4 None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:49.067773 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4db5a-b285-4ddc-8102-6d4f899961a4 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:49.069695 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 66/130] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:34:48 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:49.070312 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4db5a-b285-4ddc-8102-6d4f899961a4 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:49.101960 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526d6d7-78cc-4b67-b677-d482fd46f634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:49.103469 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526d6d7-78cc-4b67-b677-d482fd46f634 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:49.103768 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526d6d7-78cc-4b67-b677-d482fd46f634 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:49.104378 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526d6d7-78cc-4b67-b677-d482fd46f634 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:49.105787 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526d6d7-78cc-4b67-b677-d482fd46f634 None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:49.108434 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526d6d7-78cc-4b67-b677-d482fd46f634 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:49.110582 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 65/131] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:34:48 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:49.111443 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526d6d7-78cc-4b67-b677-d482fd46f634 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:49.178015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4db5a-b285-4ddc-8102-6d4f899961a4 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:49.215636 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08877441-3de2-422e-8c04-7aa6bac97cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:49.216387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08877441-3de2-422e-8c04-7aa6bac97cc0 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:49.216713 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08877441-3de2-422e-8c04-7aa6bac97cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:49.217043 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08877441-3de2-422e-8c04-7aa6bac97cc0 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:49.217814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08877441-3de2-422e-8c04-7aa6bac97cc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:49.218125 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08877441-3de2-422e-8c04-7aa6bac97cc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:49.219632 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08877441-3de2-422e-8c04-7aa6bac97cc0 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:49.228563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 67/132] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:34:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:49.229451 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08877441-3de2-422e-8c04-7aa6bac97cc0 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:49.243282 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526d6d7-78cc-4b67-b677-d482fd46f634 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:49.304274 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa76c5-64c4-4c04-972b-bf4ce2006467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:49.305211 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa76c5-64c4-4c04-972b-bf4ce2006467 None admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:49.305493 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa76c5-64c4-4c04-972b-bf4ce2006467 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:49.305771 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa76c5-64c4-4c04-972b-bf4ce2006467 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0/users/70c226c0c5ea45f29547a5be6433762e/roles/c25cb9d119a74c7281a986fa76a92af6` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:49.308050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa76c5-64c4-4c04-972b-bf4ce2006467 None admin] RBAC: Authorizing `identity:create_grant(project_id=830f37ab382049b4b39840d0c29b05c0, user_id=70c226c0c5ea45f29547a5be6433762e, role_id=c25cb9d119a74c7281a986fa76a92af6)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:49.310304 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa76c5-64c4-4c04-972b-bf4ce2006467 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:49.348428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08877441-3de2-422e-8c04-7aa6bac97cc0 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:49.384340 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fe2ab-ead4-4258-a371-93a2a42bfcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:49.385057 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fe2ab-ead4-4258-a371-93a2a42bfcd9 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:49.385345 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fe2ab-ead4-4258-a371-93a2a42bfcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:49.385627 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fe2ab-ead4-4258-a371-93a2a42bfcd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:49.386574 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fe2ab-ead4-4258-a371-93a2a42bfcd9 None admin] RBAC: Adding query filter params (role.id=8301a1978ca14ba59f726e7b703fa445, scope.project.id=830f37ab382049b4b39840d0c29b05c0, user.id=6b55c5bbe8fb4f7489165b3d0659f253) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:49.386894 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fe2ab-ead4-4258-a371-93a2a42bfcd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:49.388466 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fe2ab-ead4-4258-a371-93a2a42bfcd9 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:49.394833 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 68/133] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:34:49 2022] GET /identity/v3/role_assignments?user.id=6b55c5bbe8fb4f7489165b3d0659f253&scope.project.id=830f37ab382049b4b39840d0c29b05c0&role.id=8301a1978ca14ba59f726e7b703fa445 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:49.395678 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fe2ab-ead4-4258-a371-93a2a42bfcd9 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:49.407885 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 66/134] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:34:49 2022] PUT /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0/users/70c226c0c5ea45f29547a5be6433762e/roles/c25cb9d119a74c7281a986fa76a92af6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:34:49.530829 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fe2ab-ead4-4258-a371-93a2a42bfcd9 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:49.571841 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94f532-bbf6-4315-9868-dd5bb9dffb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:49.572783 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94f532-bbf6-4315-9868-dd5bb9dffb5e None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:49.573069 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94f532-bbf6-4315-9868-dd5bb9dffb5e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:49.573347 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94f532-bbf6-4315-9868-dd5bb9dffb5e None admin] PATH_INFO: `/v3/users/70c226c0c5ea45f29547a5be6433762e` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:49.574705 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94f532-bbf6-4315-9868-dd5bb9dffb5e None admin] RBAC: Authorizing `identity:get_user(user_id=70c226c0c5ea45f29547a5be6433762e)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:49.576326 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94f532-bbf6-4315-9868-dd5bb9dffb5e None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:49.578123 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 69/135] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:49 2022] GET /identity/v3/users/70c226c0c5ea45f29547a5be6433762e => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:49.584081 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa76c5-64c4-4c04-972b-bf4ce2006467 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:49.699663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa76c5-64c4-4c04-972b-bf4ce2006467 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:49.736658 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc840a-89bc-4f13-8cfb-390e03017005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:49.737627 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc840a-89bc-4f13-8cfb-390e03017005 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:49.738713 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc840a-89bc-4f13-8cfb-390e03017005 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:49.739165 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc840a-89bc-4f13-8cfb-390e03017005 None admin] PATH_INFO: `/v3/projects/0af3727abdcc46e899512dd46876421c` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:49.740496 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc840a-89bc-4f13-8cfb-390e03017005 None admin] RBAC: Authorizing `identity:get_project(project_id=0af3727abdcc46e899512dd46876421c)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:49.742047 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc840a-89bc-4f13-8cfb-390e03017005 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:49.743838 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 67/136] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:34:49 2022] GET /identity/v3/projects/0af3727abdcc46e899512dd46876421c => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:49.749794 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94f532-bbf6-4315-9868-dd5bb9dffb5e None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:49.856275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94f532-bbf6-4315-9868-dd5bb9dffb5e None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:49.890809 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a2973-57de-40a7-9ec9-13a9e820ed18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:49.891773 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a2973-57de-40a7-9ec9-13a9e820ed18 None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:49.899983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a2973-57de-40a7-9ec9-13a9e820ed18 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:49.899983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a2973-57de-40a7-9ec9-13a9e820ed18 None admin] PATH_INFO: `/v3/projects/0af3727abdcc46e899512dd46876421c/users/70c226c0c5ea45f29547a5be6433762e/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:49.899983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a2973-57de-40a7-9ec9-13a9e820ed18 None admin] RBAC: Authorizing `identity:create_grant(project_id=0af3727abdcc46e899512dd46876421c, user_id=70c226c0c5ea45f29547a5be6433762e, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:49.899983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a2973-57de-40a7-9ec9-13a9e820ed18 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:50.004712 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 70/137] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:34:49 2022] PUT /identity/v3/projects/0af3727abdcc46e899512dd46876421c/users/70c226c0c5ea45f29547a5be6433762e/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:34:50.480996 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0dc5c-d0b9-43af-86f7-b64f60f30a43 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:50.481369 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0dc5c-d0b9-43af-86f7-b64f60f30a43 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:50.481572 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0dc5c-d0b9-43af-86f7-b64f60f30a43 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:50.483105 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 68/138] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:50.489028 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c0fe4-b833-405c-81a0-2d3b7e5cf91b None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:50.489324 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c0fe4-b833-405c-81a0-2d3b7e5cf91b None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:50.489614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c0fe4-b833-405c-81a0-2d3b7e5cf91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:50.511465 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-685c0fe4-b833-405c-81a0-2d3b7e5cf91b None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:50.512704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-685c0fe4-b833-405c-81a0-2d3b7e5cf91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:50.606058 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 71/139] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:50.647995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0dc5c-d0b9-43af-86f7-b64f60f30a43 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:50.770317 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0dc5c-d0b9-43af-86f7-b64f60f30a43 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:50.811165 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee83f6-96dc-457e-8e4f-86d376a17140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:50.812377 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee83f6-96dc-457e-8e4f-86d376a17140 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:50.812907 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee83f6-96dc-457e-8e4f-86d376a17140 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:50.813427 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee83f6-96dc-457e-8e4f-86d376a17140 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:50.814834 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee83f6-96dc-457e-8e4f-86d376a17140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:50.817260 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee83f6-96dc-457e-8e4f-86d376a17140 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:50.819556 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 69/140] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:34:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:50.824789 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c0fe4-b833-405c-81a0-2d3b7e5cf91b None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:50.967096 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c0fe4-b833-405c-81a0-2d3b7e5cf91b None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:51.008318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91d4bb-efab-4495-9cdb-e1eed3cc5405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:51.009109 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91d4bb-efab-4495-9cdb-e1eed3cc5405 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:51.009394 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91d4bb-efab-4495-9cdb-e1eed3cc5405 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:51.009675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91d4bb-efab-4495-9cdb-e1eed3cc5405 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:51.010406 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91d4bb-efab-4495-9cdb-e1eed3cc5405 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:51.011865 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91d4bb-efab-4495-9cdb-e1eed3cc5405 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:51.163409 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 72/141] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:34:50 2022] POST /identity/v3/users => generated 283 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:34:51.305575 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46298aa7-2a0d-4165-bd46-91e3c7de212d None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:51.306006 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46298aa7-2a0d-4165-bd46-91e3c7de212d None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:51.306136 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46298aa7-2a0d-4165-bd46-91e3c7de212d None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:51.307830 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 70/142] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:51.330696 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624845b-b167-4a3b-b45e-082b687165e1 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:51.330996 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624845b-b167-4a3b-b45e-082b687165e1 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:51.331879 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624845b-b167-4a3b-b45e-082b687165e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:51.356429 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-e624845b-b167-4a3b-b45e-082b687165e1 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:51.357695 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e624845b-b167-4a3b-b45e-082b687165e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:51.448105 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 73/143] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:51.490613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46298aa7-2a0d-4165-bd46-91e3c7de212d None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:51.618732 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46298aa7-2a0d-4165-bd46-91e3c7de212d None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:51.653819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8917546-5374-4ab1-9c99-a2cdbe54ac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:51.654630 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8917546-5374-4ab1-9c99-a2cdbe54ac14 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:51.654970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8917546-5374-4ab1-9c99-a2cdbe54ac14 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:51.655248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8917546-5374-4ab1-9c99-a2cdbe54ac14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:51.666703 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8917546-5374-4ab1-9c99-a2cdbe54ac14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:51.673820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-c8917546-5374-4ab1-9c99-a2cdbe54ac14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:34:51.676000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 71/144] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:34:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:51.681952 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624845b-b167-4a3b-b45e-082b687165e1 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:51.811190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624845b-b167-4a3b-b45e-082b687165e1 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:51.852098 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa88864-c6af-4a53-9b65-8c3578ce22d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:51.852802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa88864-c6af-4a53-9b65-8c3578ce22d1 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:51.853088 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa88864-c6af-4a53-9b65-8c3578ce22d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:51.853367 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa88864-c6af-4a53-9b65-8c3578ce22d1 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:51.854131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa88864-c6af-4a53-9b65-8c3578ce22d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:51.854442 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa88864-c6af-4a53-9b65-8c3578ce22d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:51.855841 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa88864-c6af-4a53-9b65-8c3578ce22d1 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:51.864824 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 74/145] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:34:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:51.870563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8917546-5374-4ab1-9c99-a2cdbe54ac14 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:52.008984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8917546-5374-4ab1-9c99-a2cdbe54ac14 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:52.052901 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57fc25-d3fa-4423-b61c-f548a6054aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:52.053813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57fc25-d3fa-4423-b61c-f548a6054aa9 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:52.054101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57fc25-d3fa-4423-b61c-f548a6054aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:52.054383 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57fc25-d3fa-4423-b61c-f548a6054aa9 None admin] PATH_INFO: `/v3/users/70c226c0c5ea45f29547a5be6433762e` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:52.061767 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57fc25-d3fa-4423-b61c-f548a6054aa9 None admin] RBAC: Authorizing `identity:get_user(user_id=70c226c0c5ea45f29547a5be6433762e)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:52.063193 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57fc25-d3fa-4423-b61c-f548a6054aa9 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:52.064991 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 72/146] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:51 2022] GET /identity/v3/users/70c226c0c5ea45f29547a5be6433762e => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:52.071757 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa88864-c6af-4a53-9b65-8c3578ce22d1 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:52.195329 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa88864-c6af-4a53-9b65-8c3578ce22d1 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:52.235850 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e2eca-2a1a-4f82-9376-a8dd072e9d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:52.236516 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e2eca-2a1a-4f82-9376-a8dd072e9d00 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:52.236824 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e2eca-2a1a-4f82-9376-a8dd072e9d00 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:52.237104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e2eca-2a1a-4f82-9376-a8dd072e9d00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:52.309267 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e2eca-2a1a-4f82-9376-a8dd072e9d00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:52.310760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e2eca-2a1a-4f82-9376-a8dd072e9d00 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:52.413314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 75/147] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:34:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:34:52.418711 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57fc25-d3fa-4423-b61c-f548a6054aa9 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:52.531087 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57fc25-d3fa-4423-b61c-f548a6054aa9 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:52.568532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23949ab-0a9b-472a-9047-5e765ed8dfe9 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:52.568873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23949ab-0a9b-472a-9047-5e765ed8dfe9 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:52.569131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23949ab-0a9b-472a-9047-5e765ed8dfe9 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:52.570722 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 76/148] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:34:52.576457 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b536e6-62a6-4961-8e1a-a4a9e4572ca3 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:52.577009 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b536e6-62a6-4961-8e1a-a4a9e4572ca3 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:52.577495 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b536e6-62a6-4961-8e1a-a4a9e4572ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:52.582323 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d2f7c-3b13-4e8f-bae8-73b9edaf435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:52.583335 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d2f7c-3b13-4e8f-bae8-73b9edaf435a None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:52.583624 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d2f7c-3b13-4e8f-bae8-73b9edaf435a None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:52.583908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d2f7c-3b13-4e8f-bae8-73b9edaf435a None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:52.587242 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d2f7c-3b13-4e8f-bae8-73b9edaf435a None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:52.588743 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d2f7c-3b13-4e8f-bae8-73b9edaf435a None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:52.590800 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 73/149] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:34:52 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:52.596379 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d2f7c-3b13-4e8f-bae8-73b9edaf435a None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:52.599331 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d2b536e6-62a6-4961-8e1a-a4a9e4572ca3 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:52.600802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d2b536e6-62a6-4961-8e1a-a4a9e4572ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:52.720955 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 77/150] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:34:52.762211 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d2f7c-3b13-4e8f-bae8-73b9edaf435a None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:52.800508 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea9f1b-2e6d-496a-a813-e2e7db3bf2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:52.801549 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea9f1b-2e6d-496a-a813-e2e7db3bf2f7 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:52.802046 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea9f1b-2e6d-496a-a813-e2e7db3bf2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:52.802511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea9f1b-2e6d-496a-a813-e2e7db3bf2f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:52.803554 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea9f1b-2e6d-496a-a813-e2e7db3bf2f7 None admin] RBAC: Adding query filter params (role.id=4a3588df731c452fba80b071fc342f78, scope.project.id=830f37ab382049b4b39840d0c29b05c0, user.id=70c226c0c5ea45f29547a5be6433762e) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:52.804057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea9f1b-2e6d-496a-a813-e2e7db3bf2f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:52.805780 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea9f1b-2e6d-496a-a813-e2e7db3bf2f7 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:52.813046 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 74/151] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:34:52 2022] GET /identity/v3/role_assignments?user.id=70c226c0c5ea45f29547a5be6433762e&scope.project.id=830f37ab382049b4b39840d0c29b05c0&role.id=4a3588df731c452fba80b071fc342f78 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:34:52.814834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b536e6-62a6-4961-8e1a-a4a9e4572ca3 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:52.933150 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b536e6-62a6-4961-8e1a-a4a9e4572ca3 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:52.978226 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fa789-8032-498d-bc18-ace0467cc912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:52.979493 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fa789-8032-498d-bc18-ace0467cc912 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:52.979972 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fa789-8032-498d-bc18-ace0467cc912 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:52.980484 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fa789-8032-498d-bc18-ace0467cc912 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:53.001672 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90fa789-8032-498d-bc18-ace0467cc912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:53.009381 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-a90fa789-8032-498d-bc18-ace0467cc912 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 14 21:34:53.011332 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 78/152] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:34:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:53.017212 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea9f1b-2e6d-496a-a813-e2e7db3bf2f7 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:53.109436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2913dd-650c-414d-a35e-76bab2c0bbf2 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:53.110042 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2913dd-650c-414d-a35e-76bab2c0bbf2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:53.110535 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2913dd-650c-414d-a35e-76bab2c0bbf2 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:53.112255 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 79/153] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:34:53.122509 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ad2a7-d1f3-464c-9fce-63f96cccea79 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:53.123421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ad2a7-d1f3-464c-9fce-63f96cccea79 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:53.124030 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ad2a7-d1f3-464c-9fce-63f96cccea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:53.135627 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea9f1b-2e6d-496a-a813-e2e7db3bf2f7 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:53.158965 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-458ad2a7-d1f3-464c-9fce-63f96cccea79 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:53.163177 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-458ad2a7-d1f3-464c-9fce-63f96cccea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:53.213716 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a650fc6-7a08-4007-90d7-22fef17fffed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:53.214809 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a650fc6-7a08-4007-90d7-22fef17fffed None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:53.215285 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a650fc6-7a08-4007-90d7-22fef17fffed None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:53.215798 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a650fc6-7a08-4007-90d7-22fef17fffed None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:53.216830 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a650fc6-7a08-4007-90d7-22fef17fffed None admin] RBAC: Adding query filter params (name=reader) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:53.217355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a650fc6-7a08-4007-90d7-22fef17fffed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:53.218948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a650fc6-7a08-4007-90d7-22fef17fffed None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:53.233614 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 75/154] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:34:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:53.272830 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a650fc6-7a08-4007-90d7-22fef17fffed None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:53.290497 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 80/155] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:53.336073 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ad2a7-d1f3-464c-9fce-63f96cccea79 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:53.406676 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a650fc6-7a08-4007-90d7-22fef17fffed None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:53.445337 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c458f-0b36-4388-b37c-6182a40d9441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:53.446569 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c458f-0b36-4388-b37c-6182a40d9441 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:53.447043 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c458f-0b36-4388-b37c-6182a40d9441 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:53.447534 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c458f-0b36-4388-b37c-6182a40d9441 None admin] PATH_INFO: `/v3/users/6b55c5bbe8fb4f7489165b3d0659f253` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:53.449747 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c458f-0b36-4388-b37c-6182a40d9441 None admin] RBAC: Authorizing `identity:get_user(user_id=6b55c5bbe8fb4f7489165b3d0659f253)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:53.451403 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c458f-0b36-4388-b37c-6182a40d9441 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:53.453432 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 76/156] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:53 2022] GET /identity/v3/users/6b55c5bbe8fb4f7489165b3d0659f253 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:34:53.456840 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849959a-2d00-442b-8d07-67d1d933ed59 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:53.458232 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849959a-2d00-442b-8d07-67d1d933ed59 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:53.459372 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849959a-2d00-442b-8d07-67d1d933ed59 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:53.466415 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 77/157] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:53 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:53.472258 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849959a-2d00-442b-8d07-67d1d933ed59 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:53.521058 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ad2a7-d1f3-464c-9fce-63f96cccea79 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:53.565608 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41353c2-368f-4891-87d6-d9e0c892cb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:53.566958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41353c2-368f-4891-87d6-d9e0c892cb72 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:53.567483 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41353c2-368f-4891-87d6-d9e0c892cb72 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:53.568020 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41353c2-368f-4891-87d6-d9e0c892cb72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:53.591659 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41353c2-368f-4891-87d6-d9e0c892cb72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:53.601976 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-a41353c2-368f-4891-87d6-d9e0c892cb72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 14 21:34:53.610340 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 81/158] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:34:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:53.614930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e0fb8-8c9f-4d03-ab07-19ccfba1bae9 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:53.616168 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e0fb8-8c9f-4d03-ab07-19ccfba1bae9 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:53.616671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e0fb8-8c9f-4d03-ab07-19ccfba1bae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:53.644833 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-9d7e0fb8-8c9f-4d03-ab07-19ccfba1bae9 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:53.646267 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9d7e0fb8-8c9f-4d03-ab07-19ccfba1bae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:53.668778 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849959a-2d00-442b-8d07-67d1d933ed59 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:53.713859 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af26373-4db3-44d9-8b99-881a6eee1a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:53.715064 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af26373-4db3-44d9-8b99-881a6eee1a72 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:53.715561 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af26373-4db3-44d9-8b99-881a6eee1a72 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:53.716024 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af26373-4db3-44d9-8b99-881a6eee1a72 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:53.718489 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af26373-4db3-44d9-8b99-881a6eee1a72 None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:53.720202 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af26373-4db3-44d9-8b99-881a6eee1a72 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:53.722563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 78/159] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:34:53 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:53.723608 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af26373-4db3-44d9-8b99-881a6eee1a72 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:53.779981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 82/160] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:53.781368 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e0fb8-8c9f-4d03-ab07-19ccfba1bae9 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:53.855251 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af26373-4db3-44d9-8b99-881a6eee1a72 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:53.886797 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e0fb8-8c9f-4d03-ab07-19ccfba1bae9 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:53.908402 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadbfc3-b473-4a49-bf5e-578df408295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:53.909104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadbfc3-b473-4a49-bf5e-578df408295e None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:53.910099 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadbfc3-b473-4a49-bf5e-578df408295e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:53.910371 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadbfc3-b473-4a49-bf5e-578df408295e None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:53.912671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadbfc3-b473-4a49-bf5e-578df408295e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:53.912981 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadbfc3-b473-4a49-bf5e-578df408295e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:53.914361 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadbfc3-b473-4a49-bf5e-578df408295e None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:53.933215 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 79/161] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:34:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:53.934392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadbfc3-b473-4a49-bf5e-578df408295e None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:53.951719 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c61147-0170-4408-833b-f6e183b918e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:53.952801 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c61147-0170-4408-833b-f6e183b918e8 None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:53.953081 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c61147-0170-4408-833b-f6e183b918e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:53.953354 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c61147-0170-4408-833b-f6e183b918e8 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0/users/6b55c5bbe8fb4f7489165b3d0659f253/roles/8301a1978ca14ba59f726e7b703fa445` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:53.959359 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c61147-0170-4408-833b-f6e183b918e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=830f37ab382049b4b39840d0c29b05c0, user_id=6b55c5bbe8fb4f7489165b3d0659f253, role_id=8301a1978ca14ba59f726e7b703fa445)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:53.960894 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c61147-0170-4408-833b-f6e183b918e8 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:54.046838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 83/162] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:34:53 2022] PUT /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0/users/6b55c5bbe8fb4f7489165b3d0659f253/roles/8301a1978ca14ba59f726e7b703fa445 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:34:54.048076 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c61147-0170-4408-833b-f6e183b918e8 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:54.126995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadbfc3-b473-4a49-bf5e-578df408295e None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:54.207484 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329fc3e-be76-4ec8-9d55-33135cb82599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:54.208656 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329fc3e-be76-4ec8-9d55-33135cb82599 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:54.209080 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329fc3e-be76-4ec8-9d55-33135cb82599 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:54.209495 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329fc3e-be76-4ec8-9d55-33135cb82599 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:54.228829 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329fc3e-be76-4ec8-9d55-33135cb82599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:54.236320 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-a329fc3e-be76-4ec8-9d55-33135cb82599 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:34:54.242060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 80/163] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:34:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:54.243702 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b05f-5796-42b0-bc38-6060a0ae30e3 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:54.244132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b05f-5796-42b0-bc38-6060a0ae30e3 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:54.244546 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b05f-5796-42b0-bc38-6060a0ae30e3 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:54.246062 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 81/164] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:54.254452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7b05f-5796-42b0-bc38-6060a0ae30e3 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:54.264752 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c61147-0170-4408-833b-f6e183b918e8 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:54.352743 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b4db1-3f43-433d-b4e8-c1a1db5f52df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:54.353637 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b4db1-3f43-433d-b4e8-c1a1db5f52df None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:54.353916 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b4db1-3f43-433d-b4e8-c1a1db5f52df None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:54.355448 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b4db1-3f43-433d-b4e8-c1a1db5f52df None admin] PATH_INFO: `/v3/users/70c226c0c5ea45f29547a5be6433762e` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:54.357875 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b4db1-3f43-433d-b4e8-c1a1db5f52df None admin] RBAC: Authorizing `identity:get_user(user_id=70c226c0c5ea45f29547a5be6433762e)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:54.360785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b4db1-3f43-433d-b4e8-c1a1db5f52df None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:54.363078 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 84/165] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:54 2022] GET /identity/v3/users/70c226c0c5ea45f29547a5be6433762e => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:54.364366 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85727022-52a7-4362-bf3b-b5cb516e41b7 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:54.364692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85727022-52a7-4362-bf3b-b5cb516e41b7 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:54.366985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85727022-52a7-4362-bf3b-b5cb516e41b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:54.403309 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-85727022-52a7-4362-bf3b-b5cb516e41b7 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:54.405758 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-85727022-52a7-4362-bf3b-b5cb516e41b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:54.450644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7b05f-5796-42b0-bc38-6060a0ae30e3 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:54.526941 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09340c-8320-4453-89ec-46d08d2662e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:54.527674 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09340c-8320-4453-89ec-46d08d2662e7 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:54.527953 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09340c-8320-4453-89ec-46d08d2662e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:54.528285 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09340c-8320-4453-89ec-46d08d2662e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:54.529074 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09340c-8320-4453-89ec-46d08d2662e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:54.529383 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09340c-8320-4453-89ec-46d08d2662e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:54.530792 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09340c-8320-4453-89ec-46d08d2662e7 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:54.546922 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 82/166] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:34:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:54.547777 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09340c-8320-4453-89ec-46d08d2662e7 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:54.551099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 85/167] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:54.563020 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85727022-52a7-4362-bf3b-b5cb516e41b7 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:54.728155 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09340c-8320-4453-89ec-46d08d2662e7 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:54.738541 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85727022-52a7-4362-bf3b-b5cb516e41b7 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:54.789006 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb3f7e-960d-4c5c-9a54-d3dd7abd4b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:54.789659 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb3f7e-960d-4c5c-9a54-d3dd7abd4b48 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:54.789935 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb3f7e-960d-4c5c-9a54-d3dd7abd4b48 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:54.790206 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb3f7e-960d-4c5c-9a54-d3dd7abd4b48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:54.803068 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3cb9d-e5a8-40fe-92a6-3e560ab28679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:54.803958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3cb9d-e5a8-40fe-92a6-3e560ab28679 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:54.804232 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3cb9d-e5a8-40fe-92a6-3e560ab28679 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:54.804500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3cb9d-e5a8-40fe-92a6-3e560ab28679 None admin] PATH_INFO: `/v3/users/251b9783da7b448e9c5a7980e4095700` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:54.805787 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3cb9d-e5a8-40fe-92a6-3e560ab28679 None admin] RBAC: Authorizing `identity:get_user(user_id=251b9783da7b448e9c5a7980e4095700)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:54.809204 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3cb9d-e5a8-40fe-92a6-3e560ab28679 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:54.811834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 86/168] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:54 2022] GET /identity/v3/users/251b9783da7b448e9c5a7980e4095700 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:34:54.812678 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3cb9d-e5a8-40fe-92a6-3e560ab28679 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:54.924294 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb3f7e-960d-4c5c-9a54-d3dd7abd4b48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:54.926302 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb3f7e-960d-4c5c-9a54-d3dd7abd4b48 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:55.099948 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3cb9d-e5a8-40fe-92a6-3e560ab28679 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:55.160178 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9b91d-66c3-48eb-9987-cac6d75cb7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:55.161016 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9b91d-66c3-48eb-9987-cac6d75cb7a8 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:55.161294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9b91d-66c3-48eb-9987-cac6d75cb7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:55.161564 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9b91d-66c3-48eb-9987-cac6d75cb7a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:55.181553 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9b91d-66c3-48eb-9987-cac6d75cb7a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:55.196823 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-edc9b91d-66c3-48eb-9987-cac6d75cb7a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:34:55.198303 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 87/169] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:34:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:55.198464 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 83/170] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:34:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:34:55.198877 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9b91d-66c3-48eb-9987-cac6d75cb7a8 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:55.203955 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb3f7e-960d-4c5c-9a54-d3dd7abd4b48 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:55.367299 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb3f7e-960d-4c5c-9a54-d3dd7abd4b48 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:55.392328 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9b91d-66c3-48eb-9987-cac6d75cb7a8 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:55.423618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a52c7-08a6-48ab-85fc-390e923ab103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:55.424537 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a52c7-08a6-48ab-85fc-390e923ab103 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:55.425007 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a52c7-08a6-48ab-85fc-390e923ab103 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:55.425677 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a52c7-08a6-48ab-85fc-390e923ab103 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:55.426694 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a52c7-08a6-48ab-85fc-390e923ab103 None admin] RBAC: Adding query filter params (name=member) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:55.427127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a52c7-08a6-48ab-85fc-390e923ab103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:55.428683 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a52c7-08a6-48ab-85fc-390e923ab103 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:55.445233 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 84/171] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:34:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:55.446292 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a52c7-08a6-48ab-85fc-390e923ab103 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:55.481313 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91c06a-166b-42ca-b8eb-9ea9762a5085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:55.482154 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91c06a-166b-42ca-b8eb-9ea9762a5085 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:55.482539 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91c06a-166b-42ca-b8eb-9ea9762a5085 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:55.482918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91c06a-166b-42ca-b8eb-9ea9762a5085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:55.552936 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a52c7-08a6-48ab-85fc-390e923ab103 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:55.590790 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f68a5-5060-48d0-934f-97b0b82776c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:55.591886 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f68a5-5060-48d0-934f-97b0b82776c7 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:55.593922 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f68a5-5060-48d0-934f-97b0b82776c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:55.594364 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f68a5-5060-48d0-934f-97b0b82776c7 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:55.598802 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f68a5-5060-48d0-934f-97b0b82776c7 None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:55.600431 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f68a5-5060-48d0-934f-97b0b82776c7 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:55.604814 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 85/172] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:34:55 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:55.607955 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f68a5-5060-48d0-934f-97b0b82776c7 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:55.613933 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91c06a-166b-42ca-b8eb-9ea9762a5085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:55.620068 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91c06a-166b-42ca-b8eb-9ea9762a5085 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:55.726698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f68a5-5060-48d0-934f-97b0b82776c7 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:55.765052 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd353f-8a00-4031-b38e-39e3b00c7cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:55.766176 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd353f-8a00-4031-b38e-39e3b00c7cf8 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:55.766634 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd353f-8a00-4031-b38e-39e3b00c7cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:55.767228 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd353f-8a00-4031-b38e-39e3b00c7cf8 None admin] PATH_INFO: `/v3/users/70c226c0c5ea45f29547a5be6433762e` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:55.769841 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd353f-8a00-4031-b38e-39e3b00c7cf8 None admin] RBAC: Authorizing `identity:get_user(user_id=70c226c0c5ea45f29547a5be6433762e)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:55.771961 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd353f-8a00-4031-b38e-39e3b00c7cf8 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:55.774570 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 86/173] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:55 2022] GET /identity/v3/users/70c226c0c5ea45f29547a5be6433762e => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:55.775921 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b519d-7e17-4b4c-ae00-d9f1e7a4fbc7 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:55.776404 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b519d-7e17-4b4c-ae00-d9f1e7a4fbc7 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:55.776837 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b519d-7e17-4b4c-ae00-d9f1e7a4fbc7 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:55.778736 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 87/174] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:55.779590 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b519d-7e17-4b4c-ae00-d9f1e7a4fbc7 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:55.814438 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 88/175] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:34:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:34:55.824680 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a463b-6926-49d6-b5cb-a1ef9a796baa None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:55.825175 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a463b-6926-49d6-b5cb-a1ef9a796baa None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:55.825647 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a463b-6926-49d6-b5cb-a1ef9a796baa None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:55.827192 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 89/176] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:55 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:55.828130 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a463b-6926-49d6-b5cb-a1ef9a796baa None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:55.918642 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b519d-7e17-4b4c-ae00-d9f1e7a4fbc7 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:55.943495 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a463b-6926-49d6-b5cb-a1ef9a796baa None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:55.958867 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c9a33-0c0f-4427-b106-b23195ebcde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:55.959867 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c9a33-0c0f-4427-b106-b23195ebcde1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:55.960384 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c9a33-0c0f-4427-b106-b23195ebcde1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:55.960902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c9a33-0c0f-4427-b106-b23195ebcde1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:55.962174 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c9a33-0c0f-4427-b106-b23195ebcde1 None admin] RBAC: Adding query filter params (role.id=c25cb9d119a74c7281a986fa76a92af6, scope.project.id=830f37ab382049b4b39840d0c29b05c0, user.id=70c226c0c5ea45f29547a5be6433762e) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:55.962714 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c9a33-0c0f-4427-b106-b23195ebcde1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:55.964477 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c9a33-0c0f-4427-b106-b23195ebcde1 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:55.971254 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 88/177] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:34:55 2022] GET /identity/v3/role_assignments?user.id=70c226c0c5ea45f29547a5be6433762e&scope.project.id=830f37ab382049b4b39840d0c29b05c0&role.id=c25cb9d119a74c7281a986fa76a92af6 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:55.973192 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040177a-92c8-4241-ab23-b7651a3a9a26 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:55.973700 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040177a-92c8-4241-ab23-b7651a3a9a26 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:55.974268 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040177a-92c8-4241-ab23-b7651a3a9a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:55.984539 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60624996-4d0e-4b0a-b957-20c29c3fe0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:55.985232 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60624996-4d0e-4b0a-b957-20c29c3fe0ed None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:55.985517 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60624996-4d0e-4b0a-b957-20c29c3fe0ed None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:55.985794 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60624996-4d0e-4b0a-b957-20c29c3fe0ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:55.997939 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-4040177a-92c8-4241-ab23-b7651a3a9a26 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:55.999613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-4040177a-92c8-4241-ab23-b7651a3a9a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:56.073437 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60624996-4d0e-4b0a-b957-20c29c3fe0ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:56.073988 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 89/178] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:56.075119 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60624996-4d0e-4b0a-b957-20c29c3fe0ed None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:56.075313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040177a-92c8-4241-ab23-b7651a3a9a26 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:56.187699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 90/179] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:34:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:34:56.189571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32232bd-e440-4e3d-9973-1465ef83b034 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:56.190150 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32232bd-e440-4e3d-9973-1465ef83b034 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:56.191710 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32232bd-e440-4e3d-9973-1465ef83b034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:56.202127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040177a-92c8-4241-ab23-b7651a3a9a26 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:56.210332 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-b32232bd-e440-4e3d-9973-1465ef83b034 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:56.212163 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b32232bd-e440-4e3d-9973-1465ef83b034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:56.247639 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad583eeb-71a8-4095-a6de-8f3552200a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:56.248877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583eeb-71a8-4095-a6de-8f3552200a02 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:56.249358 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583eeb-71a8-4095-a6de-8f3552200a02 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:56.249826 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583eeb-71a8-4095-a6de-8f3552200a02 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:56.251330 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad583eeb-71a8-4095-a6de-8f3552200a02 None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:56.253641 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad583eeb-71a8-4095-a6de-8f3552200a02 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:56.255999 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 90/180] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:34:56 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:56.262026 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad583eeb-71a8-4095-a6de-8f3552200a02 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:56.335567 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 91/181] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:56.340615 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32232bd-e440-4e3d-9973-1465ef83b034 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:56.428061 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad583eeb-71a8-4095-a6de-8f3552200a02 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:56.465387 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7216c9-d246-46e6-85f7-e427cc4cd223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:56.466116 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7216c9-d246-46e6-85f7-e427cc4cd223 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:56.466397 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7216c9-d246-46e6-85f7-e427cc4cd223 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:56.466681 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7216c9-d246-46e6-85f7-e427cc4cd223 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:56.474377 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32232bd-e440-4e3d-9973-1465ef83b034 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:56.477845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7216c9-d246-46e6-85f7-e427cc4cd223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:56.484893 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-8f7216c9-d246-46e6-85f7-e427cc4cd223 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:34:56.486297 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 91/182] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:34:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:56.487070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7216c9-d246-46e6-85f7-e427cc4cd223 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:56.512553 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a6790-3288-4a14-95e0-3e37f9c96f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:56.513797 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a6790-3288-4a14-95e0-3e37f9c96f33 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:56.514284 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a6790-3288-4a14-95e0-3e37f9c96f33 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:56.514780 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a6790-3288-4a14-95e0-3e37f9c96f33 None admin] PATH_INFO: `/v3/projects/0af3727abdcc46e899512dd46876421c` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:56.516304 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a6790-3288-4a14-95e0-3e37f9c96f33 None admin] RBAC: Authorizing `identity:get_project(project_id=0af3727abdcc46e899512dd46876421c)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:56.518100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a6790-3288-4a14-95e0-3e37f9c96f33 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:56.520918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 92/183] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:34:56 2022] GET /identity/v3/projects/0af3727abdcc46e899512dd46876421c => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:56.521949 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a6790-3288-4a14-95e0-3e37f9c96f33 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:56.592874 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7216c9-d246-46e6-85f7-e427cc4cd223 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:56.626096 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a6790-3288-4a14-95e0-3e37f9c96f33 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:56.631751 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6c57e-4895-45b6-82cb-5883d793aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:56.632523 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6c57e-4895-45b6-82cb-5883d793aad1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:56.632907 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6c57e-4895-45b6-82cb-5883d793aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:56.633247 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6c57e-4895-45b6-82cb-5883d793aad1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:56.634188 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6c57e-4895-45b6-82cb-5883d793aad1 None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=830f37ab382049b4b39840d0c29b05c0, user.id=251b9783da7b448e9c5a7980e4095700) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:56.634568 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6c57e-4895-45b6-82cb-5883d793aad1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:56.636164 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6c57e-4895-45b6-82cb-5883d793aad1 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:56.642801 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 92/184] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:34:56 2022] GET /identity/v3/role_assignments?user.id=251b9783da7b448e9c5a7980e4095700&scope.project.id=830f37ab382049b4b39840d0c29b05c0&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:56.643893 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6c57e-4895-45b6-82cb-5883d793aad1 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:56.677833 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402366ad-860e-425f-8592-b1eef1552e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:56.678976 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402366ad-860e-425f-8592-b1eef1552e1f None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:56.679421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402366ad-860e-425f-8592-b1eef1552e1f None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:56.679904 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402366ad-860e-425f-8592-b1eef1552e1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:56.696489 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402366ad-860e-425f-8592-b1eef1552e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:56.708616 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-402366ad-860e-425f-8592-b1eef1552e1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 14 21:34:56.710334 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 93/185] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:34:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:56.711367 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402366ad-860e-425f-8592-b1eef1552e1f None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:56.756852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6c57e-4895-45b6-82cb-5883d793aad1 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:56.792879 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58e440-be8e-4ef8-a758-e4838c695f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:56.793707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58e440-be8e-4ef8-a758-e4838c695f94 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:56.794063 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58e440-be8e-4ef8-a758-e4838c695f94 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:56.794464 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58e440-be8e-4ef8-a758-e4838c695f94 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:56.795437 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58e440-be8e-4ef8-a758-e4838c695f94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:56.795772 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58e440-be8e-4ef8-a758-e4838c695f94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:56.797369 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58e440-be8e-4ef8-a758-e4838c695f94 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:56.806500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 93/186] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:34:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:56.807825 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58e440-be8e-4ef8-a758-e4838c695f94 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:56.829941 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402366ad-860e-425f-8592-b1eef1552e1f None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:56.867303 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d1d6f-efcd-48a5-adb7-4fe161aa100e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:56.868380 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d1d6f-efcd-48a5-adb7-4fe161aa100e None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:56.868859 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d1d6f-efcd-48a5-adb7-4fe161aa100e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:56.869308 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d1d6f-efcd-48a5-adb7-4fe161aa100e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:56.870360 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d1d6f-efcd-48a5-adb7-4fe161aa100e None admin] RBAC: Adding query filter params (role.id=4a3588df731c452fba80b071fc342f78, scope.project.id=0af3727abdcc46e899512dd46876421c, user.id=70c226c0c5ea45f29547a5be6433762e) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:56.870877 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d1d6f-efcd-48a5-adb7-4fe161aa100e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:56.872665 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d1d6f-efcd-48a5-adb7-4fe161aa100e None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:56.879516 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 94/187] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:34:56 2022] GET /identity/v3/role_assignments?user.id=70c226c0c5ea45f29547a5be6433762e&scope.project.id=0af3727abdcc46e899512dd46876421c&role.id=4a3588df731c452fba80b071fc342f78 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:56.880750 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d1d6f-efcd-48a5-adb7-4fe161aa100e None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:56.953077 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58e440-be8e-4ef8-a758-e4838c695f94 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:57.016438 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d1d6f-efcd-48a5-adb7-4fe161aa100e None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:57.021061 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af01b5-0048-47fd-9b27-d0211744f66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:57.021629 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af01b5-0048-47fd-9b27-d0211744f66c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:57.021906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af01b5-0048-47fd-9b27-d0211744f66c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:57.022177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af01b5-0048-47fd-9b27-d0211744f66c None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:57.022960 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af01b5-0048-47fd-9b27-d0211744f66c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:57.023270 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af01b5-0048-47fd-9b27-d0211744f66c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:57.024735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af01b5-0048-47fd-9b27-d0211744f66c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:57.036731 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 94/188] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:34:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:57.038133 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7711be-dd15-4218-be36-13cd0231f7b5 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:57.038422 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7711be-dd15-4218-be36-13cd0231f7b5 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:57.038695 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7711be-dd15-4218-be36-13cd0231f7b5 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:57.040463 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 95/189] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:57.044087 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7711be-dd15-4218-be36-13cd0231f7b5 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:57.068171 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b63a2-c567-46e3-b752-4b6e0da14a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:57.069553 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b63a2-c567-46e3-b752-4b6e0da14a15 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:57.069980 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b63a2-c567-46e3-b752-4b6e0da14a15 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:57.070706 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b63a2-c567-46e3-b752-4b6e0da14a15 None admin] PATH_INFO: `/v3/users/d15602a2085e400d8b3360dadd275743` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:57.090622 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b63a2-c567-46e3-b752-4b6e0da14a15 None admin] RBAC: Authorizing `identity:get_user(user_id=d15602a2085e400d8b3360dadd275743)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:57.093538 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b63a2-c567-46e3-b752-4b6e0da14a15 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:57.095644 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 95/190] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:56 2022] GET /identity/v3/users/d15602a2085e400d8b3360dadd275743 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:57.097485 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341819f-7dd9-4fda-af29-5698bb4f79e3 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:57.098022 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341819f-7dd9-4fda-af29-5698bb4f79e3 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:57.098520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341819f-7dd9-4fda-af29-5698bb4f79e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:57.121944 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-f341819f-7dd9-4fda-af29-5698bb4f79e3 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:57.124298 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f341819f-7dd9-4fda-af29-5698bb4f79e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:57.177602 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7711be-dd15-4218-be36-13cd0231f7b5 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:57.210403 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 96/191] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:57.211355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341819f-7dd9-4fda-af29-5698bb4f79e3 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:57.220317 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2a693-7eb1-4e47-8d34-b5866d4782ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:57.221253 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2a693-7eb1-4e47-8d34-b5866d4782ca None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:57.221597 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2a693-7eb1-4e47-8d34-b5866d4782ca None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:57.221873 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2a693-7eb1-4e47-8d34-b5866d4782ca None admin] PATH_INFO: `/v3/users/d15602a2085e400d8b3360dadd275743` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:57.223205 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2a693-7eb1-4e47-8d34-b5866d4782ca None admin] RBAC: Authorizing `identity:get_user(user_id=d15602a2085e400d8b3360dadd275743)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:57.224678 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2a693-7eb1-4e47-8d34-b5866d4782ca None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:57.226632 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 96/192] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:57 2022] GET /identity/v3/users/d15602a2085e400d8b3360dadd275743 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:57.231826 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2a693-7eb1-4e47-8d34-b5866d4782ca None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:57.333871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341819f-7dd9-4fda-af29-5698bb4f79e3 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:57.348214 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2a693-7eb1-4e47-8d34-b5866d4782ca None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:57.367406 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fdd18-091d-4ed0-bbaa-fdb1f01a99f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:57.368062 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fdd18-091d-4ed0-bbaa-fdb1f01a99f1 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:57.368343 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fdd18-091d-4ed0-bbaa-fdb1f01a99f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:57.368638 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fdd18-091d-4ed0-bbaa-fdb1f01a99f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:57.380969 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86a30d-fbc5-43db-b7fd-93e81e772968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:57.381616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86a30d-fbc5-43db-b7fd-93e81e772968 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:57.381901 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86a30d-fbc5-43db-b7fd-93e81e772968 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:57.382172 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86a30d-fbc5-43db-b7fd-93e81e772968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:57.433642 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fdd18-091d-4ed0-bbaa-fdb1f01a99f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:57.435117 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fdd18-091d-4ed0-bbaa-fdb1f01a99f1 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:57.445525 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86a30d-fbc5-43db-b7fd-93e81e772968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:57.446968 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86a30d-fbc5-43db-b7fd-93e81e772968 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:57.527799 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 97/193] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:34:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:34:57.528661 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fdd18-091d-4ed0-bbaa-fdb1f01a99f1 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:57.540978 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 97/194] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:34:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 14 21:34:57.540978 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3bc57-f66d-4083-970a-6a43f3c84994 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:57.540978 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3bc57-f66d-4083-970a-6a43f3c84994 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:57.540978 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3bc57-f66d-4083-970a-6a43f3c84994 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:57.540978 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 98/195] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:34:57.540978 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3bc57-f66d-4083-970a-6a43f3c84994 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:57.626649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fdd18-091d-4ed0-bbaa-fdb1f01a99f1 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:57.640477 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3bc57-f66d-4083-970a-6a43f3c84994 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:57.659891 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa3366-90d6-4f22-abab-ca3cba0f0208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:57.660814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3366-90d6-4f22-abab-ca3cba0f0208 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:57.661095 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3366-90d6-4f22-abab-ca3cba0f0208 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:57.661361 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3366-90d6-4f22-abab-ca3cba0f0208 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:57.662534 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa3366-90d6-4f22-abab-ca3cba0f0208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:57.663979 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa3366-90d6-4f22-abab-ca3cba0f0208 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:57.665630 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 98/196] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:34:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:57.666387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa3366-90d6-4f22-abab-ca3cba0f0208 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:57.674729 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f304b3-69fb-41ce-aea2-49f73d39a27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:57.675588 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f304b3-69fb-41ce-aea2-49f73d39a27e None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:57.675864 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f304b3-69fb-41ce-aea2-49f73d39a27e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:57.676138 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f304b3-69fb-41ce-aea2-49f73d39a27e None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:57.677343 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f304b3-69fb-41ce-aea2-49f73d39a27e None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:57.678785 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f304b3-69fb-41ce-aea2-49f73d39a27e None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:57.680625 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 99/197] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:34:57 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:57.681744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523310b1-67ac-4461-824a-717c83487157 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:57.682029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523310b1-67ac-4461-824a-717c83487157 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:57.682306 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523310b1-67ac-4461-824a-717c83487157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:57.699961 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-523310b1-67ac-4461-824a-717c83487157 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:34:57.701172 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-523310b1-67ac-4461-824a-717c83487157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:34:57.764914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa3366-90d6-4f22-abab-ca3cba0f0208 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:57.765638 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 100/198] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:34:57.766454 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523310b1-67ac-4461-824a-717c83487157 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:57.797742 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3346cb7-dd6a-4a13-8863-855eb65187e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:57.798601 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3346cb7-dd6a-4a13-8863-855eb65187e8 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:57.798880 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3346cb7-dd6a-4a13-8863-855eb65187e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:57.799153 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3346cb7-dd6a-4a13-8863-855eb65187e8 None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:57.800606 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3346cb7-dd6a-4a13-8863-855eb65187e8 None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:57.802066 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3346cb7-dd6a-4a13-8863-855eb65187e8 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:57.803779 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 99/199] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:34:57 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:57.804537 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3346cb7-dd6a-4a13-8863-855eb65187e8 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:57.863121 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523310b1-67ac-4461-824a-717c83487157 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:57.902880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637cfd2-529a-4811-91ee-c9712afd0d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:57.902880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637cfd2-529a-4811-91ee-c9712afd0d6b None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:57.902880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637cfd2-529a-4811-91ee-c9712afd0d6b None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:57.902880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637cfd2-529a-4811-91ee-c9712afd0d6b None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:57.903242 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637cfd2-529a-4811-91ee-c9712afd0d6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:57.903317 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3346cb7-dd6a-4a13-8863-855eb65187e8 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:57.903727 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637cfd2-529a-4811-91ee-c9712afd0d6b None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:57.930840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a5636-e5b9-400c-b2fe-a9e6dfe9d94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:57.931489 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a5636-e5b9-400c-b2fe-a9e6dfe9d94d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:57.931771 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a5636-e5b9-400c-b2fe-a9e6dfe9d94d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:57.937551 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a5636-e5b9-400c-b2fe-a9e6dfe9d94d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:57.937551 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a5636-e5b9-400c-b2fe-a9e6dfe9d94d None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=10c2fefd8bd2453d918573810f1d5ecb, user.id=d15602a2085e400d8b3360dadd275743) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:57.937551 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a5636-e5b9-400c-b2fe-a9e6dfe9d94d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:57.937551 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a5636-e5b9-400c-b2fe-a9e6dfe9d94d None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:57.939968 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 100/200] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:34:57 2022] GET /identity/v3/role_assignments?user.id=d15602a2085e400d8b3360dadd275743&scope.project.id=10c2fefd8bd2453d918573810f1d5ecb&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:57.941455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a5636-e5b9-400c-b2fe-a9e6dfe9d94d None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:58.055500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a5636-e5b9-400c-b2fe-a9e6dfe9d94d None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:58.068115 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 101/201] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:34:57 2022] POST /identity/v3/users => generated 297 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:34:58.069239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637cfd2-529a-4811-91ee-c9712afd0d6b None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:58.095456 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b44aa-c210-4c51-ada6-10ea1cad5231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:58.096296 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b44aa-c210-4c51-ada6-10ea1cad5231 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:58.096612 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b44aa-c210-4c51-ada6-10ea1cad5231 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:58.097498 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b44aa-c210-4c51-ada6-10ea1cad5231 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:58.109976 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b44aa-c210-4c51-ada6-10ea1cad5231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:34:58.118711 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-be4b44aa-c210-4c51-ada6-10ea1cad5231 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 14 21:34:58.120324 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 101/202] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:34:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:34:58.126685 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b44aa-c210-4c51-ada6-10ea1cad5231 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:58.207459 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637cfd2-529a-4811-91ee-c9712afd0d6b None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:58.240299 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b44aa-c210-4c51-ada6-10ea1cad5231 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:58.244451 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52545a5-7e47-4dd3-a1ae-9d220661199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:58.245235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52545a5-7e47-4dd3-a1ae-9d220661199d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:58.245582 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52545a5-7e47-4dd3-a1ae-9d220661199d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:58.245924 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52545a5-7e47-4dd3-a1ae-9d220661199d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:58.246845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52545a5-7e47-4dd3-a1ae-9d220661199d None admin] RBAC: Adding query filter params (role.id=c25cb9d119a74c7281a986fa76a92af6, scope.project.id=10c2fefd8bd2453d918573810f1d5ecb, user.id=d15602a2085e400d8b3360dadd275743) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:58.247226 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52545a5-7e47-4dd3-a1ae-9d220661199d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:58.248827 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52545a5-7e47-4dd3-a1ae-9d220661199d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:58.255582 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 102/203] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:34:58 2022] GET /identity/v3/role_assignments?user.id=d15602a2085e400d8b3360dadd275743&scope.project.id=10c2fefd8bd2453d918573810f1d5ecb&role.id=c25cb9d119a74c7281a986fa76a92af6 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:58.285848 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f78f92-bf25-4a05-9ce9-cbb672b2ac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:58.286551 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f78f92-bf25-4a05-9ce9-cbb672b2ac2b None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:58.286821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f78f92-bf25-4a05-9ce9-cbb672b2ac2b None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:58.287098 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f78f92-bf25-4a05-9ce9-cbb672b2ac2b None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:58.287887 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f78f92-bf25-4a05-9ce9-cbb672b2ac2b None admin] RBAC: Adding query filter params (name=reader) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:58.288195 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f78f92-bf25-4a05-9ce9-cbb672b2ac2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:58.289685 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f78f92-bf25-4a05-9ce9-cbb672b2ac2b None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:58.300224 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 102/204] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:34:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:34:58.306427 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52545a5-7e47-4dd3-a1ae-9d220661199d None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:58.432306 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52545a5-7e47-4dd3-a1ae-9d220661199d None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:58.470061 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c253e2-85e3-45c3-8931-43fe2cc006b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:58.470866 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c253e2-85e3-45c3-8931-43fe2cc006b6 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:58.471141 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c253e2-85e3-45c3-8931-43fe2cc006b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:58.472216 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c253e2-85e3-45c3-8931-43fe2cc006b6 None admin] PATH_INFO: `/v3/users/6b55c5bbe8fb4f7489165b3d0659f253` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:58.473298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c253e2-85e3-45c3-8931-43fe2cc006b6 None admin] RBAC: Authorizing `identity:get_user(user_id=6b55c5bbe8fb4f7489165b3d0659f253)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:58.474754 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c253e2-85e3-45c3-8931-43fe2cc006b6 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:58.476389 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 103/205] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:34:58 2022] GET /identity/v3/users/6b55c5bbe8fb4f7489165b3d0659f253 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:58.482071 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f78f92-bf25-4a05-9ce9-cbb672b2ac2b None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:58.585900 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f78f92-bf25-4a05-9ce9-cbb672b2ac2b None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:58.628755 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8db6c-47f1-4df5-9c39-3679f12a2d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:58.629518 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8db6c-47f1-4df5-9c39-3679f12a2d4f None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:58.629802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8db6c-47f1-4df5-9c39-3679f12a2d4f None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:58.630081 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8db6c-47f1-4df5-9c39-3679f12a2d4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:58.724946 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8db6c-47f1-4df5-9c39-3679f12a2d4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:58.726334 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8db6c-47f1-4df5-9c39-3679f12a2d4f None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:58.825945 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 103/206] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:34:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:34:58.831649 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c253e2-85e3-45c3-8931-43fe2cc006b6 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:58.982408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c253e2-85e3-45c3-8931-43fe2cc006b6 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:59.024045 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a2345-e988-4d95-80bb-d21ed7605fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:59.024936 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a2345-e988-4d95-80bb-d21ed7605fa9 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:59.025214 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a2345-e988-4d95-80bb-d21ed7605fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:59.025487 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a2345-e988-4d95-80bb-d21ed7605fa9 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:59.029275 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a2345-e988-4d95-80bb-d21ed7605fa9 None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:59.030748 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a2345-e988-4d95-80bb-d21ed7605fa9 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:59.032437 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 104/207] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:34:58 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:34:59.041679 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8db6c-47f1-4df5-9c39-3679f12a2d4f None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:34:59.188418 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8db6c-47f1-4df5-9c39-3679f12a2d4f None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:34:59.232130 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a9040-af3c-4154-b275-c644caa77510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:34:59.232885 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a9040-af3c-4154-b275-c644caa77510 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:34:59.233112 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a9040-af3c-4154-b275-c644caa77510 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:34:59.233392 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a9040-af3c-4154-b275-c644caa77510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:34:59.234235 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a9040-af3c-4154-b275-c644caa77510 None admin] RBAC: Adding query filter params (role.id=8301a1978ca14ba59f726e7b703fa445, scope.project.id=830f37ab382049b4b39840d0c29b05c0, user.id=6b55c5bbe8fb4f7489165b3d0659f253) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:34:59.234546 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a9040-af3c-4154-b275-c644caa77510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:34:59.235985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a9040-af3c-4154-b275-c644caa77510 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:34:59.243079 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 104/208] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:34:59 2022] GET /identity/v3/role_assignments?user.id=6b55c5bbe8fb4f7489165b3d0659f253&scope.project.id=830f37ab382049b4b39840d0c29b05c0&role.id=8301a1978ca14ba59f726e7b703fa445 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:00.579350 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f616ab-3763-4705-9ec8-78352485d7d1 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:00.580213 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f616ab-3763-4705-9ec8-78352485d7d1 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:00.580772 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f616ab-3763-4705-9ec8-78352485d7d1 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:00.582653 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 105/209] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:00.588647 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57478d28-2407-4aec-b4d6-e0ea3df40377 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:00.589527 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57478d28-2407-4aec-b4d6-e0ea3df40377 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:00.590003 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57478d28-2407-4aec-b4d6-e0ea3df40377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:00.607409 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-57478d28-2407-4aec-b4d6-e0ea3df40377 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:00.608935 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-57478d28-2407-4aec-b4d6-e0ea3df40377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:00.682981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 105/210] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:35:00.705115 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f616ab-3763-4705-9ec8-78352485d7d1 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:00.808897 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f616ab-3763-4705-9ec8-78352485d7d1 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:00.828175 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38b558-39f4-4950-b8d6-937b1551c058 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:00.828869 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38b558-39f4-4950-b8d6-937b1551c058 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:00.829341 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38b558-39f4-4950-b8d6-937b1551c058 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:00.832320 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 106/211] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:35:00.837917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d92551-5aac-43a7-987d-9ff194f21de4 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:00.838422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d92551-5aac-43a7-987d-9ff194f21de4 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:00.838889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d92551-5aac-43a7-987d-9ff194f21de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:00.845256 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69d343-6e13-4442-a3a0-216c78190751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:00.846293 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69d343-6e13-4442-a3a0-216c78190751 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:00.846399 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69d343-6e13-4442-a3a0-216c78190751 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:00.846654 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69d343-6e13-4442-a3a0-216c78190751 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:00.856924 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69d343-6e13-4442-a3a0-216c78190751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:00.859243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d1d92551-5aac-43a7-987d-9ff194f21de4 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:00.860443 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d1d92551-5aac-43a7-987d-9ff194f21de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:00.864793 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-ba69d343-6e13-4442-a3a0-216c78190751 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:35:00.866199 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 106/212] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:00.869846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0a334-a73b-485b-81ad-0e890ffe0e34 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:00.870661 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0a334-a73b-485b-81ad-0e890ffe0e34 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:00.871157 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0a334-a73b-485b-81ad-0e890ffe0e34 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:00.872481 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 107/213] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:00.873231 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0a334-a73b-485b-81ad-0e890ffe0e34 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:00.936545 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 107/214] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:00.938025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2ec8-4cac-4ec0-89de-584385bccc53 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:00.938369 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2ec8-4cac-4ec0-89de-584385bccc53 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:00.938648 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2ec8-4cac-4ec0-89de-584385bccc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:00.958721 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-f20a2ec8-4cac-4ec0-89de-584385bccc53 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:00.959919 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f20a2ec8-4cac-4ec0-89de-584385bccc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:00.989110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0a334-a73b-485b-81ad-0e890ffe0e34 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:01.028855 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af81e3-ed76-4da0-8b25-a8e910d64a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:01.029900 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af81e3-ed76-4da0-8b25-a8e910d64a3a None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:01.030409 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af81e3-ed76-4da0-8b25-a8e910d64a3a None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:01.030695 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af81e3-ed76-4da0-8b25-a8e910d64a3a None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:01.031457 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af81e3-ed76-4da0-8b25-a8e910d64a3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:01.031774 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af81e3-ed76-4da0-8b25-a8e910d64a3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:01.033213 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af81e3-ed76-4da0-8b25-a8e910d64a3a None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:01.036354 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 108/215] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:01.037233 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a2ec8-4cac-4ec0-89de-584385bccc53 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:01.049143 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 108/216] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:01.051229 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d472c7b-6d3b-4d88-bc8d-7f53b22db376 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:01.051515 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d472c7b-6d3b-4d88-bc8d-7f53b22db376 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:01.051792 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d472c7b-6d3b-4d88-bc8d-7f53b22db376 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:01.053093 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 109/217] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:01.057289 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d472c7b-6d3b-4d88-bc8d-7f53b22db376 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:01.136568 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a2ec8-4cac-4ec0-89de-584385bccc53 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:01.153378 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d472c7b-6d3b-4d88-bc8d-7f53b22db376 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:01.168416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeab98d-2870-464b-92e1-a289b78c0723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:01.169233 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeab98d-2870-464b-92e1-a289b78c0723 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:01.169512 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeab98d-2870-464b-92e1-a289b78c0723 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:01.169785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeab98d-2870-464b-92e1-a289b78c0723 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:01.180221 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeab98d-2870-464b-92e1-a289b78c0723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:01.185233 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a1df4-0894-416e-b1bf-e6d5963e6c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:01.186096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a1df4-0894-416e-b1bf-e6d5963e6c41 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:01.186369 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a1df4-0894-416e-b1bf-e6d5963e6c41 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:01.186639 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a1df4-0894-416e-b1bf-e6d5963e6c41 None admin] PATH_INFO: `/v3/users/d15602a2085e400d8b3360dadd275743` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:01.187327 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-dfeab98d-2870-464b-92e1-a289b78c0723 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:35:01.187788 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a1df4-0894-416e-b1bf-e6d5963e6c41 None admin] RBAC: Authorizing `identity:get_user(user_id=d15602a2085e400d8b3360dadd275743)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:01.188529 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 109/218] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:01.189309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a1df4-0894-416e-b1bf-e6d5963e6c41 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:01.189424 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeab98d-2870-464b-92e1-a289b78c0723 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:01.191753 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 110/219] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:35:01 2022] GET /identity/v3/users/d15602a2085e400d8b3360dadd275743 => generated 283 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:01.192751 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e76d9-6c39-4b4f-939a-a7a4afa0fb6a None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:01.193028 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e76d9-6c39-4b4f-939a-a7a4afa0fb6a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:01.193297 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e76d9-6c39-4b4f-939a-a7a4afa0fb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:01.208707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-815e76d9-6c39-4b4f-939a-a7a4afa0fb6a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:01.209888 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-815e76d9-6c39-4b4f-939a-a7a4afa0fb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:01.271573 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 111/220] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:01.284764 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e76d9-6c39-4b4f-939a-a7a4afa0fb6a None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:01.289237 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeab98d-2870-464b-92e1-a289b78c0723 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:01.321893 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fa4a6-33e7-4c59-ba54-9815604cb937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:01.322691 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fa4a6-33e7-4c59-ba54-9815604cb937 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:01.322966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fa4a6-33e7-4c59-ba54-9815604cb937 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:01.323236 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fa4a6-33e7-4c59-ba54-9815604cb937 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:01.332836 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fa4a6-33e7-4c59-ba54-9815604cb937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:01.340354 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-f56fa4a6-33e7-4c59-ba54-9815604cb937 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 14 21:35:01.341583 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 110/221] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:35:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:01.343144 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fa4a6-33e7-4c59-ba54-9815604cb937 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:01.365957 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e76d9-6c39-4b4f-939a-a7a4afa0fb6a None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:01.400175 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100ffce-6f8f-45f0-baa6-093e08b576c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:01.400792 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100ffce-6f8f-45f0-baa6-093e08b576c7 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:01.401076 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100ffce-6f8f-45f0-baa6-093e08b576c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:01.401350 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100ffce-6f8f-45f0-baa6-093e08b576c7 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:01.402103 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100ffce-6f8f-45f0-baa6-093e08b576c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:01.402408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100ffce-6f8f-45f0-baa6-093e08b576c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:01.403791 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100ffce-6f8f-45f0-baa6-093e08b576c7 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:01.412238 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 112/222] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:01.413077 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100ffce-6f8f-45f0-baa6-093e08b576c7 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:01.439274 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fa4a6-33e7-4c59-ba54-9815604cb937 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:01.470684 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939a4d3-113b-4ce0-93c9-8904ac2d3a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:01.472118 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939a4d3-113b-4ce0-93c9-8904ac2d3a68 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:01.472488 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939a4d3-113b-4ce0-93c9-8904ac2d3a68 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:01.472797 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939a4d3-113b-4ce0-93c9-8904ac2d3a68 None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:01.474009 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939a4d3-113b-4ce0-93c9-8904ac2d3a68 None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:01.475481 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939a4d3-113b-4ce0-93c9-8904ac2d3a68 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:01.477226 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 111/223] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:01 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:01.477993 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939a4d3-113b-4ce0-93c9-8904ac2d3a68 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:01.507350 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100ffce-6f8f-45f0-baa6-093e08b576c7 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:01.539213 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6508b-1627-4ca4-bc68-07beb75b70cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:01.539997 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6508b-1627-4ca4-bc68-07beb75b70cb None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:01.540275 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6508b-1627-4ca4-bc68-07beb75b70cb None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:01.540551 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6508b-1627-4ca4-bc68-07beb75b70cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:01.541749 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6508b-1627-4ca4-bc68-07beb75b70cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:01.543208 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6508b-1627-4ca4-bc68-07beb75b70cb None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:01.544857 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 113/224] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:01.545615 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6508b-1627-4ca4-bc68-07beb75b70cb None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:01.577427 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939a4d3-113b-4ce0-93c9-8904ac2d3a68 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:01.609634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019bd60-4bd6-456c-bbc9-05327fc42dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:01.610301 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019bd60-4bd6-456c-bbc9-05327fc42dd5 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:01.610582 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019bd60-4bd6-456c-bbc9-05327fc42dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:01.610859 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019bd60-4bd6-456c-bbc9-05327fc42dd5 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:01.611605 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019bd60-4bd6-456c-bbc9-05327fc42dd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:01.611974 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019bd60-4bd6-456c-bbc9-05327fc42dd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:01.613887 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019bd60-4bd6-456c-bbc9-05327fc42dd5 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:01.621618 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 112/225] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:01.622477 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019bd60-4bd6-456c-bbc9-05327fc42dd5 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:01.640751 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6508b-1627-4ca4-bc68-07beb75b70cb None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:01.672351 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0afb80-c1c0-4d05-aa1c-e76972cd33f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:01.673168 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0afb80-c1c0-4d05-aa1c-e76972cd33f6 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:01.673446 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0afb80-c1c0-4d05-aa1c-e76972cd33f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:01.673715 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0afb80-c1c0-4d05-aa1c-e76972cd33f6 None admin] PATH_INFO: `/v3/users/c1490bf7ca1e42779b2ded00a312a181` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:01.686405 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0afb80-c1c0-4d05-aa1c-e76972cd33f6 None admin] RBAC: Authorizing `identity:get_user(user_id=c1490bf7ca1e42779b2ded00a312a181)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:01.687871 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0afb80-c1c0-4d05-aa1c-e76972cd33f6 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:01.689572 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 114/226] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:35:01 2022] GET /identity/v3/users/c1490bf7ca1e42779b2ded00a312a181 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:01.690964 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0afb80-c1c0-4d05-aa1c-e76972cd33f6 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:01.719591 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019bd60-4bd6-456c-bbc9-05327fc42dd5 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:01.752317 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a39991-e563-4adc-8705-b787e329d334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:01.753255 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a39991-e563-4adc-8705-b787e329d334 None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:01.753547 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a39991-e563-4adc-8705-b787e329d334 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:01.753807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a39991-e563-4adc-8705-b787e329d334 None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb/users/d15602a2085e400d8b3360dadd275743/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:01.755785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a39991-e563-4adc-8705-b787e329d334 None admin] RBAC: Authorizing `identity:create_grant(project_id=10c2fefd8bd2453d918573810f1d5ecb, user_id=d15602a2085e400d8b3360dadd275743, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:01.757285 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a39991-e563-4adc-8705-b787e329d334 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:01.786878 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0afb80-c1c0-4d05-aa1c-e76972cd33f6 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:01.818931 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23bcfc-4bd7-4750-a171-d199d6c62ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:01.819593 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23bcfc-4bd7-4750-a171-d199d6c62ae5 None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:01.819886 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23bcfc-4bd7-4750-a171-d199d6c62ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:01.820142 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23bcfc-4bd7-4750-a171-d199d6c62ae5 None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:01.820881 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23bcfc-4bd7-4750-a171-d199d6c62ae5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:01.822308 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23bcfc-4bd7-4750-a171-d199d6c62ae5 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:01.838799 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 113/227] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:35:01 2022] PUT /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb/users/d15602a2085e400d8b3360dadd275743/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:35:01.839727 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a39991-e563-4adc-8705-b787e329d334 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:01.919242 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 115/228] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:35:01 2022] POST /identity/v3/users => generated 297 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:35:01.933269 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23bcfc-4bd7-4750-a171-d199d6c62ae5 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:01.962188 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a39991-e563-4adc-8705-b787e329d334 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:02.016068 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338293b8-23bb-4bf9-b3cc-9f40bff90acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:02.017946 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338293b8-23bb-4bf9-b3cc-9f40bff90acf None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:02.019122 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338293b8-23bb-4bf9-b3cc-9f40bff90acf None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:02.019551 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338293b8-23bb-4bf9-b3cc-9f40bff90acf None admin] PATH_INFO: `/v3/users/d15602a2085e400d8b3360dadd275743` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:02.021497 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338293b8-23bb-4bf9-b3cc-9f40bff90acf None admin] RBAC: Authorizing `identity:get_user(user_id=d15602a2085e400d8b3360dadd275743)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:02.024260 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338293b8-23bb-4bf9-b3cc-9f40bff90acf None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:02.031505 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 114/229] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:35:01 2022] GET /identity/v3/users/d15602a2085e400d8b3360dadd275743 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:02.035501 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338293b8-23bb-4bf9-b3cc-9f40bff90acf None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:02.084135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23bcfc-4bd7-4750-a171-d199d6c62ae5 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:02.123021 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c092919-dd5d-4377-b072-7facfc5f0630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:02.123677 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c092919-dd5d-4377-b072-7facfc5f0630 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:02.123959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c092919-dd5d-4377-b072-7facfc5f0630 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:02.124223 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c092919-dd5d-4377-b072-7facfc5f0630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:02.169459 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338293b8-23bb-4bf9-b3cc-9f40bff90acf None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:02.206441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c092919-dd5d-4377-b072-7facfc5f0630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:02.208688 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c092919-dd5d-4377-b072-7facfc5f0630 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:02.223371 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a8592-624d-4677-838c-a23caf2f9275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:02.224260 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a8592-624d-4677-838c-a23caf2f9275 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:02.224540 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a8592-624d-4677-838c-a23caf2f9275 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:02.224839 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a8592-624d-4677-838c-a23caf2f9275 None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:02.226050 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a8592-624d-4677-838c-a23caf2f9275 None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:02.227686 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a8592-624d-4677-838c-a23caf2f9275 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:02.229589 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 115/230] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:02 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:02.236669 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a8592-624d-4677-838c-a23caf2f9275 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:02.329883 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 116/231] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:02.335691 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c092919-dd5d-4377-b072-7facfc5f0630 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:02.369442 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a8592-624d-4677-838c-a23caf2f9275 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:02.404943 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00a027-aefb-458f-9493-307957d86365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:02.406234 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00a027-aefb-458f-9493-307957d86365 None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:02.406709 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00a027-aefb-458f-9493-307957d86365 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:02.407174 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00a027-aefb-458f-9493-307957d86365 None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb/users/d15602a2085e400d8b3360dadd275743/roles/c25cb9d119a74c7281a986fa76a92af6` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:02.410461 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00a027-aefb-458f-9493-307957d86365 None admin] RBAC: Authorizing `identity:create_grant(project_id=10c2fefd8bd2453d918573810f1d5ecb, user_id=d15602a2085e400d8b3360dadd275743, role_id=c25cb9d119a74c7281a986fa76a92af6)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:02.412228 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00a027-aefb-458f-9493-307957d86365 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:02.454790 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c092919-dd5d-4377-b072-7facfc5f0630 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:02.491416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7314ccb-aed0-4d56-9374-0249ff90dbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:02.492715 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7314ccb-aed0-4d56-9374-0249ff90dbe0 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:02.493242 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7314ccb-aed0-4d56-9374-0249ff90dbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:02.493725 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7314ccb-aed0-4d56-9374-0249ff90dbe0 None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:02.501244 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 116/232] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:35:02 2022] PUT /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb/users/d15602a2085e400d8b3360dadd275743/roles/c25cb9d119a74c7281a986fa76a92af6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:35:02.501964 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7314ccb-aed0-4d56-9374-0249ff90dbe0 None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:02.504037 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7314ccb-aed0-4d56-9374-0249ff90dbe0 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:02.510481 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 117/233] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:02 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:02.516644 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00a027-aefb-458f-9493-307957d86365 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:02.641401 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00a027-aefb-458f-9493-307957d86365 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:02.679955 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0e957-c9ef-438e-9ffc-0be94d15d8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:02.680973 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0e957-c9ef-438e-9ffc-0be94d15d8a6 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:02.681436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0e957-c9ef-438e-9ffc-0be94d15d8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:02.681909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0e957-c9ef-438e-9ffc-0be94d15d8a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:02.682945 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0e957-c9ef-438e-9ffc-0be94d15d8a6 None admin] RBAC: Adding query filter params (role.id=4a3588df731c452fba80b071fc342f78, scope.project.id=10c2fefd8bd2453d918573810f1d5ecb, user.id=c1490bf7ca1e42779b2ded00a312a181) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:02.683438 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0e957-c9ef-438e-9ffc-0be94d15d8a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:02.685211 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0e957-c9ef-438e-9ffc-0be94d15d8a6 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:02.692002 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 117/234] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:35:02 2022] GET /identity/v3/role_assignments?user.id=c1490bf7ca1e42779b2ded00a312a181&scope.project.id=10c2fefd8bd2453d918573810f1d5ecb&role.id=4a3588df731c452fba80b071fc342f78 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:04.786022 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9345e7-449b-4b06-9250-d65235bc259a None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:04.786608 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9345e7-449b-4b06-9250-d65235bc259a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:04.786608 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9345e7-449b-4b06-9250-d65235bc259a None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:04.788772 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 118/235] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:04.794424 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8bc04-fa7a-41b0-9e42-020db245c42c None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:04.795272 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8bc04-fa7a-41b0-9e42-020db245c42c None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:04.795926 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8bc04-fa7a-41b0-9e42-020db245c42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:04.821617 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d1c8bc04-fa7a-41b0-9e42-020db245c42c None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:04.823183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d1c8bc04-fa7a-41b0-9e42-020db245c42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:04.912144 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 118/236] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:04.934267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f058b33-767a-41d0-ab95-4c687bae6a1e None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:04.934851 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f058b33-767a-41d0-ab95-4c687bae6a1e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:04.935289 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f058b33-767a-41d0-ab95-4c687bae6a1e None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:04.936973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 119/237] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:04.942698 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47883c79-76fe-4603-a770-850c203f30d5 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:04.942980 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47883c79-76fe-4603-a770-850c203f30d5 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:04.943254 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47883c79-76fe-4603-a770-850c203f30d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:04.962933 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f058b33-767a-41d0-ab95-4c687bae6a1e None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:04.967169 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-47883c79-76fe-4603-a770-850c203f30d5 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:04.968360 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-47883c79-76fe-4603-a770-850c203f30d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:05.051931 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 119/238] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:05.053335 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d688841-5f28-4d6d-a097-ee9accd499e9 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:05.053628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d688841-5f28-4d6d-a097-ee9accd499e9 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:05.053928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d688841-5f28-4d6d-a097-ee9accd499e9 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:05.055239 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 120/239] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:05.061323 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034a9d6-23ae-44c4-af56-e27d055044e0 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:05.061605 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034a9d6-23ae-44c4-af56-e27d055044e0 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:05.061887 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034a9d6-23ae-44c4-af56-e27d055044e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:05.137131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-4034a9d6-23ae-44c4-af56-e27d055044e0 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:05.139135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-4034a9d6-23ae-44c4-af56-e27d055044e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:05.160553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f058b33-767a-41d0-ab95-4c687bae6a1e None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:05.198133 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f434a3-37e5-4200-a66d-d8d05f285abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:05.198967 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f434a3-37e5-4200-a66d-d8d05f285abd None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:05.199245 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f434a3-37e5-4200-a66d-d8d05f285abd None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:05.199514 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f434a3-37e5-4200-a66d-d8d05f285abd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:05.216097 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f434a3-37e5-4200-a66d-d8d05f285abd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:05.223694 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 121/240] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:35:05.224247 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-76f434a3-37e5-4200-a66d-d8d05f285abd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:35:05.224557 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034a9d6-23ae-44c4-af56-e27d055044e0 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:05.234000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 120/241] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:35:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:05.239686 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f434a3-37e5-4200-a66d-d8d05f285abd None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:05.339886 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034a9d6-23ae-44c4-af56-e27d055044e0 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:05.365969 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f434a3-37e5-4200-a66d-d8d05f285abd None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:05.381614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64ef89-57c9-478f-a916-8c10712b9d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:05.382683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64ef89-57c9-478f-a916-8c10712b9d28 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:05.382966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64ef89-57c9-478f-a916-8c10712b9d28 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:05.383238 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64ef89-57c9-478f-a916-8c10712b9d28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:05.384468 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64ef89-57c9-478f-a916-8c10712b9d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:05.385960 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64ef89-57c9-478f-a916-8c10712b9d28 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:05.387972 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 122/242] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:05.389122 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64ef89-57c9-478f-a916-8c10712b9d28 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:05.402393 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c579332-f820-4744-aa6c-104ed4e96874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:05.403070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c579332-f820-4744-aa6c-104ed4e96874 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:05.403345 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c579332-f820-4744-aa6c-104ed4e96874 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:05.403617 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c579332-f820-4744-aa6c-104ed4e96874 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:05.404376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c579332-f820-4744-aa6c-104ed4e96874 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:05.404711 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c579332-f820-4744-aa6c-104ed4e96874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:05.406123 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c579332-f820-4744-aa6c-104ed4e96874 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:05.416849 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 121/243] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:05.417770 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c579332-f820-4744-aa6c-104ed4e96874 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:05.506757 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64ef89-57c9-478f-a916-8c10712b9d28 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:05.520916 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c579332-f820-4744-aa6c-104ed4e96874 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:05.541436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d81de-cf2a-4d5a-bb4c-10d8916363d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:05.542238 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d81de-cf2a-4d5a-bb4c-10d8916363d7 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:05.542516 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d81de-cf2a-4d5a-bb4c-10d8916363d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:05.542791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d81de-cf2a-4d5a-bb4c-10d8916363d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:05.554663 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d81de-cf2a-4d5a-bb4c-10d8916363d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:05.555195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35452038-8caf-4301-8874-138a1428895e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:05.555869 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35452038-8caf-4301-8874-138a1428895e None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:05.556145 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35452038-8caf-4301-8874-138a1428895e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:05.556415 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35452038-8caf-4301-8874-138a1428895e None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:05.557157 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35452038-8caf-4301-8874-138a1428895e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:05.558595 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35452038-8caf-4301-8874-138a1428895e None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:05.561709 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-5c5d81de-cf2a-4d5a-bb4c-10d8916363d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 14 21:35:05.563220 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 123/244] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:05.563824 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d81de-cf2a-4d5a-bb4c-10d8916363d7 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:05.666932 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 122/245] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:35:05 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:35:05.667589 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d81de-cf2a-4d5a-bb4c-10d8916363d7 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:05.668225 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19465b-dc71-4b74-a65f-ab4ba2501127 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:05.668654 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19465b-dc71-4b74-a65f-ab4ba2501127 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:05.668832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19465b-dc71-4b74-a65f-ab4ba2501127 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:05.672736 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 123/246] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:05.672736 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19465b-dc71-4b74-a65f-ab4ba2501127 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:05.718879 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea5a5a-a2e1-4875-ab87-2be0a023c15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:05.719769 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea5a5a-a2e1-4875-ab87-2be0a023c15e None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:05.720048 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea5a5a-a2e1-4875-ab87-2be0a023c15e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:05.720314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea5a5a-a2e1-4875-ab87-2be0a023c15e None admin] PATH_INFO: `/v3/users/d15602a2085e400d8b3360dadd275743` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:05.722413 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea5a5a-a2e1-4875-ab87-2be0a023c15e None admin] RBAC: Authorizing `identity:get_user(user_id=d15602a2085e400d8b3360dadd275743)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:05.723899 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea5a5a-a2e1-4875-ab87-2be0a023c15e None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:05.725640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 124/247] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:35:05 2022] GET /identity/v3/users/d15602a2085e400d8b3360dadd275743 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:05.726868 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a2147-0d57-4b0f-9c5b-5f1190561957 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:05.727149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a2147-0d57-4b0f-9c5b-5f1190561957 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:05.727565 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a2147-0d57-4b0f-9c5b-5f1190561957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:05.746621 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-8a1a2147-0d57-4b0f-9c5b-5f1190561957 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:05.747882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-8a1a2147-0d57-4b0f-9c5b-5f1190561957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:05.791831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19465b-dc71-4b74-a65f-ab4ba2501127 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:05.823953 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 125/248] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:05.826173 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f630dda-596b-4cdf-8a9b-d5250aacb677 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:05.826791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f630dda-596b-4cdf-8a9b-d5250aacb677 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:05.827263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f630dda-596b-4cdf-8a9b-d5250aacb677 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:05.829346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 126/249] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:05.830971 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f630dda-596b-4cdf-8a9b-d5250aacb677 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:05.842460 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe32bb0-bc45-43e2-ab3e-2efc47619cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:05.843171 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe32bb0-bc45-43e2-ab3e-2efc47619cdb None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:05.843455 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe32bb0-bc45-43e2-ab3e-2efc47619cdb None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:05.843728 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe32bb0-bc45-43e2-ab3e-2efc47619cdb None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:05.844501 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe32bb0-bc45-43e2-ab3e-2efc47619cdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:05.844842 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe32bb0-bc45-43e2-ab3e-2efc47619cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:05.846882 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe32bb0-bc45-43e2-ab3e-2efc47619cdb None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:05.856542 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 124/250] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:05.858029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012139d9-4a0d-46cb-b62c-a51d70307fc4 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:05.858321 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012139d9-4a0d-46cb-b62c-a51d70307fc4 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:05.858600 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012139d9-4a0d-46cb-b62c-a51d70307fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:05.876650 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-012139d9-4a0d-46cb-b62c-a51d70307fc4 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:05.878767 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-012139d9-4a0d-46cb-b62c-a51d70307fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:05.954147 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f630dda-596b-4cdf-8a9b-d5250aacb677 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:05.954329 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 125/251] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:05.955004 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012139d9-4a0d-46cb-b62c-a51d70307fc4 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:05.999408 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940822f-084b-46dc-ad2c-5fccf9a33c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:06.000072 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940822f-084b-46dc-ad2c-5fccf9a33c11 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:06.000349 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940822f-084b-46dc-ad2c-5fccf9a33c11 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:06.000678 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940822f-084b-46dc-ad2c-5fccf9a33c11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:06.073568 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940822f-084b-46dc-ad2c-5fccf9a33c11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:06.075352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940822f-084b-46dc-ad2c-5fccf9a33c11 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:06.084697 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012139d9-4a0d-46cb-b62c-a51d70307fc4 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:06.124557 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f620b95-5723-4b87-88cd-2c9af22bcaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:06.125389 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f620b95-5723-4b87-88cd-2c9af22bcaa3 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:06.125661 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f620b95-5723-4b87-88cd-2c9af22bcaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:06.125926 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f620b95-5723-4b87-88cd-2c9af22bcaa3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:06.136313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f620b95-5723-4b87-88cd-2c9af22bcaa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:06.143832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-9f620b95-5723-4b87-88cd-2c9af22bcaa3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 14 21:35:06.145319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 126/252] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:35:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:06.145996 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f620b95-5723-4b87-88cd-2c9af22bcaa3 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:06.200040 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 127/253] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:06.201158 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940822f-084b-46dc-ad2c-5fccf9a33c11 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:06.314057 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940822f-084b-46dc-ad2c-5fccf9a33c11 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:06.357087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd633075-3a63-4a0b-979a-be232b09cdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:06.357888 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd633075-3a63-4a0b-979a-be232b09cdcb None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:06.358168 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd633075-3a63-4a0b-979a-be232b09cdcb None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:06.358506 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd633075-3a63-4a0b-979a-be232b09cdcb None admin] PATH_INFO: `/v3/roles/member` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:06.370606 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd633075-3a63-4a0b-979a-be232b09cdcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:06.377677 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-cd633075-3a63-4a0b-979a-be232b09cdcb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:35:06.377897 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f620b95-5723-4b87-88cd-2c9af22bcaa3 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:06.383654 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 128/254] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:06.383654 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd633075-3a63-4a0b-979a-be232b09cdcb None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:06.417569 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52744ae-df8d-49e8-9a32-1c704f26e240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:06.418618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52744ae-df8d-49e8-9a32-1c704f26e240 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:06.418999 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52744ae-df8d-49e8-9a32-1c704f26e240 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:06.419391 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52744ae-df8d-49e8-9a32-1c704f26e240 None admin] PATH_INFO: `/v3/users/579b183eaa274111b17fba27f5ca6f6f` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:06.433125 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52744ae-df8d-49e8-9a32-1c704f26e240 None admin] RBAC: Authorizing `identity:get_user(user_id=579b183eaa274111b17fba27f5ca6f6f)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:06.434790 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52744ae-df8d-49e8-9a32-1c704f26e240 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:06.436886 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 127/255] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:35:06 2022] GET /identity/v3/users/579b183eaa274111b17fba27f5ca6f6f => generated 297 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:06.437753 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52744ae-df8d-49e8-9a32-1c704f26e240 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:06.508816 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd633075-3a63-4a0b-979a-be232b09cdcb None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:06.542420 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52744ae-df8d-49e8-9a32-1c704f26e240 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:06.551748 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510e74f-03ed-4d21-aab2-e7995b8249fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:06.553059 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510e74f-03ed-4d21-aab2-e7995b8249fc None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:06.553507 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510e74f-03ed-4d21-aab2-e7995b8249fc None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:06.553920 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510e74f-03ed-4d21-aab2-e7995b8249fc None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:06.555375 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510e74f-03ed-4d21-aab2-e7995b8249fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:06.555849 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510e74f-03ed-4d21-aab2-e7995b8249fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:06.558016 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510e74f-03ed-4d21-aab2-e7995b8249fc None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:06.569628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 129/256] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:06.570812 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510e74f-03ed-4d21-aab2-e7995b8249fc None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:06.582296 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b942389-1484-4a9d-a81e-798871ab7c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:06.583325 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b942389-1484-4a9d-a81e-798871ab7c9a None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:06.583706 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b942389-1484-4a9d-a81e-798871ab7c9a None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:06.584082 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b942389-1484-4a9d-a81e-798871ab7c9a None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:06.585710 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b942389-1484-4a9d-a81e-798871ab7c9a None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:06.587438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b942389-1484-4a9d-a81e-798871ab7c9a None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:06.589320 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 128/257] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:06 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:06.594323 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b942389-1484-4a9d-a81e-798871ab7c9a None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:06.696807 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b942389-1484-4a9d-a81e-798871ab7c9a None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:06.704641 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510e74f-03ed-4d21-aab2-e7995b8249fc None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:06.732027 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dc5b3-27a9-4b1b-8f27-0b2dd04826e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:06.732735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dc5b3-27a9-4b1b-8f27-0b2dd04826e1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:06.733021 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dc5b3-27a9-4b1b-8f27-0b2dd04826e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:06.733298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dc5b3-27a9-4b1b-8f27-0b2dd04826e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:06.743500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ecc3c-eeba-46fb-bcbe-15e3d6f7e28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:06.744507 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ecc3c-eeba-46fb-bcbe-15e3d6f7e28d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:06.745037 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ecc3c-eeba-46fb-bcbe-15e3d6f7e28d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:06.745505 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ecc3c-eeba-46fb-bcbe-15e3d6f7e28d None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:06.746453 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ecc3c-eeba-46fb-bcbe-15e3d6f7e28d None admin] RBAC: Adding query filter params (name=member) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:06.746953 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ecc3c-eeba-46fb-bcbe-15e3d6f7e28d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:06.748561 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ecc3c-eeba-46fb-bcbe-15e3d6f7e28d None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:06.763865 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 130/258] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:06.765099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ecc3c-eeba-46fb-bcbe-15e3d6f7e28d None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:06.803461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dc5b3-27a9-4b1b-8f27-0b2dd04826e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:06.804972 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dc5b3-27a9-4b1b-8f27-0b2dd04826e1 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:06.868571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ecc3c-eeba-46fb-bcbe-15e3d6f7e28d None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:06.903980 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbabf63-64cc-4b4b-a10a-788060d354d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:06.905218 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbabf63-64cc-4b4b-a10a-788060d354d0 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:06.905663 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbabf63-64cc-4b4b-a10a-788060d354d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:06.905765 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 129/259] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:06.906183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbabf63-64cc-4b4b-a10a-788060d354d0 None admin] PATH_INFO: `/v3/users/d15602a2085e400d8b3360dadd275743` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:06.913689 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dc5b3-27a9-4b1b-8f27-0b2dd04826e1 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:06.913874 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbabf63-64cc-4b4b-a10a-788060d354d0 None admin] RBAC: Authorizing `identity:get_user(user_id=d15602a2085e400d8b3360dadd275743)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:06.913874 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbabf63-64cc-4b4b-a10a-788060d354d0 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:06.913874 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 131/260] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:35:06 2022] GET /identity/v3/users/d15602a2085e400d8b3360dadd275743 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:06.913874 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbabf63-64cc-4b4b-a10a-788060d354d0 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:07.011615 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dc5b3-27a9-4b1b-8f27-0b2dd04826e1 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:07.017405 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbabf63-64cc-4b4b-a10a-788060d354d0 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:07.046803 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2792e85-f407-401e-9529-0699e03e4bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:07.047468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2792e85-f407-401e-9529-0699e03e4bc1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:07.047972 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2792e85-f407-401e-9529-0699e03e4bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:07.048077 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2792e85-f407-401e-9529-0699e03e4bc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:07.048960 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2792e85-f407-401e-9529-0699e03e4bc1 None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=10c2fefd8bd2453d918573810f1d5ecb, user.id=d15602a2085e400d8b3360dadd275743) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:07.049994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2792e85-f407-401e-9529-0699e03e4bc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:07.051528 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2792e85-f407-401e-9529-0699e03e4bc1 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:07.054053 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b13fc5-b30f-4182-8a5d-254471b0ddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:07.055122 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b13fc5-b30f-4182-8a5d-254471b0ddfa None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:07.055579 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b13fc5-b30f-4182-8a5d-254471b0ddfa None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:07.056024 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b13fc5-b30f-4182-8a5d-254471b0ddfa None admin] PATH_INFO: `/v3/users/c1490bf7ca1e42779b2ded00a312a181` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:07.057420 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b13fc5-b30f-4182-8a5d-254471b0ddfa None admin] RBAC: Authorizing `identity:get_user(user_id=c1490bf7ca1e42779b2ded00a312a181)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:07.064079 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 130/261] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:35:06 2022] GET /identity/v3/role_assignments?user.id=d15602a2085e400d8b3360dadd275743&scope.project.id=10c2fefd8bd2453d918573810f1d5ecb&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:07.064079 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2792e85-f407-401e-9529-0699e03e4bc1 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:07.064314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b13fc5-b30f-4182-8a5d-254471b0ddfa None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:07.064314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 132/262] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:35:06 2022] GET /identity/v3/users/c1490bf7ca1e42779b2ded00a312a181 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:07.070115 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b13fc5-b30f-4182-8a5d-254471b0ddfa None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:07.248422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b13fc5-b30f-4182-8a5d-254471b0ddfa None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:07.285249 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2792e85-f407-401e-9529-0699e03e4bc1 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:07.288939 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc862752-e8ae-43ff-adfc-722ddea15be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:07.289838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc862752-e8ae-43ff-adfc-722ddea15be0 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:07.290345 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc862752-e8ae-43ff-adfc-722ddea15be0 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:07.290839 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc862752-e8ae-43ff-adfc-722ddea15be0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:07.322225 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43dec5-7ee5-4c11-b078-8d99a92e6ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:07.323084 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43dec5-7ee5-4c11-b078-8d99a92e6ca4 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:07.323357 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43dec5-7ee5-4c11-b078-8d99a92e6ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:07.323624 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43dec5-7ee5-4c11-b078-8d99a92e6ca4 None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:07.325125 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43dec5-7ee5-4c11-b078-8d99a92e6ca4 None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:07.326571 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43dec5-7ee5-4c11-b078-8d99a92e6ca4 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:07.328540 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 131/263] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:07 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:07.333317 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43dec5-7ee5-4c11-b078-8d99a92e6ca4 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:07.364419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc862752-e8ae-43ff-adfc-722ddea15be0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:07.366235 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc862752-e8ae-43ff-adfc-722ddea15be0 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:07.440633 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43dec5-7ee5-4c11-b078-8d99a92e6ca4 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:07.468846 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 133/264] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:07.470170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc862752-e8ae-43ff-adfc-722ddea15be0 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:07.476797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b8fc9-beda-41fb-970d-1d74b9b00070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:07.477712 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b8fc9-beda-41fb-970d-1d74b9b00070 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:07.477993 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b8fc9-beda-41fb-970d-1d74b9b00070 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:07.478264 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b8fc9-beda-41fb-970d-1d74b9b00070 None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:07.479449 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b8fc9-beda-41fb-970d-1d74b9b00070 None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:07.481243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b8fc9-beda-41fb-970d-1d74b9b00070 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:07.487336 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 132/265] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:07 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:07.487336 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b8fc9-beda-41fb-970d-1d74b9b00070 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:07.601565 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc862752-e8ae-43ff-adfc-722ddea15be0 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:07.628839 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b8fc9-beda-41fb-970d-1d74b9b00070 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:07.647108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2e8b5-10ae-405c-bf77-c0791989a8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:07.648259 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2e8b5-10ae-405c-bf77-c0791989a8ed None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:07.648779 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2e8b5-10ae-405c-bf77-c0791989a8ed None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:07.649254 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2e8b5-10ae-405c-bf77-c0791989a8ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:07.650390 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2e8b5-10ae-405c-bf77-c0791989a8ed None admin] RBAC: Adding query filter params (role.id=8301a1978ca14ba59f726e7b703fa445, scope.project.id=10c2fefd8bd2453d918573810f1d5ecb, user.id=579b183eaa274111b17fba27f5ca6f6f) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:07.650932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2e8b5-10ae-405c-bf77-c0791989a8ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:07.652570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2e8b5-10ae-405c-bf77-c0791989a8ed None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:07.661436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 134/266] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:35:07 2022] GET /identity/v3/role_assignments?user.id=579b183eaa274111b17fba27f5ca6f6f&scope.project.id=10c2fefd8bd2453d918573810f1d5ecb&role.id=8301a1978ca14ba59f726e7b703fa445 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:07.662602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2e8b5-10ae-405c-bf77-c0791989a8ed None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:07.680989 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282e5f5-9f12-47c7-af4d-cadeec64314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:07.681870 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282e5f5-9f12-47c7-af4d-cadeec64314c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:07.682143 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282e5f5-9f12-47c7-af4d-cadeec64314c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:07.682410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282e5f5-9f12-47c7-af4d-cadeec64314c None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:07.684301 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282e5f5-9f12-47c7-af4d-cadeec64314c None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:07.688200 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282e5f5-9f12-47c7-af4d-cadeec64314c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:07.688200 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 133/267] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:07 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:07.694973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282e5f5-9f12-47c7-af4d-cadeec64314c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:07.821919 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282e5f5-9f12-47c7-af4d-cadeec64314c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:07.869224 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b34c3f-2dfc-4f1c-b071-d48a61e05a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:07.869986 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b34c3f-2dfc-4f1c-b071-d48a61e05a84 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:07.870262 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b34c3f-2dfc-4f1c-b071-d48a61e05a84 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:07.870528 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b34c3f-2dfc-4f1c-b071-d48a61e05a84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:07.871366 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b34c3f-2dfc-4f1c-b071-d48a61e05a84 None admin] RBAC: Adding query filter params (role.id=c25cb9d119a74c7281a986fa76a92af6, scope.project.id=10c2fefd8bd2453d918573810f1d5ecb, user.id=d15602a2085e400d8b3360dadd275743) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:07.871673 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b34c3f-2dfc-4f1c-b071-d48a61e05a84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:07.872035 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2e8b5-10ae-405c-bf77-c0791989a8ed None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:07.873259 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b34c3f-2dfc-4f1c-b071-d48a61e05a84 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:07.885477 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 134/268] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:35:07 2022] GET /identity/v3/role_assignments?user.id=d15602a2085e400d8b3360dadd275743&scope.project.id=10c2fefd8bd2453d918573810f1d5ecb&role.id=c25cb9d119a74c7281a986fa76a92af6 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:07.910596 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3a8b6-5d0b-443d-9a6a-9ba1940cecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:07.911507 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3a8b6-5d0b-443d-9a6a-9ba1940cecd3 None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:07.911788 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3a8b6-5d0b-443d-9a6a-9ba1940cecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:07.912061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3a8b6-5d0b-443d-9a6a-9ba1940cecd3 None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb/users/c1490bf7ca1e42779b2ded00a312a181/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:07.914148 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3a8b6-5d0b-443d-9a6a-9ba1940cecd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=10c2fefd8bd2453d918573810f1d5ecb, user_id=c1490bf7ca1e42779b2ded00a312a181, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:07.915666 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3a8b6-5d0b-443d-9a6a-9ba1940cecd3 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:08.051250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 135/269] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:35:07 2022] PUT /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb/users/c1490bf7ca1e42779b2ded00a312a181/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:35:08.365096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d01cb-4cde-40a3-8145-6e2217e6de05 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:08.365421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d01cb-4cde-40a3-8145-6e2217e6de05 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:08.365660 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d01cb-4cde-40a3-8145-6e2217e6de05 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:08.367215 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 135/270] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:08.372900 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c93acb-9476-401b-abb9-11be346edf0c None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:08.373427 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c93acb-9476-401b-abb9-11be346edf0c None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:08.373891 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c93acb-9476-401b-abb9-11be346edf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:08.392337 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-c1c93acb-9476-401b-abb9-11be346edf0c None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:08.393946 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c1c93acb-9476-401b-abb9-11be346edf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:08.424943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561e4cd-9e5d-49db-91ad-98b7b7134c86 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:08.425246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561e4cd-9e5d-49db-91ad-98b7b7134c86 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:08.425501 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561e4cd-9e5d-49db-91ad-98b7b7134c86 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:08.426908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 136/271] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:35:08.432381 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f430cd-ce1a-4eb4-9739-ae2b75b8398c None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:08.432689 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f430cd-ce1a-4eb4-9739-ae2b75b8398c None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:08.432971 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f430cd-ce1a-4eb4-9739-ae2b75b8398c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:08.452607 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-13f430cd-ce1a-4eb4-9739-ae2b75b8398c None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:08.453800 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-13f430cd-ce1a-4eb4-9739-ae2b75b8398c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:08.466379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 136/272] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:08.492371 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c93acb-9476-401b-abb9-11be346edf0c None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:08.527285 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 137/273] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:35:08.553498 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f430cd-ce1a-4eb4-9739-ae2b75b8398c None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:08.629670 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c93acb-9476-401b-abb9-11be346edf0c None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:08.654982 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f430cd-ce1a-4eb4-9739-ae2b75b8398c None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:08.672934 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec31100-df50-411c-a19c-f9cda04dff69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:08.673727 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec31100-df50-411c-a19c-f9cda04dff69 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:08.674575 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec31100-df50-411c-a19c-f9cda04dff69 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:08.674871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec31100-df50-411c-a19c-f9cda04dff69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:08.685973 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec31100-df50-411c-a19c-f9cda04dff69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:08.690804 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c6acf-d6c4-45c2-8703-fcff6002a139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:08.691595 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c6acf-d6c4-45c2-8703-fcff6002a139 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:08.691871 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c6acf-d6c4-45c2-8703-fcff6002a139 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:08.692192 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c6acf-d6c4-45c2-8703-fcff6002a139 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:08.693455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-cec31100-df50-411c-a19c-f9cda04dff69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:35:08.693561 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c6acf-d6c4-45c2-8703-fcff6002a139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:08.695023 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c6acf-d6c4-45c2-8703-fcff6002a139 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:08.695141 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 137/274] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:08.701172 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 138/275] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:08.701991 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c6acf-d6c4-45c2-8703-fcff6002a139 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:08.702093 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec31100-df50-411c-a19c-f9cda04dff69 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:08.800803 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c6acf-d6c4-45c2-8703-fcff6002a139 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:08.803808 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec31100-df50-411c-a19c-f9cda04dff69 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:08.835531 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21093371-0fa2-4594-8569-b87c71fdfb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:08.836394 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21093371-0fa2-4594-8569-b87c71fdfb72 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:08.836966 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21093371-0fa2-4594-8569-b87c71fdfb72 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:08.837334 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21093371-0fa2-4594-8569-b87c71fdfb72 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:08.838084 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21093371-0fa2-4594-8569-b87c71fdfb72 None admin] RBAC: Adding query filter params (name=member) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:08.838384 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21093371-0fa2-4594-8569-b87c71fdfb72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:08.839139 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5da66d-fb93-4a0c-8e82-8745f876c429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:08.839851 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21093371-0fa2-4594-8569-b87c71fdfb72 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:08.840075 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5da66d-fb93-4a0c-8e82-8745f876c429 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:08.840456 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5da66d-fb93-4a0c-8e82-8745f876c429 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:08.840859 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5da66d-fb93-4a0c-8e82-8745f876c429 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:08.841691 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5da66d-fb93-4a0c-8e82-8745f876c429 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:08.843221 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5da66d-fb93-4a0c-8e82-8745f876c429 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:08.848463 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 139/276] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:08.854299 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21093371-0fa2-4594-8569-b87c71fdfb72 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:08.941571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 138/277] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:35:08 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:35:08.971813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21093371-0fa2-4594-8569-b87c71fdfb72 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:09.011448 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ae229-82eb-4d2e-be0b-f5808f4a7380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:09.012388 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ae229-82eb-4d2e-be0b-f5808f4a7380 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:09.012697 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ae229-82eb-4d2e-be0b-f5808f4a7380 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:09.012973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ae229-82eb-4d2e-be0b-f5808f4a7380 None admin] PATH_INFO: `/v3/users/36e1837e1d5a435488c4df4652140834` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:09.032644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ae229-82eb-4d2e-be0b-f5808f4a7380 None admin] RBAC: Authorizing `identity:get_user(user_id=36e1837e1d5a435488c4df4652140834)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:09.034769 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ae229-82eb-4d2e-be0b-f5808f4a7380 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:09.036703 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 140/278] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:35:08 2022] GET /identity/v3/users/36e1837e1d5a435488c4df4652140834 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:09.042607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5da66d-fb93-4a0c-8e82-8745f876c429 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:09.154613 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5da66d-fb93-4a0c-8e82-8745f876c429 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:09.191387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e75753-b9b9-4cd2-b7a6-cf1d5ff1ef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:09.192112 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e75753-b9b9-4cd2-b7a6-cf1d5ff1ef52 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:09.192335 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e75753-b9b9-4cd2-b7a6-cf1d5ff1ef52 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:09.192632 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e75753-b9b9-4cd2-b7a6-cf1d5ff1ef52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:09.193484 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e75753-b9b9-4cd2-b7a6-cf1d5ff1ef52 None admin] RBAC: Adding query filter params (role.id=4a3588df731c452fba80b071fc342f78, user.id=36e1837e1d5a435488c4df4652140834, scope.system=all) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:09.193785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e75753-b9b9-4cd2-b7a6-cf1d5ff1ef52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:09.195228 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e75753-b9b9-4cd2-b7a6-cf1d5ff1ef52 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:09.200469 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 139/279] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Apr 14 21:35:09 2022] GET /identity/v3/role_assignments?user.id=36e1837e1d5a435488c4df4652140834&scope.system=all&role.id=4a3588df731c452fba80b071fc342f78 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:10.378614 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a334ec5-a816-44e9-8c73-5cd39aa9b4d3 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:10.379663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a334ec5-a816-44e9-8c73-5cd39aa9b4d3 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:10.380157 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a334ec5-a816-44e9-8c73-5cd39aa9b4d3 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:10.381919 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 141/280] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:10.388163 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c39b5-375a-41d2-8bc2-93d4cc6a88e6 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:10.389077 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c39b5-375a-41d2-8bc2-93d4cc6a88e6 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:10.389500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c39b5-375a-41d2-8bc2-93d4cc6a88e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:10.413983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d03c39b5-375a-41d2-8bc2-93d4cc6a88e6 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:10.415452 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d03c39b5-375a-41d2-8bc2-93d4cc6a88e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:10.506088 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 140/281] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:10.542075 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a334ec5-a816-44e9-8c73-5cd39aa9b4d3 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:10.662277 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a334ec5-a816-44e9-8c73-5cd39aa9b4d3 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:10.709829 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10987da3-3592-4ba2-8d97-2ee5af836651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:10.710637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10987da3-3592-4ba2-8d97-2ee5af836651 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:10.710921 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10987da3-3592-4ba2-8d97-2ee5af836651 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:10.711196 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10987da3-3592-4ba2-8d97-2ee5af836651 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:10.722534 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10987da3-3592-4ba2-8d97-2ee5af836651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:10.729565 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-10987da3-3592-4ba2-8d97-2ee5af836651 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 14 21:35:10.735544 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 142/282] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:10.737184 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c39b5-375a-41d2-8bc2-93d4cc6a88e6 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:10.858966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c39b5-375a-41d2-8bc2-93d4cc6a88e6 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:10.875351 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad1cc9-f114-403e-906c-2cdbd74540b9 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:10.875636 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad1cc9-f114-403e-906c-2cdbd74540b9 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:10.875902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad1cc9-f114-403e-906c-2cdbd74540b9 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:10.877366 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 143/283] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:10.886782 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf53cc2-81f7-46ae-b375-354c0dd63247 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:10.887289 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf53cc2-81f7-46ae-b375-354c0dd63247 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:10.887732 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf53cc2-81f7-46ae-b375-354c0dd63247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:10.897986 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37807612-3757-4d54-9055-976b0a2d2956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:10.899484 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807612-3757-4d54-9055-976b0a2d2956 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:10.903870 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807612-3757-4d54-9055-976b0a2d2956 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:10.903870 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807612-3757-4d54-9055-976b0a2d2956 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:10.903870 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37807612-3757-4d54-9055-976b0a2d2956 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:10.903870 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37807612-3757-4d54-9055-976b0a2d2956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:10.903870 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37807612-3757-4d54-9055-976b0a2d2956 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:10.920761 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 141/284] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:10.921998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-bbf53cc2-81f7-46ae-b375-354c0dd63247 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:10.923378 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-bbf53cc2-81f7-46ae-b375-354c0dd63247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:10.949464 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37807612-3757-4d54-9055-976b0a2d2956 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:11.022968 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 144/285] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:11.047536 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf53cc2-81f7-46ae-b375-354c0dd63247 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:11.152325 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf53cc2-81f7-46ae-b375-354c0dd63247 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:11.198846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501aa360-8d77-45b3-94de-e136679b065f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:11.199602 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aa360-8d77-45b3-94de-e136679b065f None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:11.199881 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aa360-8d77-45b3-94de-e136679b065f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:11.200154 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aa360-8d77-45b3-94de-e136679b065f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:11.219094 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501aa360-8d77-45b3-94de-e136679b065f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:11.230802 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-501aa360-8d77-45b3-94de-e136679b065f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:35:11.232084 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 145/286] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:11.238230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501aa360-8d77-45b3-94de-e136679b065f None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:11.281934 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37807612-3757-4d54-9055-976b0a2d2956 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:11.333555 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0547d-164b-4ccd-9125-80cee0eb9f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:11.334428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0547d-164b-4ccd-9125-80cee0eb9f9a None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:11.334705 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0547d-164b-4ccd-9125-80cee0eb9f9a None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:11.334972 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0547d-164b-4ccd-9125-80cee0eb9f9a None admin] PATH_INFO: `/v3/users/579b183eaa274111b17fba27f5ca6f6f` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:11.336296 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0547d-164b-4ccd-9125-80cee0eb9f9a None admin] RBAC: Authorizing `identity:get_user(user_id=579b183eaa274111b17fba27f5ca6f6f)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:11.338052 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0547d-164b-4ccd-9125-80cee0eb9f9a None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:11.339990 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 142/287] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:35:10 2022] GET /identity/v3/users/579b183eaa274111b17fba27f5ca6f6f => generated 297 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:11.349718 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0547d-164b-4ccd-9125-80cee0eb9f9a None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:11.403840 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501aa360-8d77-45b3-94de-e136679b065f None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:11.442459 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b546bff-0c8b-45e1-90c5-c3f87d8fa801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:11.443500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b546bff-0c8b-45e1-90c5-c3f87d8fa801 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:11.443983 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b546bff-0c8b-45e1-90c5-c3f87d8fa801 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:11.444452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b546bff-0c8b-45e1-90c5-c3f87d8fa801 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:11.445621 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b546bff-0c8b-45e1-90c5-c3f87d8fa801 None admin] RBAC: Adding query filter params (name=member) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:11.446197 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b546bff-0c8b-45e1-90c5-c3f87d8fa801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:11.447845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b546bff-0c8b-45e1-90c5-c3f87d8fa801 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:11.458260 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 146/288] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:11.464684 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b546bff-0c8b-45e1-90c5-c3f87d8fa801 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:11.579530 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0547d-164b-4ccd-9125-80cee0eb9f9a None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:11.623045 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b546bff-0c8b-45e1-90c5-c3f87d8fa801 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:11.649336 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013aab07-252d-418b-ab2b-c2ea324c016e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:11.650215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013aab07-252d-418b-ab2b-c2ea324c016e None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:11.650498 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013aab07-252d-418b-ab2b-c2ea324c016e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:11.650772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013aab07-252d-418b-ab2b-c2ea324c016e None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:11.652024 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013aab07-252d-418b-ab2b-c2ea324c016e None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:11.653501 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013aab07-252d-418b-ab2b-c2ea324c016e None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:11.655582 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 143/289] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:11 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:11.661454 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013aab07-252d-418b-ab2b-c2ea324c016e None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:11.667971 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d3387-7c39-40df-8656-b328daea7d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:11.669302 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3387-7c39-40df-8656-b328daea7d4c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:11.669816 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3387-7c39-40df-8656-b328daea7d4c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:11.670283 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3387-7c39-40df-8656-b328daea7d4c None admin] PATH_INFO: `/v3/users/c1490bf7ca1e42779b2ded00a312a181` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:11.677706 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d3387-7c39-40df-8656-b328daea7d4c None admin] RBAC: Authorizing `identity:get_user(user_id=c1490bf7ca1e42779b2ded00a312a181)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:11.679568 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d3387-7c39-40df-8656-b328daea7d4c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:11.682089 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 147/290] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:35:11 2022] GET /identity/v3/users/c1490bf7ca1e42779b2ded00a312a181 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:11.687223 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d3387-7c39-40df-8656-b328daea7d4c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:11.810317 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013aab07-252d-418b-ab2b-c2ea324c016e None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:11.851067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa5b6d-b909-45bb-aeba-163f341764de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:11.851969 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa5b6d-b909-45bb-aeba-163f341764de None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:11.852250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa5b6d-b909-45bb-aeba-163f341764de None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:11.852525 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa5b6d-b909-45bb-aeba-163f341764de None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb/users/579b183eaa274111b17fba27f5ca6f6f/roles/8301a1978ca14ba59f726e7b703fa445` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:11.854603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa5b6d-b909-45bb-aeba-163f341764de None admin] RBAC: Authorizing `identity:create_grant(project_id=10c2fefd8bd2453d918573810f1d5ecb, user_id=579b183eaa274111b17fba27f5ca6f6f, role_id=8301a1978ca14ba59f726e7b703fa445)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:11.856052 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa5b6d-b909-45bb-aeba-163f341764de None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:11.865344 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d3387-7c39-40df-8656-b328daea7d4c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:11.898181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b0a95-c069-4d2f-b098-2a34c5843e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:11.898833 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b0a95-c069-4d2f-b098-2a34c5843e87 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:11.899116 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b0a95-c069-4d2f-b098-2a34c5843e87 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:11.899391 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b0a95-c069-4d2f-b098-2a34c5843e87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:11.931710 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 144/291] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:35:11 2022] PUT /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb/users/579b183eaa274111b17fba27f5ca6f6f/roles/8301a1978ca14ba59f726e7b703fa445 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:35:11.933956 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cff61-a74a-49b3-9081-92655c632530 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:11.934842 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cff61-a74a-49b3-9081-92655c632530 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:11.935600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cff61-a74a-49b3-9081-92655c632530 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:11.942629 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 145/292] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:11.944512 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a6d0f-24bc-4663-8db0-debf85fc2267 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:11.945101 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a6d0f-24bc-4663-8db0-debf85fc2267 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:11.945576 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a6d0f-24bc-4663-8db0-debf85fc2267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:11.986935 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-df9a6d0f-24bc-4663-8db0-debf85fc2267 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:11.988486 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-df9a6d0f-24bc-4663-8db0-debf85fc2267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:12.003444 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b0a95-c069-4d2f-b098-2a34c5843e87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:12.005240 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b0a95-c069-4d2f-b098-2a34c5843e87 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:12.067707 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 146/293] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:35:12.069458 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe30d1-9e35-46cf-a57d-9b7e7437e966 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:12.069980 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe30d1-9e35-46cf-a57d-9b7e7437e966 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:12.070419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe30d1-9e35-46cf-a57d-9b7e7437e966 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:12.072021 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 147/294] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:12.078364 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1b25-cdb3-44dd-8964-acf6b2045e38 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:12.078912 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1b25-cdb3-44dd-8964-acf6b2045e38 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:12.079811 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1b25-cdb3-44dd-8964-acf6b2045e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:12.101731 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-064f1b25-cdb3-44dd-8964-acf6b2045e38 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:12.103263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-064f1b25-cdb3-44dd-8964-acf6b2045e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:12.138346 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 148/295] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 14 21:35:12.139286 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b0a95-c069-4d2f-b098-2a34c5843e87 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:12.182948 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 148/296] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:12.184282 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae86ab-e5ea-485b-8c84-93d255f95d65 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:12.184563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae86ab-e5ea-485b-8c84-93d255f95d65 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:12.184871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae86ab-e5ea-485b-8c84-93d255f95d65 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:12.186118 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 149/297] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:12.186802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae86ab-e5ea-485b-8c84-93d255f95d65 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:12.256304 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b0a95-c069-4d2f-b098-2a34c5843e87 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:12.288707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cfdca-5ff8-4815-8f75-c94e6a8f3750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:12.289521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cfdca-5ff8-4815-8f75-c94e6a8f3750 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:12.289796 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cfdca-5ff8-4815-8f75-c94e6a8f3750 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:12.290065 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cfdca-5ff8-4815-8f75-c94e6a8f3750 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:12.290351 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae86ab-e5ea-485b-8c84-93d255f95d65 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:12.300737 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cfdca-5ff8-4815-8f75-c94e6a8f3750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:12.307948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-c91cfdca-5ff8-4815-8f75-c94e6a8f3750 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 14 21:35:12.309373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 149/298] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:12.314554 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d118-89c6-4151-9795-964f31a1e14c None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:12.315084 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d118-89c6-4151-9795-964f31a1e14c None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:12.315565 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d118-89c6-4151-9795-964f31a1e14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:12.323749 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035862e-d114-4c54-8112-d9233de6c0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:12.324537 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035862e-d114-4c54-8112-d9233de6c0f3 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:12.324841 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035862e-d114-4c54-8112-d9233de6c0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:12.325108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035862e-d114-4c54-8112-d9233de6c0f3 None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:12.326254 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035862e-d114-4c54-8112-d9233de6c0f3 None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:12.327681 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035862e-d114-4c54-8112-d9233de6c0f3 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:12.329399 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 150/299] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:12 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:12.330669 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035862e-d114-4c54-8112-d9233de6c0f3 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:12.335020 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-7b71d118-89c6-4151-9795-964f31a1e14c None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:12.336220 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-7b71d118-89c6-4151-9795-964f31a1e14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:12.401995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 150/300] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:12.403037 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71d118-89c6-4151-9795-964f31a1e14c None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:12.433552 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035862e-d114-4c54-8112-d9233de6c0f3 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:12.468413 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e9411-dd89-42b4-9712-09a93ec8a158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:12.469259 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e9411-dd89-42b4-9712-09a93ec8a158 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:12.469535 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e9411-dd89-42b4-9712-09a93ec8a158 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:12.469807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e9411-dd89-42b4-9712-09a93ec8a158 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:12.471138 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e9411-dd89-42b4-9712-09a93ec8a158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:12.472566 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e9411-dd89-42b4-9712-09a93ec8a158 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:12.478868 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 151/301] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:12.478868 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e9411-dd89-42b4-9712-09a93ec8a158 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:12.504727 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71d118-89c6-4151-9795-964f31a1e14c None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:12.538207 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9347c1-7d81-499a-ae8d-62bf47725e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:12.538975 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9347c1-7d81-499a-ae8d-62bf47725e0f None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:12.539269 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9347c1-7d81-499a-ae8d-62bf47725e0f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:12.539669 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9347c1-7d81-499a-ae8d-62bf47725e0f None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:12.540412 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9347c1-7d81-499a-ae8d-62bf47725e0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:12.540755 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9347c1-7d81-499a-ae8d-62bf47725e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:12.542121 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9347c1-7d81-499a-ae8d-62bf47725e0f None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:12.550956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 151/302] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:12.551731 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9347c1-7d81-499a-ae8d-62bf47725e0f None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:12.578309 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e9411-dd89-42b4-9712-09a93ec8a158 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:12.613889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d6c4d-c14e-4496-ab2f-455c7fcef869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:12.614656 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d6c4d-c14e-4496-ab2f-455c7fcef869 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:12.614887 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d6c4d-c14e-4496-ab2f-455c7fcef869 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:12.615168 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d6c4d-c14e-4496-ab2f-455c7fcef869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:12.616055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d6c4d-c14e-4496-ab2f-455c7fcef869 None admin] RBAC: Adding query filter params (role.id=4a3588df731c452fba80b071fc342f78, scope.project.id=10c2fefd8bd2453d918573810f1d5ecb, user.id=c1490bf7ca1e42779b2ded00a312a181) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:12.616366 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d6c4d-c14e-4496-ab2f-455c7fcef869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:12.617886 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d6c4d-c14e-4496-ab2f-455c7fcef869 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:12.623699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 152/303] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:35:12 2022] GET /identity/v3/role_assignments?user.id=c1490bf7ca1e42779b2ded00a312a181&scope.project.id=10c2fefd8bd2453d918573810f1d5ecb&role.id=4a3588df731c452fba80b071fc342f78 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:12.624473 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d6c4d-c14e-4496-ab2f-455c7fcef869 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:12.667464 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9347c1-7d81-499a-ae8d-62bf47725e0f None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:12.718311 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b36272-7258-4ea0-9568-f5f6d9323f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:12.719478 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b36272-7258-4ea0-9568-f5f6d9323f69 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:12.719866 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b36272-7258-4ea0-9568-f5f6d9323f69 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:12.721145 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b36272-7258-4ea0-9568-f5f6d9323f69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:12.737168 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b36272-7258-4ea0-9568-f5f6d9323f69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:12.738184 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d6c4d-c14e-4496-ab2f-455c7fcef869 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:12.745978 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-55b36272-7258-4ea0-9568-f5f6d9323f69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:35:12.748208 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 152/304] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:12.748975 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b36272-7258-4ea0-9568-f5f6d9323f69 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:12.775955 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcfd28-8e15-4d67-bda1-ce4a22fe65c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:12.776938 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcfd28-8e15-4d67-bda1-ce4a22fe65c9 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:12.777364 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcfd28-8e15-4d67-bda1-ce4a22fe65c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:12.777802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcfd28-8e15-4d67-bda1-ce4a22fe65c9 None admin] PATH_INFO: `/v3/groups` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:12.778690 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcfd28-8e15-4d67-bda1-ce4a22fe65c9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:12.780428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcfd28-8e15-4d67-bda1-ce4a22fe65c9 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:12.865128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 153/305] 10.222.0.52 () {60 vars in 1134 bytes} [Thu Apr 14 21:35:12 2022] POST /identity/v3/groups => generated 229 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:35:12.866322 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcfd28-8e15-4d67-bda1-ce4a22fe65c9 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:12.868932 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b36272-7258-4ea0-9568-f5f6d9323f69 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:12.911639 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85054d-fc88-4f9d-9374-84412f156080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:12.912288 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85054d-fc88-4f9d-9374-84412f156080 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:12.912598 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85054d-fc88-4f9d-9374-84412f156080 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:12.912880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85054d-fc88-4f9d-9374-84412f156080 None admin] PATH_INFO: `/v3/users/671719728a5d4b94b56e5436938b5f90` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:12.931189 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85054d-fc88-4f9d-9374-84412f156080 None admin] RBAC: Authorizing `identity:get_user(user_id=671719728a5d4b94b56e5436938b5f90)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:12.932796 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85054d-fc88-4f9d-9374-84412f156080 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:12.935116 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 153/306] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:35:12 2022] GET /identity/v3/users/671719728a5d4b94b56e5436938b5f90 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:12.940711 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85054d-fc88-4f9d-9374-84412f156080 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:13.012718 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcfd28-8e15-4d67-bda1-ce4a22fe65c9 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:13.051618 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b5be7-d4e6-419e-bfb8-59551d03d741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:13.052304 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b5be7-d4e6-419e-bfb8-59551d03d741 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:13.052616 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b5be7-d4e6-419e-bfb8-59551d03d741 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:13.052887 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b5be7-d4e6-419e-bfb8-59551d03d741 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:13.053653 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b5be7-d4e6-419e-bfb8-59551d03d741 None admin] RBAC: Adding query filter params (name=member) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:13.054067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b5be7-d4e6-419e-bfb8-59551d03d741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:13.054760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85054d-fc88-4f9d-9374-84412f156080 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:13.055470 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b5be7-d4e6-419e-bfb8-59551d03d741 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:13.065250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 154/307] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:13.074863 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b5be7-d4e6-419e-bfb8-59551d03d741 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:13.102087 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c606d-0034-4382-b402-04463fcb18cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:13.102950 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c606d-0034-4382-b402-04463fcb18cd None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:13.103058 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c606d-0034-4382-b402-04463fcb18cd None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:13.103331 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c606d-0034-4382-b402-04463fcb18cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:13.104180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c606d-0034-4382-b402-04463fcb18cd None admin] RBAC: Adding query filter params (role.id=8301a1978ca14ba59f726e7b703fa445, user.id=671719728a5d4b94b56e5436938b5f90, scope.system=all) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:13.104494 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c606d-0034-4382-b402-04463fcb18cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:13.106070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c606d-0034-4382-b402-04463fcb18cd None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:13.112762 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 154/308] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Apr 14 21:35:12 2022] GET /identity/v3/role_assignments?user.id=671719728a5d4b94b56e5436938b5f90&scope.system=all&role.id=8301a1978ca14ba59f726e7b703fa445 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:13.209287 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b5be7-d4e6-419e-bfb8-59551d03d741 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:13.247025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f0305-3859-4f96-bbd9-fa1f545d96c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:13.247914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f0305-3859-4f96-bbd9-fa1f545d96c7 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:13.248198 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f0305-3859-4f96-bbd9-fa1f545d96c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:13.248474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f0305-3859-4f96-bbd9-fa1f545d96c7 None admin] PATH_INFO: `/v3/users/36e1837e1d5a435488c4df4652140834` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:13.249757 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f0305-3859-4f96-bbd9-fa1f545d96c7 None admin] RBAC: Authorizing `identity:get_user(user_id=36e1837e1d5a435488c4df4652140834)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:13.251336 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f0305-3859-4f96-bbd9-fa1f545d96c7 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:13.258051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 155/309] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:35:13 2022] GET /identity/v3/users/36e1837e1d5a435488c4df4652140834 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:13.259528 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c606d-0034-4382-b402-04463fcb18cd None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:13.363919 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c606d-0034-4382-b402-04463fcb18cd None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:13.398149 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815dcb4-97a2-43a4-9c84-77c05309b12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:13.399012 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815dcb4-97a2-43a4-9c84-77c05309b12a None admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:13.399296 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815dcb4-97a2-43a4-9c84-77c05309b12a None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:13.399573 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815dcb4-97a2-43a4-9c84-77c05309b12a None admin] PATH_INFO: `/v3/system/users/36e1837e1d5a435488c4df4652140834/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:13.401193 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815dcb4-97a2-43a4-9c84-77c05309b12a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=36e1837e1d5a435488c4df4652140834, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:13.402585 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815dcb4-97a2-43a4-9c84-77c05309b12a None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:13.503658 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 155/310] 10.222.0.52 () {58 vars in 1334 bytes} [Thu Apr 14 21:35:13 2022] PUT /identity/v3/system/users/36e1837e1d5a435488c4df4652140834/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:35:14.329440 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47b803-7932-416c-a032-9b894cf7d221 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:14.330005 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47b803-7932-416c-a032-9b894cf7d221 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:14.330109 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47b803-7932-416c-a032-9b894cf7d221 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:14.331881 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 156/311] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:14.337725 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01382b5f-8d68-4347-9c1f-6be48969e3ae None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:14.338518 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01382b5f-8d68-4347-9c1f-6be48969e3ae None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:14.338942 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01382b5f-8d68-4347-9c1f-6be48969e3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:14.356971 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-01382b5f-8d68-4347-9c1f-6be48969e3ae None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:14.358357 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-01382b5f-8d68-4347-9c1f-6be48969e3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:14.424661 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 156/312] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:35:14.449433 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47b803-7932-416c-a032-9b894cf7d221 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:14.553067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47b803-7932-416c-a032-9b894cf7d221 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:14.588317 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3d7d9-4336-463e-8eb8-c3a0bb94c24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:14.589147 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3d7d9-4336-463e-8eb8-c3a0bb94c24d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:14.589425 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3d7d9-4336-463e-8eb8-c3a0bb94c24d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:14.589696 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3d7d9-4336-463e-8eb8-c3a0bb94c24d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:14.600809 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3d7d9-4336-463e-8eb8-c3a0bb94c24d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:14.607785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-55e3d7d9-4336-463e-8eb8-c3a0bb94c24d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 14 21:35:14.609030 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 157/313] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:14.615554 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01382b5f-8d68-4347-9c1f-6be48969e3ae None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:14.718015 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01382b5f-8d68-4347-9c1f-6be48969e3ae None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:14.752658 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3769857-ba58-4ea5-b9da-edd4f5d1849e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:14.753340 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3769857-ba58-4ea5-b9da-edd4f5d1849e None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:14.753620 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3769857-ba58-4ea5-b9da-edd4f5d1849e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:14.753897 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3769857-ba58-4ea5-b9da-edd4f5d1849e None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:14.754649 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3769857-ba58-4ea5-b9da-edd4f5d1849e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:14.754956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3769857-ba58-4ea5-b9da-edd4f5d1849e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:14.756335 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3769857-ba58-4ea5-b9da-edd4f5d1849e None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:14.765240 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 157/314] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:14.771448 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3d7d9-4336-463e-8eb8-c3a0bb94c24d None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:14.873468 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3d7d9-4336-463e-8eb8-c3a0bb94c24d None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:14.909422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a4d34-f775-41b9-8c2d-13c22278edbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:14.910303 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a4d34-f775-41b9-8c2d-13c22278edbf None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:14.910580 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a4d34-f775-41b9-8c2d-13c22278edbf None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:14.918548 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a4d34-f775-41b9-8c2d-13c22278edbf None admin] PATH_INFO: `/v3/users/579b183eaa274111b17fba27f5ca6f6f` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:14.918548 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a4d34-f775-41b9-8c2d-13c22278edbf None admin] RBAC: Authorizing `identity:get_user(user_id=579b183eaa274111b17fba27f5ca6f6f)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:14.918548 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a4d34-f775-41b9-8c2d-13c22278edbf None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:14.918548 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 158/315] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:35:14 2022] GET /identity/v3/users/579b183eaa274111b17fba27f5ca6f6f => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:14.920906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3769857-ba58-4ea5-b9da-edd4f5d1849e None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:15.029865 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3769857-ba58-4ea5-b9da-edd4f5d1849e None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:15.063264 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3013c6-5e34-4ded-85f8-ad865a295cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:15.064020 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3013c6-5e34-4ded-85f8-ad865a295cf7 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:15.064985 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3013c6-5e34-4ded-85f8-ad865a295cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:15.065267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3013c6-5e34-4ded-85f8-ad865a295cf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:15.138228 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3013c6-5e34-4ded-85f8-ad865a295cf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:15.139616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3013c6-5e34-4ded-85f8-ad865a295cf7 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:15.240902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 158/316] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:15.246591 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a4d34-f775-41b9-8c2d-13c22278edbf None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:15.336210 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc18071-9f75-4fd5-a26c-6735f3baa65b None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:15.336767 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc18071-9f75-4fd5-a26c-6735f3baa65b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:15.337252 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc18071-9f75-4fd5-a26c-6735f3baa65b None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:15.339081 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 159/317] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:15.345234 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f74569-eb0e-49a9-80d9-26d2348dce7b None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:15.345819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f74569-eb0e-49a9-80d9-26d2348dce7b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:15.346412 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f74569-eb0e-49a9-80d9-26d2348dce7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:15.353082 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a4d34-f775-41b9-8c2d-13c22278edbf None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:15.364491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-49f74569-eb0e-49a9-80d9-26d2348dce7b None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:15.365992 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-49f74569-eb0e-49a9-80d9-26d2348dce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:15.387813 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d9574-0c94-48eb-bd54-8bc9e93fd520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:15.388761 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9574-0c94-48eb-bd54-8bc9e93fd520 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:15.389200 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9574-0c94-48eb-bd54-8bc9e93fd520 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:15.389615 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9574-0c94-48eb-bd54-8bc9e93fd520 None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:15.391384 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d9574-0c94-48eb-bd54-8bc9e93fd520 None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:15.393430 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d9574-0c94-48eb-bd54-8bc9e93fd520 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:15.395595 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 159/318] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:15 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:15.401502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d9574-0c94-48eb-bd54-8bc9e93fd520 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:15.444709 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 160/319] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:35:15.463569 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448739a-60fa-4e09-beff-7bf648ebbe18 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:15.463822 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448739a-60fa-4e09-beff-7bf648ebbe18 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:15.464296 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448739a-60fa-4e09-beff-7bf648ebbe18 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:15.465686 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 161/320] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:35:15.466507 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448739a-60fa-4e09-beff-7bf648ebbe18 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:15.510030 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d9574-0c94-48eb-bd54-8bc9e93fd520 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:15.549241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943214b4-82a9-464d-a3b8-f59a1468ef58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:15.549906 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943214b4-82a9-464d-a3b8-f59a1468ef58 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:15.550180 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943214b4-82a9-464d-a3b8-f59a1468ef58 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:15.550452 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943214b4-82a9-464d-a3b8-f59a1468ef58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:15.551316 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943214b4-82a9-464d-a3b8-f59a1468ef58 None admin] RBAC: Adding query filter params (role.id=8301a1978ca14ba59f726e7b703fa445, scope.project.id=10c2fefd8bd2453d918573810f1d5ecb, user.id=579b183eaa274111b17fba27f5ca6f6f) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:15.551628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943214b4-82a9-464d-a3b8-f59a1468ef58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:15.553124 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943214b4-82a9-464d-a3b8-f59a1468ef58 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:15.568607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 160/321] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:35:15 2022] GET /identity/v3/role_assignments?user.id=579b183eaa274111b17fba27f5ca6f6f&scope.project.id=10c2fefd8bd2453d918573810f1d5ecb&role.id=8301a1978ca14ba59f726e7b703fa445 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:15.568607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fde0fc-547d-43c2-b0d8-1d3f3adcf022 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:15.568607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fde0fc-547d-43c2-b0d8-1d3f3adcf022 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:15.568607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fde0fc-547d-43c2-b0d8-1d3f3adcf022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:15.571215 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448739a-60fa-4e09-beff-7bf648ebbe18 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:15.586218 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-a0fde0fc-547d-43c2-b0d8-1d3f3adcf022 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:15.587881 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a0fde0fc-547d-43c2-b0d8-1d3f3adcf022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:15.609069 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60348d2d-90ed-4a08-a3bf-bfb337c315da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:15.609878 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60348d2d-90ed-4a08-a3bf-bfb337c315da None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:15.610158 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60348d2d-90ed-4a08-a3bf-bfb337c315da None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:15.610435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60348d2d-90ed-4a08-a3bf-bfb337c315da None admin] PATH_INFO: `/v3/domains/default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:15.612188 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60348d2d-90ed-4a08-a3bf-bfb337c315da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:15.613811 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60348d2d-90ed-4a08-a3bf-bfb337c315da None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:15.615490 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 162/322] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:15.621071 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60348d2d-90ed-4a08-a3bf-bfb337c315da None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:15.663895 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 161/323] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:15.687392 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fde0fc-547d-43c2-b0d8-1d3f3adcf022 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:15.728172 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60348d2d-90ed-4a08-a3bf-bfb337c315da None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:15.766055 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55980349-e9b2-4b6c-8679-649b187053c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:15.766738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55980349-e9b2-4b6c-8679-649b187053c2 None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:15.767022 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55980349-e9b2-4b6c-8679-649b187053c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:15.768190 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55980349-e9b2-4b6c-8679-649b187053c2 None admin] PATH_INFO: `/v3/groups` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:15.768845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55980349-e9b2-4b6c-8679-649b187053c2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:15.770716 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55980349-e9b2-4b6c-8679-649b187053c2 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:15.799904 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fde0fc-547d-43c2-b0d8-1d3f3adcf022 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:15.838157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430bfb0-c257-4efd-a136-5f56311ce013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:15.838967 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430bfb0-c257-4efd-a136-5f56311ce013 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:15.839246 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430bfb0-c257-4efd-a136-5f56311ce013 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:15.839520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430bfb0-c257-4efd-a136-5f56311ce013 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:15.852979 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430bfb0-c257-4efd-a136-5f56311ce013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:15.860028 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-d430bfb0-c257-4efd-a136-5f56311ce013 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 14 21:35:15.862616 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 162/324] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:15.868217 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430bfb0-c257-4efd-a136-5f56311ce013 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:15.878792 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 163/325] 10.222.0.52 () {60 vars in 1134 bytes} [Thu Apr 14 21:35:15 2022] POST /identity/v3/groups => generated 226 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:35:15.880186 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ba0d4-8a20-4fd9-8ff9-2f50f0d88e23 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:15.880472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ba0d4-8a20-4fd9-8ff9-2f50f0d88e23 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:15.880777 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ba0d4-8a20-4fd9-8ff9-2f50f0d88e23 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:15.882166 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 164/326] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:15.890305 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da437bfd-afc1-4783-954c-40a357a764aa None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:15.890640 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da437bfd-afc1-4783-954c-40a357a764aa None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:15.890915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da437bfd-afc1-4783-954c-40a357a764aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:15.910680 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-da437bfd-afc1-4783-954c-40a357a764aa None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:15.911917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-da437bfd-afc1-4783-954c-40a357a764aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:15.982135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430bfb0-c257-4efd-a136-5f56311ce013 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:15.988743 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 165/327] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:35:16.015979 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da437bfd-afc1-4783-954c-40a357a764aa None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:16.022348 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5764f0c-1c41-49ef-8cba-d60a2a976c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:16.023013 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5764f0c-1c41-49ef-8cba-d60a2a976c0d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:16.023291 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5764f0c-1c41-49ef-8cba-d60a2a976c0d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:16.023560 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5764f0c-1c41-49ef-8cba-d60a2a976c0d None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:16.024327 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5764f0c-1c41-49ef-8cba-d60a2a976c0d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:16.024662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5764f0c-1c41-49ef-8cba-d60a2a976c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:16.026074 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5764f0c-1c41-49ef-8cba-d60a2a976c0d None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:16.036623 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 163/328] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:16.043414 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5764f0c-1c41-49ef-8cba-d60a2a976c0d None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:16.128445 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da437bfd-afc1-4783-954c-40a357a764aa None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:16.154033 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5764f0c-1c41-49ef-8cba-d60a2a976c0d None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:16.167168 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1565bd9-34a1-420d-bbd6-3709f110022e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:16.167981 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1565bd9-34a1-420d-bbd6-3709f110022e None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:16.168260 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1565bd9-34a1-420d-bbd6-3709f110022e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:16.168530 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1565bd9-34a1-420d-bbd6-3709f110022e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:16.180230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1565bd9-34a1-420d-bbd6-3709f110022e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:16.187471 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-f1565bd9-34a1-420d-bbd6-3709f110022e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:35:16.189097 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 166/329] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:16.195560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1565bd9-34a1-420d-bbd6-3709f110022e None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:16.198865 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55cc3c-f96c-40c0-8632-a53b8fd955a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:16.200094 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55cc3c-f96c-40c0-8632-a53b8fd955a5 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:16.200094 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55cc3c-f96c-40c0-8632-a53b8fd955a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:16.200291 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55cc3c-f96c-40c0-8632-a53b8fd955a5 None admin] PATH_INFO: `/v3/users/671719728a5d4b94b56e5436938b5f90` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:16.201599 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55cc3c-f96c-40c0-8632-a53b8fd955a5 None admin] RBAC: Authorizing `identity:get_user(user_id=671719728a5d4b94b56e5436938b5f90)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:16.203047 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55cc3c-f96c-40c0-8632-a53b8fd955a5 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:16.205344 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 164/330] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:35:16 2022] GET /identity/v3/users/671719728a5d4b94b56e5436938b5f90 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:16.211176 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55cc3c-f96c-40c0-8632-a53b8fd955a5 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:16.301680 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1565bd9-34a1-420d-bbd6-3709f110022e None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:16.323098 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55cc3c-f96c-40c0-8632-a53b8fd955a5 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:16.339710 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5005c-ef99-4a57-a5bf-6bb10735c5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:16.340383 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5005c-ef99-4a57-a5bf-6bb10735c5b3 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:16.340832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5005c-ef99-4a57-a5bf-6bb10735c5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:16.341107 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5005c-ef99-4a57-a5bf-6bb10735c5b3 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:16.341864 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5005c-ef99-4a57-a5bf-6bb10735c5b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:16.342171 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5005c-ef99-4a57-a5bf-6bb10735c5b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:16.343560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5005c-ef99-4a57-a5bf-6bb10735c5b3 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:16.354035 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 167/331] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:16.359433 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5005c-ef99-4a57-a5bf-6bb10735c5b3 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:16.359586 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca370fb4-f920-4609-b0a4-a8302122646d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:16.360280 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca370fb4-f920-4609-b0a4-a8302122646d None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:16.360563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca370fb4-f920-4609-b0a4-a8302122646d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:16.360957 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca370fb4-f920-4609-b0a4-a8302122646d None admin] PATH_INFO: `/v3/system/users/671719728a5d4b94b56e5436938b5f90/roles/8301a1978ca14ba59f726e7b703fa445` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:16.362523 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca370fb4-f920-4609-b0a4-a8302122646d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=671719728a5d4b94b56e5436938b5f90, role_id=8301a1978ca14ba59f726e7b703fa445)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:16.363961 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca370fb4-f920-4609-b0a4-a8302122646d None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:16.456413 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 165/332] 10.222.0.52 () {58 vars in 1334 bytes} [Thu Apr 14 21:35:16 2022] PUT /identity/v3/system/users/671719728a5d4b94b56e5436938b5f90/roles/8301a1978ca14ba59f726e7b703fa445 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:35:16.462632 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5005c-ef99-4a57-a5bf-6bb10735c5b3 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:16.501010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5006a-1039-449e-9dcd-8c4bdf339dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:16.502485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5006a-1039-449e-9dcd-8c4bdf339dbd None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:16.502769 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5006a-1039-449e-9dcd-8c4bdf339dbd None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:16.503075 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5006a-1039-449e-9dcd-8c4bdf339dbd None admin] PATH_INFO: `/v3/users/36e1837e1d5a435488c4df4652140834` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:16.504426 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5006a-1039-449e-9dcd-8c4bdf339dbd None admin] RBAC: Authorizing `identity:get_user(user_id=36e1837e1d5a435488c4df4652140834)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:16.505943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5006a-1039-449e-9dcd-8c4bdf339dbd None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:16.507994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 168/333] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:35:16 2022] GET /identity/v3/users/36e1837e1d5a435488c4df4652140834 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:16.517810 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca370fb4-f920-4609-b0a4-a8302122646d None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:16.643158 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca370fb4-f920-4609-b0a4-a8302122646d None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:16.679559 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15069393-6526-40e6-adcc-1759fa7a50f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:16.680220 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15069393-6526-40e6-adcc-1759fa7a50f7 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:16.680494 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15069393-6526-40e6-adcc-1759fa7a50f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:16.680788 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15069393-6526-40e6-adcc-1759fa7a50f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:16.681622 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15069393-6526-40e6-adcc-1759fa7a50f7 None admin] RBAC: Adding query filter params (role.id=4a3588df731c452fba80b071fc342f78, user.id=36e1837e1d5a435488c4df4652140834, scope.system=all) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:16.681930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15069393-6526-40e6-adcc-1759fa7a50f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:16.683355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15069393-6526-40e6-adcc-1759fa7a50f7 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:16.696303 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 166/334] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Apr 14 21:35:16 2022] GET /identity/v3/role_assignments?user.id=36e1837e1d5a435488c4df4652140834&scope.system=all&role.id=4a3588df731c452fba80b071fc342f78 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:18.692812 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320cb09-eb6a-4b01-b1c8-7a571251aa63 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:18.693358 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320cb09-eb6a-4b01-b1c8-7a571251aa63 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:18.693358 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320cb09-eb6a-4b01-b1c8-7a571251aa63 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:18.695081 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 169/335] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:18.700515 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9bc3b-4da6-4f36-8306-3a1442ae6d92 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:18.700947 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9bc3b-4da6-4f36-8306-3a1442ae6d92 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:18.701121 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9bc3b-4da6-4f36-8306-3a1442ae6d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:18.725660 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-4dc9bc3b-4da6-4f36-8306-3a1442ae6d92 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:18.726862 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-4dc9bc3b-4da6-4f36-8306-3a1442ae6d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:18.815506 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 167/336] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:35:18.852535 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320cb09-eb6a-4b01-b1c8-7a571251aa63 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:18.868668 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7709fc-44df-476b-bd8d-180266e97830 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:18.868880 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7709fc-44df-476b-bd8d-180266e97830 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:18.869154 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7709fc-44df-476b-bd8d-180266e97830 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:18.870787 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 168/337] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:18.875475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b216d-9e32-405e-9fd7-e64d46ccbce0 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:18.875754 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b216d-9e32-405e-9fd7-e64d46ccbce0 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:18.876029 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b216d-9e32-405e-9fd7-e64d46ccbce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:18.901728 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-875b216d-9e32-405e-9fd7-e64d46ccbce0 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:18.916748 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-875b216d-9e32-405e-9fd7-e64d46ccbce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:19.001295 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320cb09-eb6a-4b01-b1c8-7a571251aa63 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:19.006751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 169/338] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:35:19.049961 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b216d-9e32-405e-9fd7-e64d46ccbce0 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:19.051890 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011990e-3c72-4ce6-8aeb-3629720946b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:19.052744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011990e-3c72-4ce6-8aeb-3629720946b2 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:19.053027 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011990e-3c72-4ce6-8aeb-3629720946b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:19.053303 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011990e-3c72-4ce6-8aeb-3629720946b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:19.070228 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011990e-3c72-4ce6-8aeb-3629720946b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:19.077833 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-6011990e-3c72-4ce6-8aeb-3629720946b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 14 21:35:19.079392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 170/339] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:35:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:19.093879 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011990e-3c72-4ce6-8aeb-3629720946b2 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:19.217105 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011990e-3c72-4ce6-8aeb-3629720946b2 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:19.230878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b216d-9e32-405e-9fd7-e64d46ccbce0 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:19.258896 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bbc40-3533-40e9-b294-d50403dfc1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:19.259683 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bbc40-3533-40e9-b294-d50403dfc1d2 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:19.259973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bbc40-3533-40e9-b294-d50403dfc1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:19.260251 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bbc40-3533-40e9-b294-d50403dfc1d2 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:19.261046 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bbc40-3533-40e9-b294-d50403dfc1d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:19.261356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bbc40-3533-40e9-b294-d50403dfc1d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:19.262754 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bbc40-3533-40e9-b294-d50403dfc1d2 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:19.277501 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 171/340] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:19.284505 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bbc40-3533-40e9-b294-d50403dfc1d2 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:19.341918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76086abd-b16a-42ce-97ca-8f8484ef0638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:19.342734 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76086abd-b16a-42ce-97ca-8f8484ef0638 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:19.343011 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76086abd-b16a-42ce-97ca-8f8484ef0638 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:19.348598 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76086abd-b16a-42ce-97ca-8f8484ef0638 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:19.393521 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76086abd-b16a-42ce-97ca-8f8484ef0638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:19.396925 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bbc40-3533-40e9-b294-d50403dfc1d2 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:19.400630 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-76086abd-b16a-42ce-97ca-8f8484ef0638 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:35:19.402227 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 170/341] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:19.409338 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76086abd-b16a-42ce-97ca-8f8484ef0638 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:19.435134 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9a007-f695-4664-9ea8-9627ceef46cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:19.435800 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9a007-f695-4664-9ea8-9627ceef46cc None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:19.436078 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9a007-f695-4664-9ea8-9627ceef46cc None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:19.436352 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9a007-f695-4664-9ea8-9627ceef46cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:19.588413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9a007-f695-4664-9ea8-9627ceef46cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:19.589929 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9a007-f695-4664-9ea8-9627ceef46cc None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:19.621577 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76086abd-b16a-42ce-97ca-8f8484ef0638 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:19.687710 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a6b76-1135-4434-8319-09e7a427759c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:19.688387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a6b76-1135-4434-8319-09e7a427759c None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:19.688726 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a6b76-1135-4434-8319-09e7a427759c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:19.689056 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a6b76-1135-4434-8319-09e7a427759c None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:19.689822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a6b76-1135-4434-8319-09e7a427759c None admin] RBAC: Adding query filter params (name=member) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:19.690126 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a6b76-1135-4434-8319-09e7a427759c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:19.691500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a6b76-1135-4434-8319-09e7a427759c None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:19.709019 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 171/342] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:19.710004 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a6b76-1135-4434-8319-09e7a427759c None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:19.772954 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 172/343] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:19.777984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9a007-f695-4664-9ea8-9627ceef46cc None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:19.833561 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a6b76-1135-4434-8319-09e7a427759c None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:19.877477 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072284c-f470-4aa0-a394-652e8af74668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:19.878067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072284c-f470-4aa0-a394-652e8af74668 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:19.878348 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072284c-f470-4aa0-a394-652e8af74668 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:19.878614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072284c-f470-4aa0-a394-652e8af74668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:19.903288 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9a007-f695-4664-9ea8-9627ceef46cc None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:19.941491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c3108-53a1-4ffa-87f4-a2a47345a479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:19.942359 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c3108-53a1-4ffa-87f4-a2a47345a479 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:19.942637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c3108-53a1-4ffa-87f4-a2a47345a479 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:19.942911 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c3108-53a1-4ffa-87f4-a2a47345a479 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:19.944214 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c3108-53a1-4ffa-87f4-a2a47345a479 None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:19.945713 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c3108-53a1-4ffa-87f4-a2a47345a479 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:19.947724 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 173/344] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:19 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:19.948951 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e9480-ca42-4e66-834e-f1089bd6b31a None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:19.949231 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e9480-ca42-4e66-834e-f1089bd6b31a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:19.949503 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e9480-ca42-4e66-834e-f1089bd6b31a None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:19.950853 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 174/345] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:19.954131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072284c-f470-4aa0-a394-652e8af74668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:19.955783 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072284c-f470-4aa0-a394-652e8af74668 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:19.956961 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e9480-ca42-4e66-834e-f1089bd6b31a None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:20.058717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 172/346] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:20.065329 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fd671-5c28-4bde-b129-bb0576ff9548 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:20.065609 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fd671-5c28-4bde-b129-bb0576ff9548 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:20.066126 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fd671-5c28-4bde-b129-bb0576ff9548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:20.066237 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e9480-ca42-4e66-834e-f1089bd6b31a None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:20.085967 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-104fd671-5c28-4bde-b129-bb0576ff9548 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:20.087766 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-104fd671-5c28-4bde-b129-bb0576ff9548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:20.101680 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679993bd-6982-4391-a2ac-68c26fe380e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:20.102832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679993bd-6982-4391-a2ac-68c26fe380e8 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:20.103257 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679993bd-6982-4391-a2ac-68c26fe380e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:20.103755 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679993bd-6982-4391-a2ac-68c26fe380e8 None admin] PATH_INFO: `/v3/groups/6328aaa5c36642c48b34837f640c94da` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:20.110464 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679993bd-6982-4391-a2ac-68c26fe380e8 None admin] RBAC: Authorizing `identity:get_group(group_id=6328aaa5c36642c48b34837f640c94da)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:20.112922 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679993bd-6982-4391-a2ac-68c26fe380e8 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:20.115165 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 175/347] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Apr 14 21:35:19 2022] GET /identity/v3/groups/6328aaa5c36642c48b34837f640c94da => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:20.116394 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679993bd-6982-4391-a2ac-68c26fe380e8 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:20.156711 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 173/348] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:20.158046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fd671-5c28-4bde-b129-bb0576ff9548 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:20.230247 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679993bd-6982-4391-a2ac-68c26fe380e8 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:20.260995 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fd671-5c28-4bde-b129-bb0576ff9548 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:20.266030 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468f792-cda0-479f-a0b5-00e98f17de6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:20.267226 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468f792-cda0-479f-a0b5-00e98f17de6e None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:20.267722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468f792-cda0-479f-a0b5-00e98f17de6e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:20.268238 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468f792-cda0-479f-a0b5-00e98f17de6e None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:20.269920 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468f792-cda0-479f-a0b5-00e98f17de6e None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:20.271611 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468f792-cda0-479f-a0b5-00e98f17de6e None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:20.275563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 176/349] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:20 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:20.276634 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468f792-cda0-479f-a0b5-00e98f17de6e None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:20.296493 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c847a49-8af7-4d2d-91c8-c2ec8174031c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:20.299649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847a49-8af7-4d2d-91c8-c2ec8174031c None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:20.299649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847a49-8af7-4d2d-91c8-c2ec8174031c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:20.299649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847a49-8af7-4d2d-91c8-c2ec8174031c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:20.299649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c847a49-8af7-4d2d-91c8-c2ec8174031c None admin] RBAC: Adding query filter params (group.id=6328aaa5c36642c48b34837f640c94da, role.id=c25cb9d119a74c7281a986fa76a92af6, scope.project.id=830f37ab382049b4b39840d0c29b05c0) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:20.299649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c847a49-8af7-4d2d-91c8-c2ec8174031c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:20.301101 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c847a49-8af7-4d2d-91c8-c2ec8174031c None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:20.306806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 174/350] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Apr 14 21:35:20 2022] GET /identity/v3/role_assignments?group.id=6328aaa5c36642c48b34837f640c94da&scope.project.id=830f37ab382049b4b39840d0c29b05c0&role.id=c25cb9d119a74c7281a986fa76a92af6 => generated 260 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:20.312621 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c847a49-8af7-4d2d-91c8-c2ec8174031c None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:20.412511 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c847a49-8af7-4d2d-91c8-c2ec8174031c None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:20.448450 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd81f1e-7778-45e9-b6ba-a5b5249ff87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:20.449367 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd81f1e-7778-45e9-b6ba-a5b5249ff87d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:20.449671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd81f1e-7778-45e9-b6ba-a5b5249ff87d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:20.449912 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd81f1e-7778-45e9-b6ba-a5b5249ff87d None admin] PATH_INFO: `/v3/groups/6328aaa5c36642c48b34837f640c94da` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:20.451095 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd81f1e-7778-45e9-b6ba-a5b5249ff87d None admin] RBAC: Authorizing `identity:get_group(group_id=6328aaa5c36642c48b34837f640c94da)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:20.452532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd81f1e-7778-45e9-b6ba-a5b5249ff87d None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:20.453271 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468f792-cda0-479f-a0b5-00e98f17de6e None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:20.454183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 175/351] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Apr 14 21:35:20 2022] GET /identity/v3/groups/6328aaa5c36642c48b34837f640c94da => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:20.456630 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bcdf8-cba8-4a3e-a47c-d6b6d930a1a8 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:20.456630 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bcdf8-cba8-4a3e-a47c-d6b6d930a1a8 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:20.456630 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bcdf8-cba8-4a3e-a47c-d6b6d930a1a8 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:20.457907 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 176/352] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:20.462675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bcdf8-cba8-4a3e-a47c-d6b6d930a1a8 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:20.530151 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6c444-b095-4bc6-ab8e-a4a4f46ea72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:20.532090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6c444-b095-4bc6-ab8e-a4a4f46ea72c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:20.534836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6c444-b095-4bc6-ab8e-a4a4f46ea72c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:20.535321 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6c444-b095-4bc6-ab8e-a4a4f46ea72c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:20.558177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6c444-b095-4bc6-ab8e-a4a4f46ea72c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:20.567602 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-a5d6c444-b095-4bc6-ab8e-a4a4f46ea72c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 14 21:35:20.569381 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 177/353] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:35:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:20.571109 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c521457-7453-4978-b118-8b4fc670ab28 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:20.571590 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c521457-7453-4978-b118-8b4fc670ab28 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:20.572055 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c521457-7453-4978-b118-8b4fc670ab28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:20.593726 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-1c521457-7453-4978-b118-8b4fc670ab28 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:20.595397 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-1c521457-7453-4978-b118-8b4fc670ab28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:20.679379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bcdf8-cba8-4a3e-a47c-d6b6d930a1a8 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:20.698797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 178/354] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:20.699573 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c521457-7453-4978-b118-8b4fc670ab28 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:20.737740 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6df42f-0877-480a-a248-7ebf8f8980a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:20.738402 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6df42f-0877-480a-a248-7ebf8f8980a1 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:20.738676 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6df42f-0877-480a-a248-7ebf8f8980a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:20.739001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6df42f-0877-480a-a248-7ebf8f8980a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:20.739852 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6df42f-0877-480a-a248-7ebf8f8980a1 None admin] RBAC: Adding query filter params (group.id=6328aaa5c36642c48b34837f640c94da, role.id=4a3588df731c452fba80b071fc342f78, scope.project.id=830f37ab382049b4b39840d0c29b05c0) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:20.740160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6df42f-0877-480a-a248-7ebf8f8980a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:20.742309 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6df42f-0877-480a-a248-7ebf8f8980a1 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:20.749512 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 177/355] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Apr 14 21:35:20 2022] GET /identity/v3/role_assignments?group.id=6328aaa5c36642c48b34837f640c94da&scope.project.id=830f37ab382049b4b39840d0c29b05c0&role.id=4a3588df731c452fba80b071fc342f78 => generated 260 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:20.751642 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af10312-892d-4254-86c2-b37f05e76a72 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:20.752327 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af10312-892d-4254-86c2-b37f05e76a72 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:20.752624 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af10312-892d-4254-86c2-b37f05e76a72 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:20.754796 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 178/356] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:20.756297 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af10312-892d-4254-86c2-b37f05e76a72 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:20.836169 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c521457-7453-4978-b118-8b4fc670ab28 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:20.872529 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147083d-4e7b-4e51-a64b-36af05874ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:20.873245 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147083d-4e7b-4e51-a64b-36af05874ee9 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:20.873459 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af10312-892d-4254-86c2-b37f05e76a72 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:20.873563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147083d-4e7b-4e51-a64b-36af05874ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:20.873787 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147083d-4e7b-4e51-a64b-36af05874ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:20.874550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147083d-4e7b-4e51-a64b-36af05874ee9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:20.874856 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147083d-4e7b-4e51-a64b-36af05874ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:20.876312 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147083d-4e7b-4e51-a64b-36af05874ee9 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:20.887408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 179/357] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:20.888817 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9922e-66e1-4817-bfb1-072c992a23a2 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:20.889117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9922e-66e1-4817-bfb1-072c992a23a2 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:20.889390 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9922e-66e1-4817-bfb1-072c992a23a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:20.911790 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341f846-4f17-4ddc-9dcd-461a243244c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:20.912605 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341f846-4f17-4ddc-9dcd-461a243244c2 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:20.913044 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341f846-4f17-4ddc-9dcd-461a243244c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:20.913372 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341f846-4f17-4ddc-9dcd-461a243244c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:20.913574 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-eed9922e-66e1-4817-bfb1-072c992a23a2 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:20.914595 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-eed9922e-66e1-4817-bfb1-072c992a23a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:20.925140 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341f846-4f17-4ddc-9dcd-461a243244c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:20.932645 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-8341f846-4f17-4ddc-9dcd-461a243244c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:35:20.934051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 179/358] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:20.934744 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341f846-4f17-4ddc-9dcd-461a243244c2 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:20.991855 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 180/359] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:20.992751 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9922e-66e1-4817-bfb1-072c992a23a2 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:21.044944 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341f846-4f17-4ddc-9dcd-461a243244c2 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:21.083168 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be71ff3-da1d-4fcc-b2c6-d1799e1742a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:21.083825 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be71ff3-da1d-4fcc-b2c6-d1799e1742a8 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:21.084104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be71ff3-da1d-4fcc-b2c6-d1799e1742a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:21.084376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be71ff3-da1d-4fcc-b2c6-d1799e1742a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:21.099091 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9922e-66e1-4817-bfb1-072c992a23a2 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:21.135995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad15886-672e-4fe6-8d0f-e9968bdaeb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:21.136705 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad15886-672e-4fe6-8d0f-e9968bdaeb9d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:21.136987 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad15886-672e-4fe6-8d0f-e9968bdaeb9d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:21.137260 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad15886-672e-4fe6-8d0f-e9968bdaeb9d None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:21.138023 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad15886-672e-4fe6-8d0f-e9968bdaeb9d None admin] RBAC: Adding query filter params (name=member) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:21.138333 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad15886-672e-4fe6-8d0f-e9968bdaeb9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:21.139723 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad15886-672e-4fe6-8d0f-e9968bdaeb9d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:21.149145 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 181/360] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:21.150023 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad15886-672e-4fe6-8d0f-e9968bdaeb9d None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:21.159238 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be71ff3-da1d-4fcc-b2c6-d1799e1742a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:21.160790 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be71ff3-da1d-4fcc-b2c6-d1799e1742a8 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:21.258502 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad15886-672e-4fe6-8d0f-e9968bdaeb9d None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:21.266399 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 180/361] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:21.267451 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be71ff3-da1d-4fcc-b2c6-d1799e1742a8 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:21.299860 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05fd44-7ea5-436c-a40e-f549056825f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:21.300707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05fd44-7ea5-436c-a40e-f549056825f1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:21.300988 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05fd44-7ea5-436c-a40e-f549056825f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:21.301257 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05fd44-7ea5-436c-a40e-f549056825f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:21.312022 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05fd44-7ea5-436c-a40e-f549056825f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:21.319277 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-8c05fd44-7ea5-436c-a40e-f549056825f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 14 21:35:21.320845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 182/362] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:21.321695 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05fd44-7ea5-436c-a40e-f549056825f1 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:21.371984 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be71ff3-da1d-4fcc-b2c6-d1799e1742a8 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:21.411894 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928c3bb-a58b-462d-bd22-a551003f947c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:21.412637 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928c3bb-a58b-462d-bd22-a551003f947c None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:21.413011 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928c3bb-a58b-462d-bd22-a551003f947c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:21.413340 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928c3bb-a58b-462d-bd22-a551003f947c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:21.426107 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05fd44-7ea5-436c-a40e-f549056825f1 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:21.461031 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb8ce5-997e-4163-a131-25f48554ab9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:21.462161 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8ce5-997e-4163-a131-25f48554ab9c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:21.462438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8ce5-997e-4163-a131-25f48554ab9c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:21.462708 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8ce5-997e-4163-a131-25f48554ab9c None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:21.463917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb8ce5-997e-4163-a131-25f48554ab9c None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:21.465403 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb8ce5-997e-4163-a131-25f48554ab9c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:21.467092 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 183/363] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:21 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:21.467846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb8ce5-997e-4163-a131-25f48554ab9c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:21.488036 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928c3bb-a58b-462d-bd22-a551003f947c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:21.489525 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928c3bb-a58b-462d-bd22-a551003f947c None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:21.576075 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb8ce5-997e-4163-a131-25f48554ab9c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:21.591682 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 181/364] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:21.592534 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928c3bb-a58b-462d-bd22-a551003f947c None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:21.617037 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad29c84-a870-4720-8ada-d7ed0f005526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:21.617715 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad29c84-a870-4720-8ada-d7ed0f005526 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:21.617994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad29c84-a870-4720-8ada-d7ed0f005526 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:21.618268 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad29c84-a870-4720-8ada-d7ed0f005526 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:21.619018 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad29c84-a870-4720-8ada-d7ed0f005526 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:21.619322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad29c84-a870-4720-8ada-d7ed0f005526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:21.620723 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad29c84-a870-4720-8ada-d7ed0f005526 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:21.630363 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 184/365] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:21.631269 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad29c84-a870-4720-8ada-d7ed0f005526 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:21.698060 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928c3bb-a58b-462d-bd22-a551003f947c None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:21.733203 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa266e-d403-428e-8510-d670a4952011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:21.733574 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad29c84-a870-4720-8ada-d7ed0f005526 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:21.734061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa266e-d403-428e-8510-d670a4952011 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:21.734339 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa266e-d403-428e-8510-d670a4952011 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:21.734607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa266e-d403-428e-8510-d670a4952011 None admin] PATH_INFO: `/v3/groups/6328aaa5c36642c48b34837f640c94da` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:21.736673 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa266e-d403-428e-8510-d670a4952011 None admin] RBAC: Authorizing `identity:get_group(group_id=6328aaa5c36642c48b34837f640c94da)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:21.738126 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa266e-d403-428e-8510-d670a4952011 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:21.739772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 182/366] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Apr 14 21:35:21 2022] GET /identity/v3/groups/6328aaa5c36642c48b34837f640c94da => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:21.740528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa266e-d403-428e-8510-d670a4952011 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:21.774063 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e39895-d6f7-4d2a-85e3-486e8b595bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:21.774930 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e39895-d6f7-4d2a-85e3-486e8b595bff None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:21.775212 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e39895-d6f7-4d2a-85e3-486e8b595bff None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:21.775485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e39895-d6f7-4d2a-85e3-486e8b595bff None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:21.776708 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e39895-d6f7-4d2a-85e3-486e8b595bff None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:21.778147 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e39895-d6f7-4d2a-85e3-486e8b595bff None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:21.780373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 185/367] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:21 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:21.781210 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e39895-d6f7-4d2a-85e3-486e8b595bff None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:21.872620 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa266e-d403-428e-8510-d670a4952011 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:21.893324 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e39895-d6f7-4d2a-85e3-486e8b595bff None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:21.910510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131ed86-7ad1-4e37-8169-6b90f4ffe217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:21.911821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131ed86-7ad1-4e37-8169-6b90f4ffe217 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:21.912103 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131ed86-7ad1-4e37-8169-6b90f4ffe217 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:21.912375 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131ed86-7ad1-4e37-8169-6b90f4ffe217 None admin] PATH_INFO: `/v3/users/671719728a5d4b94b56e5436938b5f90` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:21.913717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131ed86-7ad1-4e37-8169-6b90f4ffe217 None admin] RBAC: Authorizing `identity:get_user(user_id=671719728a5d4b94b56e5436938b5f90)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:21.915846 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131ed86-7ad1-4e37-8169-6b90f4ffe217 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:21.918404 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 183/368] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:35:21 2022] GET /identity/v3/users/671719728a5d4b94b56e5436938b5f90 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:21.919175 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131ed86-7ad1-4e37-8169-6b90f4ffe217 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:21.935671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9d669-79c0-4310-9bed-5b161282752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:21.936664 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9d669-79c0-4310-9bed-5b161282752f None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:21.936952 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9d669-79c0-4310-9bed-5b161282752f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:21.937226 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9d669-79c0-4310-9bed-5b161282752f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:21.938620 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9d669-79c0-4310-9bed-5b161282752f None admin] RBAC: Adding query filter params (group.id=6328aaa5c36642c48b34837f640c94da, role.id=c25cb9d119a74c7281a986fa76a92af6, scope.project.id=10c2fefd8bd2453d918573810f1d5ecb) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:21.939067 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9d669-79c0-4310-9bed-5b161282752f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:21.940997 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9d669-79c0-4310-9bed-5b161282752f None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:21.948225 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 186/369] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Apr 14 21:35:21 2022] GET /identity/v3/role_assignments?group.id=6328aaa5c36642c48b34837f640c94da&scope.project.id=10c2fefd8bd2453d918573810f1d5ecb&role.id=c25cb9d119a74c7281a986fa76a92af6 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:21.950209 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d56f1-ba37-4227-9527-10cd5826cf72 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:21.950644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d56f1-ba37-4227-9527-10cd5826cf72 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:21.950928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d56f1-ba37-4227-9527-10cd5826cf72 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:21.956907 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 187/370] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:21.958079 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d56f1-ba37-4227-9527-10cd5826cf72 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:22.062227 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131ed86-7ad1-4e37-8169-6b90f4ffe217 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:22.107437 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3d8c3-b1cc-4d87-b65a-8e3839f403cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:22.108313 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3d8c3-b1cc-4d87-b65a-8e3839f403cc None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:22.108811 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3d8c3-b1cc-4d87-b65a-8e3839f403cc None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:22.109233 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3d8c3-b1cc-4d87-b65a-8e3839f403cc None admin] PATH_INFO: `/v3/groups/6328aaa5c36642c48b34837f640c94da` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:22.110660 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3d8c3-b1cc-4d87-b65a-8e3839f403cc None admin] RBAC: Authorizing `identity:get_group(group_id=6328aaa5c36642c48b34837f640c94da)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:22.112383 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3d8c3-b1cc-4d87-b65a-8e3839f403cc None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:22.114873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 184/371] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Apr 14 21:35:21 2022] GET /identity/v3/groups/6328aaa5c36642c48b34837f640c94da => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:22.116418 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dc33b-ae87-441a-a17d-848a30cfc640 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:22.116890 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dc33b-ae87-441a-a17d-848a30cfc640 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:22.117827 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dc33b-ae87-441a-a17d-848a30cfc640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:22.137634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d64dc33b-ae87-441a-a17d-848a30cfc640 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:22.139272 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d64dc33b-ae87-441a-a17d-848a30cfc640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:22.150741 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d56f1-ba37-4227-9527-10cd5826cf72 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:22.195803 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f498d0-b7e7-4a8a-82a0-316416a7a7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:22.196824 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f498d0-b7e7-4a8a-82a0-316416a7a7a7 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:22.197106 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f498d0-b7e7-4a8a-82a0-316416a7a7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:22.197378 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f498d0-b7e7-4a8a-82a0-316416a7a7a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:22.198502 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f498d0-b7e7-4a8a-82a0-316416a7a7a7 None admin] RBAC: Adding query filter params (role.id=8301a1978ca14ba59f726e7b703fa445, user.id=671719728a5d4b94b56e5436938b5f90, scope.system=all) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:22.198857 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f498d0-b7e7-4a8a-82a0-316416a7a7a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:22.200315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f498d0-b7e7-4a8a-82a0-316416a7a7a7 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:22.217225 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 188/372] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Apr 14 21:35:21 2022] GET /identity/v3/role_assignments?user.id=671719728a5d4b94b56e5436938b5f90&scope.system=all&role.id=8301a1978ca14ba59f726e7b703fa445 => generated 510 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:22.218710 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f498d0-b7e7-4a8a-82a0-316416a7a7a7 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:22.242642 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 185/373] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:22.271887 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dc33b-ae87-441a-a17d-848a30cfc640 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:22.422142 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dc33b-ae87-441a-a17d-848a30cfc640 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:22.452335 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f498d0-b7e7-4a8a-82a0-316416a7a7a7 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:22.472991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1c784-523c-44e1-bedc-bce765a9d710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:22.473804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1c784-523c-44e1-bedc-bce765a9d710 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:22.474087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1c784-523c-44e1-bedc-bce765a9d710 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:22.474363 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1c784-523c-44e1-bedc-bce765a9d710 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:22.489774 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1c784-523c-44e1-bedc-bce765a9d710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:22.496879 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-1df1c784-523c-44e1-bedc-bce765a9d710 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:35:22.504713 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 186/374] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:35:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:22.507335 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1c784-523c-44e1-bedc-bce765a9d710 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:22.526096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584fd53-4049-4a7f-833b-637dd1c6f5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:22.526780 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584fd53-4049-4a7f-833b-637dd1c6f5b3 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:22.527058 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584fd53-4049-4a7f-833b-637dd1c6f5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:22.527328 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584fd53-4049-4a7f-833b-637dd1c6f5b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:22.528165 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584fd53-4049-4a7f-833b-637dd1c6f5b3 None admin] RBAC: Adding query filter params (group.id=6328aaa5c36642c48b34837f640c94da, role.id=4a3588df731c452fba80b071fc342f78, scope.project.id=10c2fefd8bd2453d918573810f1d5ecb) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:22.528472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584fd53-4049-4a7f-833b-637dd1c6f5b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:22.529941 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584fd53-4049-4a7f-833b-637dd1c6f5b3 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:22.546937 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 189/375] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Apr 14 21:35:22 2022] GET /identity/v3/role_assignments?group.id=6328aaa5c36642c48b34837f640c94da&scope.project.id=10c2fefd8bd2453d918573810f1d5ecb&role.id=4a3588df731c452fba80b071fc342f78 => generated 260 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:22.638306 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1c784-523c-44e1-bedc-bce765a9d710 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:22.682642 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d23ce-7788-4c68-9268-37a351d95055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:22.683260 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d23ce-7788-4c68-9268-37a351d95055 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:22.683541 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d23ce-7788-4c68-9268-37a351d95055 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:22.683814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d23ce-7788-4c68-9268-37a351d95055 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:22.684625 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d23ce-7788-4c68-9268-37a351d95055 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:22.684916 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d23ce-7788-4c68-9268-37a351d95055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:22.686294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d23ce-7788-4c68-9268-37a351d95055 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:22.700976 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 187/376] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:22.704155 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584fd53-4049-4a7f-833b-637dd1c6f5b3 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:22.930868 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584fd53-4049-4a7f-833b-637dd1c6f5b3 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:22.982144 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0804b-26ae-4338-a09c-8b87bf599a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:22.982737 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0804b-26ae-4338-a09c-8b87bf599a00 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:22.983018 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0804b-26ae-4338-a09c-8b87bf599a00 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:22.983276 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0804b-26ae-4338-a09c-8b87bf599a00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:23.066837 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0804b-26ae-4338-a09c-8b87bf599a00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:23.068304 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0804b-26ae-4338-a09c-8b87bf599a00 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:23.182259 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 190/377] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:23.187945 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d23ce-7788-4c68-9268-37a351d95055 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:23.331186 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d23ce-7788-4c68-9268-37a351d95055 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:23.380311 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2d96a-b518-4636-8f56-a681371776c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:23.381558 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2d96a-b518-4636-8f56-a681371776c7 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:23.382061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2d96a-b518-4636-8f56-a681371776c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:23.382526 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2d96a-b518-4636-8f56-a681371776c7 None admin] PATH_INFO: `/v3/projects/a2a4691b0f66431db71e4f1cd4001c61` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:23.383930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2d96a-b518-4636-8f56-a681371776c7 None admin] RBAC: Authorizing `identity:get_project(project_id=a2a4691b0f66431db71e4f1cd4001c61)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:23.385603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2d96a-b518-4636-8f56-a681371776c7 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:23.387779 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 188/378] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:23 2022] GET /identity/v3/projects/a2a4691b0f66431db71e4f1cd4001c61 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:23.393948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0804b-26ae-4338-a09c-8b87bf599a00 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:23.523712 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0804b-26ae-4338-a09c-8b87bf599a00 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:23.564158 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc2570-5ac0-41c5-b6a1-b30390b3645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:23.565050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc2570-5ac0-41c5-b6a1-b30390b3645e None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:23.565327 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc2570-5ac0-41c5-b6a1-b30390b3645e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:23.565597 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc2570-5ac0-41c5-b6a1-b30390b3645e None admin] PATH_INFO: `/v3/groups/016838dd035149a182f761bcf15b0601` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:23.570908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc2570-5ac0-41c5-b6a1-b30390b3645e None admin] RBAC: Authorizing `identity:get_group(group_id=016838dd035149a182f761bcf15b0601)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:23.572355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc2570-5ac0-41c5-b6a1-b30390b3645e None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:23.574339 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 191/379] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Apr 14 21:35:23 2022] GET /identity/v3/groups/016838dd035149a182f761bcf15b0601 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:23.580532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2d96a-b518-4636-8f56-a681371776c7 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:23.665775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdbfa7-e1dd-4490-bd17-9cf23289f0a0 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:23.666214 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdbfa7-e1dd-4490-bd17-9cf23289f0a0 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:23.666597 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdbfa7-e1dd-4490-bd17-9cf23289f0a0 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:23.668222 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 192/380] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:23.674074 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6494afc-89f9-47ef-bec5-510ebd480559 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:23.674361 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6494afc-89f9-47ef-bec5-510ebd480559 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:23.674633 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6494afc-89f9-47ef-bec5-510ebd480559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:23.694344 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-b6494afc-89f9-47ef-bec5-510ebd480559 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:23.695518 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b6494afc-89f9-47ef-bec5-510ebd480559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:23.734215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2d96a-b518-4636-8f56-a681371776c7 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:23.783082 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 193/381] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:35:23.790257 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d907c11-c5dd-4ed1-82aa-ab67a3e74d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:23.790933 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d907c11-c5dd-4ed1-82aa-ab67a3e74d32 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:23.791290 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d907c11-c5dd-4ed1-82aa-ab67a3e74d32 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:23.791577 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d907c11-c5dd-4ed1-82aa-ab67a3e74d32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:23.792426 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d907c11-c5dd-4ed1-82aa-ab67a3e74d32 None admin] RBAC: Adding query filter params (group.id=016838dd035149a182f761bcf15b0601, role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=a2a4691b0f66431db71e4f1cd4001c61) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:23.792765 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d907c11-c5dd-4ed1-82aa-ab67a3e74d32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:23.794199 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d907c11-c5dd-4ed1-82aa-ab67a3e74d32 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:23.801713 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 189/382] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Apr 14 21:35:23 2022] GET /identity/v3/role_assignments?group.id=016838dd035149a182f761bcf15b0601&scope.project.id=a2a4691b0f66431db71e4f1cd4001c61&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:23.811730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6494afc-89f9-47ef-bec5-510ebd480559 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:23.921172 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6494afc-89f9-47ef-bec5-510ebd480559 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:23.960214 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cec59-fda8-4d03-878c-1144e71882d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:23.961072 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cec59-fda8-4d03-878c-1144e71882d8 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:23.961615 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cec59-fda8-4d03-878c-1144e71882d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:23.961888 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cec59-fda8-4d03-878c-1144e71882d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:23.978880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cec59-fda8-4d03-878c-1144e71882d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:23.986901 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-4c0cec59-fda8-4d03-878c-1144e71882d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 14 21:35:23.988518 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 194/383] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:35:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:23.994495 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d907c11-c5dd-4ed1-82aa-ab67a3e74d32 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:24.136346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d907c11-c5dd-4ed1-82aa-ab67a3e74d32 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:24.181225 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a54235-a727-4191-8bd6-1b7aba72fc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:24.181828 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a54235-a727-4191-8bd6-1b7aba72fc88 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:24.182110 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a54235-a727-4191-8bd6-1b7aba72fc88 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:24.182386 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a54235-a727-4191-8bd6-1b7aba72fc88 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:24.183146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a54235-a727-4191-8bd6-1b7aba72fc88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:24.183449 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a54235-a727-4191-8bd6-1b7aba72fc88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:24.184846 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a54235-a727-4191-8bd6-1b7aba72fc88 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:24.195847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 190/384] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:24.203367 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cec59-fda8-4d03-878c-1144e71882d8 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:24.363671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cec59-fda8-4d03-878c-1144e71882d8 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:24.404122 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af8d10-a1a6-4284-8777-e87b875d7ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:24.405018 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af8d10-a1a6-4284-8777-e87b875d7ecc None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:24.405301 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af8d10-a1a6-4284-8777-e87b875d7ecc None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:24.405577 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af8d10-a1a6-4284-8777-e87b875d7ecc None admin] PATH_INFO: `/v3/groups/6328aaa5c36642c48b34837f640c94da` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:24.406784 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af8d10-a1a6-4284-8777-e87b875d7ecc None admin] RBAC: Authorizing `identity:get_group(group_id=6328aaa5c36642c48b34837f640c94da)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:24.408665 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af8d10-a1a6-4284-8777-e87b875d7ecc None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:24.410631 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 195/385] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Apr 14 21:35:24 2022] GET /identity/v3/groups/6328aaa5c36642c48b34837f640c94da => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:24.415924 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a54235-a727-4191-8bd6-1b7aba72fc88 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:24.518819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699984-e9f1-41e8-9a1a-66227858b5df None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:24.519132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699984-e9f1-41e8-9a1a-66227858b5df None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:24.519289 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699984-e9f1-41e8-9a1a-66227858b5df None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:24.520935 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 196/386] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:24.525953 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b233-1ed2-41c8-8771-9c34053bdda2 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:24.526563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b233-1ed2-41c8-8771-9c34053bdda2 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:24.526963 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b233-1ed2-41c8-8771-9c34053bdda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:24.558777 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-b091b233-1ed2-41c8-8771-9c34053bdda2 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:24.559997 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b091b233-1ed2-41c8-8771-9c34053bdda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:24.565000 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a54235-a727-4191-8bd6-1b7aba72fc88 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:24.607933 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cad483-5c23-4aa3-931f-8a061a5221a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:24.608867 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cad483-5c23-4aa3-931f-8a061a5221a1 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:24.609150 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cad483-5c23-4aa3-931f-8a061a5221a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:24.609430 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cad483-5c23-4aa3-931f-8a061a5221a1 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:24.611594 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cad483-5c23-4aa3-931f-8a061a5221a1 None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:24.613098 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cad483-5c23-4aa3-931f-8a061a5221a1 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:24.616385 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 191/387] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:24 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:24.626869 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cad483-5c23-4aa3-931f-8a061a5221a1 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:24.699414 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 197/388] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:35:24.747620 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091b233-1ed2-41c8-8771-9c34053bdda2 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:24.788292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cad483-5c23-4aa3-931f-8a061a5221a1 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:24.866928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9bc52-0f35-43c2-97f9-37527c7347d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:24.868194 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9bc52-0f35-43c2-97f9-37527c7347d7 None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:24.878772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9bc52-0f35-43c2-97f9-37527c7347d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:24.878772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9bc52-0f35-43c2-97f9-37527c7347d7 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0/groups/6328aaa5c36642c48b34837f640c94da/roles/c25cb9d119a74c7281a986fa76a92af6` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:24.878772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9bc52-0f35-43c2-97f9-37527c7347d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=830f37ab382049b4b39840d0c29b05c0, group_id=6328aaa5c36642c48b34837f640c94da, role_id=c25cb9d119a74c7281a986fa76a92af6)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:24.878772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9bc52-0f35-43c2-97f9-37527c7347d7 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:24.880965 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091b233-1ed2-41c8-8771-9c34053bdda2 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:24.921641 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea3e59-f851-44c5-bb1a-66f28208c878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:24.922468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea3e59-f851-44c5-bb1a-66f28208c878 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:24.922751 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea3e59-f851-44c5-bb1a-66f28208c878 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:24.923120 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea3e59-f851-44c5-bb1a-66f28208c878 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:24.934010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea3e59-f851-44c5-bb1a-66f28208c878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:24.942212 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-78ea3e59-f851-44c5-bb1a-66f28208c878 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:35:24.943960 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 198/389] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:24.949558 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea3e59-f851-44c5-bb1a-66f28208c878 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:24.996375 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 192/390] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Apr 14 21:35:24 2022] PUT /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0/groups/6328aaa5c36642c48b34837f640c94da/roles/c25cb9d119a74c7281a986fa76a92af6 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:35:25.080697 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea3e59-f851-44c5-bb1a-66f28208c878 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:25.103216 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdce89b-2273-403e-9297-f7e8c3d8cbbc None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:25.103507 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdce89b-2273-403e-9297-f7e8c3d8cbbc None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:25.103792 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdce89b-2273-403e-9297-f7e8c3d8cbbc None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:25.105219 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 193/391] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:35:25.118122 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdda788-2770-4a7b-a319-4649351994da None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:25.118408 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdda788-2770-4a7b-a319-4649351994da None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:25.118685 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdda788-2770-4a7b-a319-4649351994da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:25.124255 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f27ab-1349-4727-868f-8e4975f9316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:25.125205 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f27ab-1349-4727-868f-8e4975f9316a None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:25.125639 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f27ab-1349-4727-868f-8e4975f9316a None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:25.126352 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f27ab-1349-4727-868f-8e4975f9316a None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:25.127299 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f27ab-1349-4727-868f-8e4975f9316a None admin] RBAC: Adding query filter params (name=member) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:25.128031 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f27ab-1349-4727-868f-8e4975f9316a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:25.129708 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f27ab-1349-4727-868f-8e4975f9316a None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:25.144672 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 199/392] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:25.151180 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-bfdda788-2770-4a7b-a319-4649351994da None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:25.151717 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f27ab-1349-4727-868f-8e4975f9316a None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:25.152395 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-bfdda788-2770-4a7b-a319-4649351994da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:25.301049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 194/393] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:25.309895 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f27ab-1349-4727-868f-8e4975f9316a None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:25.328338 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdda788-2770-4a7b-a319-4649351994da None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:25.359753 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c448c64-53fa-4ff2-ad06-af8ad22e5806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:25.361542 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448c64-53fa-4ff2-ad06-af8ad22e5806 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:25.361542 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448c64-53fa-4ff2-ad06-af8ad22e5806 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:25.361856 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448c64-53fa-4ff2-ad06-af8ad22e5806 None admin] PATH_INFO: `/v3/groups/6328aaa5c36642c48b34837f640c94da` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:25.367409 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c448c64-53fa-4ff2-ad06-af8ad22e5806 None admin] RBAC: Authorizing `identity:get_group(group_id=6328aaa5c36642c48b34837f640c94da)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:25.368968 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c448c64-53fa-4ff2-ad06-af8ad22e5806 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:25.371036 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 200/394] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Apr 14 21:35:25 2022] GET /identity/v3/groups/6328aaa5c36642c48b34837f640c94da => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:25.376125 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c448c64-53fa-4ff2-ad06-af8ad22e5806 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:25.471923 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdda788-2770-4a7b-a319-4649351994da None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:25.488606 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c448c64-53fa-4ff2-ad06-af8ad22e5806 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:25.519666 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067865e1-ea8d-4e75-ad63-80591bc4e45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:25.520883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067865e1-ea8d-4e75-ad63-80591bc4e45f None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:25.521452 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067865e1-ea8d-4e75-ad63-80591bc4e45f None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:25.521979 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067865e1-ea8d-4e75-ad63-80591bc4e45f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:25.524710 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c012020-d593-432f-85c7-4004a33ba054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:25.525715 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c012020-d593-432f-85c7-4004a33ba054 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:25.526195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c012020-d593-432f-85c7-4004a33ba054 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:25.526344 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c012020-d593-432f-85c7-4004a33ba054 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:25.527752 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c012020-d593-432f-85c7-4004a33ba054 None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:25.529382 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c012020-d593-432f-85c7-4004a33ba054 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:25.531555 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 201/395] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:25 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:25.537445 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c012020-d593-432f-85c7-4004a33ba054 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:25.538149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067865e1-ea8d-4e75-ad63-80591bc4e45f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:25.556947 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-067865e1-ea8d-4e75-ad63-80591bc4e45f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 14 21:35:25.558821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 195/396] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:35:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:25.579776 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067865e1-ea8d-4e75-ad63-80591bc4e45f None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:25.657441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c012020-d593-432f-85c7-4004a33ba054 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:25.695201 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd04de1-6d67-475c-8905-9df845e4e845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:25.696150 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd04de1-6d67-475c-8905-9df845e4e845 None admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:25.696432 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd04de1-6d67-475c-8905-9df845e4e845 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:25.696899 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd04de1-6d67-475c-8905-9df845e4e845 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0/groups/6328aaa5c36642c48b34837f640c94da/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:25.699100 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd04de1-6d67-475c-8905-9df845e4e845 None admin] RBAC: Authorizing `identity:create_grant(project_id=830f37ab382049b4b39840d0c29b05c0, group_id=6328aaa5c36642c48b34837f640c94da, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:25.700555 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd04de1-6d67-475c-8905-9df845e4e845 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:25.767096 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067865e1-ea8d-4e75-ad63-80591bc4e45f None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:25.785212 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 202/397] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Apr 14 21:35:25 2022] PUT /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0/groups/6328aaa5c36642c48b34837f640c94da/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:35:25.811887 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52385938-a5c7-45d6-8c18-2878e01aa857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:25.812563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52385938-a5c7-45d6-8c18-2878e01aa857 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:25.813010 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52385938-a5c7-45d6-8c18-2878e01aa857 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:25.813294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52385938-a5c7-45d6-8c18-2878e01aa857 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:25.814437 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52385938-a5c7-45d6-8c18-2878e01aa857 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:25.814809 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52385938-a5c7-45d6-8c18-2878e01aa857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:25.816254 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52385938-a5c7-45d6-8c18-2878e01aa857 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:25.826389 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 196/398] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:25.834105 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd04de1-6d67-475c-8905-9df845e4e845 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:25.929547 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a4154-9d19-4328-8430-14e1f001f387 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:25.929860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a4154-9d19-4328-8430-14e1f001f387 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:25.930026 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a4154-9d19-4328-8430-14e1f001f387 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:25.931739 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 197/399] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:25.938319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfddf17-324b-4211-abfe-18bd05c90c48 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:25.939445 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfddf17-324b-4211-abfe-18bd05c90c48 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:25.939876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfddf17-324b-4211-abfe-18bd05c90c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:25.966877 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-0cfddf17-324b-4211-abfe-18bd05c90c48 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:25.968101 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-0cfddf17-324b-4211-abfe-18bd05c90c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:25.996756 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd04de1-6d67-475c-8905-9df845e4e845 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:26.070312 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa0919-fa86-4fd9-b40b-fd78dc1d6974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:26.071177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa0919-fa86-4fd9-b40b-fd78dc1d6974 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:26.071456 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa0919-fa86-4fd9-b40b-fd78dc1d6974 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:26.071739 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa0919-fa86-4fd9-b40b-fd78dc1d6974 None admin] PATH_INFO: `/v3/groups/6328aaa5c36642c48b34837f640c94da` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:26.073390 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa0919-fa86-4fd9-b40b-fd78dc1d6974 None admin] RBAC: Authorizing `identity:get_group(group_id=6328aaa5c36642c48b34837f640c94da)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:26.074846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa0919-fa86-4fd9-b40b-fd78dc1d6974 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:26.080480 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 203/400] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Apr 14 21:35:25 2022] GET /identity/v3/groups/6328aaa5c36642c48b34837f640c94da => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:26.085649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 198/401] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:26.087171 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa0919-fa86-4fd9-b40b-fd78dc1d6974 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:26.124132 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfddf17-324b-4211-abfe-18bd05c90c48 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:26.196466 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa0919-fa86-4fd9-b40b-fd78dc1d6974 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:26.231558 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d5cd7-55c6-41b1-9519-dec2fe9640ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:26.232809 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d5cd7-55c6-41b1-9519-dec2fe9640ae None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:26.233295 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d5cd7-55c6-41b1-9519-dec2fe9640ae None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:26.233790 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d5cd7-55c6-41b1-9519-dec2fe9640ae None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:26.235372 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d5cd7-55c6-41b1-9519-dec2fe9640ae None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:26.237580 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d5cd7-55c6-41b1-9519-dec2fe9640ae None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:26.237898 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfddf17-324b-4211-abfe-18bd05c90c48 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:26.240064 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 204/402] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:26 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:26.246144 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d5cd7-55c6-41b1-9519-dec2fe9640ae None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:26.276687 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4162c-3513-4f31-b24f-1e052a2f39ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:26.277278 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4162c-3513-4f31-b24f-1e052a2f39ad None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:26.277563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4162c-3513-4f31-b24f-1e052a2f39ad None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:26.277840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4162c-3513-4f31-b24f-1e052a2f39ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:26.289538 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4162c-3513-4f31-b24f-1e052a2f39ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:26.297003 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-39a4162c-3513-4f31-b24f-1e052a2f39ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:35:26.298344 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 199/403] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:26.310712 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4162c-3513-4f31-b24f-1e052a2f39ad None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:26.361995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d5cd7-55c6-41b1-9519-dec2fe9640ae None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:26.397162 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e180230-4dc4-4237-985d-83d12e9358dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:26.398320 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e180230-4dc4-4237-985d-83d12e9358dc None admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:26.398793 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e180230-4dc4-4237-985d-83d12e9358dc None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:26.399244 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e180230-4dc4-4237-985d-83d12e9358dc None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb/groups/6328aaa5c36642c48b34837f640c94da/roles/c25cb9d119a74c7281a986fa76a92af6` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:26.401736 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e180230-4dc4-4237-985d-83d12e9358dc None admin] RBAC: Authorizing `identity:create_grant(project_id=10c2fefd8bd2453d918573810f1d5ecb, group_id=6328aaa5c36642c48b34837f640c94da, role_id=c25cb9d119a74c7281a986fa76a92af6)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:26.403393 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e180230-4dc4-4237-985d-83d12e9358dc None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:26.421675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4162c-3513-4f31-b24f-1e052a2f39ad None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:26.457312 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963147bd-33e7-4003-b9d0-6161c5b81919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:26.458263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963147bd-33e7-4003-b9d0-6161c5b81919 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:26.458790 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963147bd-33e7-4003-b9d0-6161c5b81919 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:26.459254 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963147bd-33e7-4003-b9d0-6161c5b81919 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:26.460342 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963147bd-33e7-4003-b9d0-6161c5b81919 None admin] RBAC: Adding query filter params (name=member) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:26.460847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963147bd-33e7-4003-b9d0-6161c5b81919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:26.462719 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963147bd-33e7-4003-b9d0-6161c5b81919 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:26.472135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 200/404] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:26.479076 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963147bd-33e7-4003-b9d0-6161c5b81919 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:26.492324 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 205/405] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Apr 14 21:35:26 2022] PUT /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb/groups/6328aaa5c36642c48b34837f640c94da/roles/c25cb9d119a74c7281a986fa76a92af6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:35:26.606602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963147bd-33e7-4003-b9d0-6161c5b81919 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:26.648266 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907c337-ec51-4a48-89c9-764de8d6413d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:26.649270 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907c337-ec51-4a48-89c9-764de8d6413d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:26.649551 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907c337-ec51-4a48-89c9-764de8d6413d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:26.649825 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907c337-ec51-4a48-89c9-764de8d6413d None admin] PATH_INFO: `/v3/groups/6328aaa5c36642c48b34837f640c94da` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:26.651083 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907c337-ec51-4a48-89c9-764de8d6413d None admin] RBAC: Authorizing `identity:get_group(group_id=6328aaa5c36642c48b34837f640c94da)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:26.652549 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907c337-ec51-4a48-89c9-764de8d6413d None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:26.654627 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 201/406] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Apr 14 21:35:26 2022] GET /identity/v3/groups/6328aaa5c36642c48b34837f640c94da => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:26.660309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e180230-4dc4-4237-985d-83d12e9358dc None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:26.788804 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e180230-4dc4-4237-985d-83d12e9358dc None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:26.832144 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93751fd1-905a-4966-9a33-5d989176d98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:26.833060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751fd1-905a-4966-9a33-5d989176d98f None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:26.833337 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751fd1-905a-4966-9a33-5d989176d98f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:26.833610 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751fd1-905a-4966-9a33-5d989176d98f None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:26.835591 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93751fd1-905a-4966-9a33-5d989176d98f None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:26.837337 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93751fd1-905a-4966-9a33-5d989176d98f None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:26.839340 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 206/407] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:26 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:26.845099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907c337-ec51-4a48-89c9-764de8d6413d None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:27.004491 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907c337-ec51-4a48-89c9-764de8d6413d None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:27.040666 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febe7e8-0525-46b7-ae25-acc2c5e19bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:27.041478 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febe7e8-0525-46b7-ae25-acc2c5e19bd5 None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:27.041757 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febe7e8-0525-46b7-ae25-acc2c5e19bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:27.042027 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febe7e8-0525-46b7-ae25-acc2c5e19bd5 None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb/groups/6328aaa5c36642c48b34837f640c94da/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:27.043966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febe7e8-0525-46b7-ae25-acc2c5e19bd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=10c2fefd8bd2453d918573810f1d5ecb, group_id=6328aaa5c36642c48b34837f640c94da, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:27.045501 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febe7e8-0525-46b7-ae25-acc2c5e19bd5 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:27.123503 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 202/408] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Apr 14 21:35:26 2022] PUT /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb/groups/6328aaa5c36642c48b34837f640c94da/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:35:27.335288 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fc9c2-5e66-4144-9c25-dac791093ba5 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:27.335288 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fc9c2-5e66-4144-9c25-dac791093ba5 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:27.335288 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fc9c2-5e66-4144-9c25-dac791093ba5 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:27.336646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 207/409] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:27.340969 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f8d1a-8dfc-4477-b2a3-dee14ef3eea4 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:27.341817 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f8d1a-8dfc-4477-b2a3-dee14ef3eea4 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:27.342321 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f8d1a-8dfc-4477-b2a3-dee14ef3eea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:27.369843 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-5f3f8d1a-8dfc-4477-b2a3-dee14ef3eea4 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:27.371443 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5f3f8d1a-8dfc-4477-b2a3-dee14ef3eea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:27.450102 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 203/410] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:27.475408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fc9c2-5e66-4144-9c25-dac791093ba5 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:27.602355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fc9c2-5e66-4144-9c25-dac791093ba5 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:27.644376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baa8ff-fb17-46d4-9e24-ef7fbc1ace92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:27.645641 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baa8ff-fb17-46d4-9e24-ef7fbc1ace92 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:27.646200 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baa8ff-fb17-46d4-9e24-ef7fbc1ace92 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:27.646679 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baa8ff-fb17-46d4-9e24-ef7fbc1ace92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:27.660611 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47baa8ff-fb17-46d4-9e24-ef7fbc1ace92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:27.668368 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-47baa8ff-fb17-46d4-9e24-ef7fbc1ace92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:35:27.670056 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 208/411] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:35:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:27.676742 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f8d1a-8dfc-4477-b2a3-dee14ef3eea4 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:27.781341 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f8d1a-8dfc-4477-b2a3-dee14ef3eea4 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:27.819616 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982927a7-1a4d-471e-91da-9e3bfd513c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:27.820674 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982927a7-1a4d-471e-91da-9e3bfd513c05 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:27.821164 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982927a7-1a4d-471e-91da-9e3bfd513c05 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:27.821656 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982927a7-1a4d-471e-91da-9e3bfd513c05 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:27.822424 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982927a7-1a4d-471e-91da-9e3bfd513c05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:27.822734 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982927a7-1a4d-471e-91da-9e3bfd513c05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:27.824116 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982927a7-1a4d-471e-91da-9e3bfd513c05 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:27.834405 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 204/412] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:27.841130 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baa8ff-fb17-46d4-9e24-ef7fbc1ace92 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:27.952958 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baa8ff-fb17-46d4-9e24-ef7fbc1ace92 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:28.002332 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be441154-3578-4659-811b-8ff0ff8324cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:28.003583 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be441154-3578-4659-811b-8ff0ff8324cf None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:28.004123 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be441154-3578-4659-811b-8ff0ff8324cf None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:28.004662 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be441154-3578-4659-811b-8ff0ff8324cf None admin] PATH_INFO: `/v3/groups/016838dd035149a182f761bcf15b0601` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:28.006081 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be441154-3578-4659-811b-8ff0ff8324cf None admin] RBAC: Authorizing `identity:get_group(group_id=016838dd035149a182f761bcf15b0601)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:28.007949 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be441154-3578-4659-811b-8ff0ff8324cf None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:28.010616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 209/413] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Apr 14 21:35:27 2022] GET /identity/v3/groups/016838dd035149a182f761bcf15b0601 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:28.015637 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982927a7-1a4d-471e-91da-9e3bfd513c05 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:28.077963 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3961c4-087e-4287-a1f6-6fb83afae17b None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:28.078612 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3961c4-087e-4287-a1f6-6fb83afae17b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:28.079104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3961c4-087e-4287-a1f6-6fb83afae17b None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:28.081074 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 210/414] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:35:28.089537 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87960d56-4f47-4c7e-ab6b-7f857ced2fc5 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:28.089740 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87960d56-4f47-4c7e-ab6b-7f857ced2fc5 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:28.089954 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87960d56-4f47-4c7e-ab6b-7f857ced2fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:28.125232 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-87960d56-4f47-4c7e-ab6b-7f857ced2fc5 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:28.126997 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-87960d56-4f47-4c7e-ab6b-7f857ced2fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:28.144435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982927a7-1a4d-471e-91da-9e3bfd513c05 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:28.178738 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3db32a-1ce3-41e3-a0f4-2c48bd701952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:28.179962 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db32a-1ce3-41e3-a0f4-2c48bd701952 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:28.180442 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db32a-1ce3-41e3-a0f4-2c48bd701952 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:28.180933 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db32a-1ce3-41e3-a0f4-2c48bd701952 None admin] PATH_INFO: `/v3/projects/a2a4691b0f66431db71e4f1cd4001c61` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:28.182324 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3db32a-1ce3-41e3-a0f4-2c48bd701952 None admin] RBAC: Authorizing `identity:get_project(project_id=a2a4691b0f66431db71e4f1cd4001c61)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:28.183957 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3db32a-1ce3-41e3-a0f4-2c48bd701952 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:28.186359 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 205/415] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:28 2022] GET /identity/v3/projects/a2a4691b0f66431db71e4f1cd4001c61 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:28.194166 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3db32a-1ce3-41e3-a0f4-2c48bd701952 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:28.253854 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 211/416] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:35:28.307854 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87960d56-4f47-4c7e-ab6b-7f857ced2fc5 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:28.367813 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3db32a-1ce3-41e3-a0f4-2c48bd701952 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:28.428134 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceaced5-b73a-4c86-a4ee-f8e9a40d6a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:28.429077 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaced5-b73a-4c86-a4ee-f8e9a40d6a4b None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:28.429352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaced5-b73a-4c86-a4ee-f8e9a40d6a4b None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:28.429624 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaced5-b73a-4c86-a4ee-f8e9a40d6a4b None admin] PATH_INFO: `/v3/projects/a2a4691b0f66431db71e4f1cd4001c61/groups/016838dd035149a182f761bcf15b0601/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:28.434236 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceaced5-b73a-4c86-a4ee-f8e9a40d6a4b None admin] RBAC: Authorizing `identity:create_grant(project_id=a2a4691b0f66431db71e4f1cd4001c61, group_id=016838dd035149a182f761bcf15b0601, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:28.435671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceaced5-b73a-4c86-a4ee-f8e9a40d6a4b None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:28.461075 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87960d56-4f47-4c7e-ab6b-7f857ced2fc5 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:28.497483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b83a8a-5177-4b71-8aba-adbcda68ae7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:28.498682 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83a8a-5177-4b71-8aba-adbcda68ae7b None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:28.499196 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83a8a-5177-4b71-8aba-adbcda68ae7b None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:28.499683 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83a8a-5177-4b71-8aba-adbcda68ae7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:28.516687 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b83a8a-5177-4b71-8aba-adbcda68ae7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:28.522368 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-91b83a8a-5177-4b71-8aba-adbcda68ae7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 14 21:35:28.524035 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 212/417] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:35:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:28.529961 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b83a8a-5177-4b71-8aba-adbcda68ae7b None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:28.583918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 206/418] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Apr 14 21:35:28 2022] PUT /identity/v3/projects/a2a4691b0f66431db71e4f1cd4001c61/groups/016838dd035149a182f761bcf15b0601/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:35:28.650252 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b83a8a-5177-4b71-8aba-adbcda68ae7b None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:28.697114 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838de636-0114-46d5-bbaf-11e6da43acb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:28.697793 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838de636-0114-46d5-bbaf-11e6da43acb0 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:28.698077 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838de636-0114-46d5-bbaf-11e6da43acb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:28.698355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838de636-0114-46d5-bbaf-11e6da43acb0 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:28.699116 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838de636-0114-46d5-bbaf-11e6da43acb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:28.699424 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838de636-0114-46d5-bbaf-11e6da43acb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:28.700836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838de636-0114-46d5-bbaf-11e6da43acb0 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:28.712712 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 213/419] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:28.718248 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceaced5-b73a-4c86-a4ee-f8e9a40d6a4b None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:28.869890 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceaced5-b73a-4c86-a4ee-f8e9a40d6a4b None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:28.907143 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb7145-b6eb-437f-ab58-667ca5542c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:28.908248 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb7145-b6eb-437f-ab58-667ca5542c57 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:28.908785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb7145-b6eb-437f-ab58-667ca5542c57 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:28.909304 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb7145-b6eb-437f-ab58-667ca5542c57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:28.989685 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb7145-b6eb-437f-ab58-667ca5542c57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:28.991429 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb7145-b6eb-437f-ab58-667ca5542c57 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:29.078970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86046b4-8f56-4979-9f37-e43ab46f1b29 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:29.079398 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86046b4-8f56-4979-9f37-e43ab46f1b29 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:29.079678 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86046b4-8f56-4979-9f37-e43ab46f1b29 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:29.081412 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 214/420] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:29.087435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5725c-bdd0-4c51-8f01-8cef81af9823 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:29.087720 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5725c-bdd0-4c51-8f01-8cef81af9823 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:29.087995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5725c-bdd0-4c51-8f01-8cef81af9823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:29.115441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-2bf5725c-bdd0-4c51-8f01-8cef81af9823 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:29.118784 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 207/421] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:29.120354 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-2bf5725c-bdd0-4c51-8f01-8cef81af9823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:29.123808 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb7145-b6eb-437f-ab58-667ca5542c57 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:29.247332 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 215/422] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:29.279249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb7145-b6eb-437f-ab58-667ca5542c57 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:29.324454 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5725c-bdd0-4c51-8f01-8cef81af9823 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:29.329144 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d76278-2edc-49d2-b21f-3a816d2f0b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:29.330022 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d76278-2edc-49d2-b21f-3a816d2f0b5a None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:29.330305 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d76278-2edc-49d2-b21f-3a816d2f0b5a None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:29.330576 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d76278-2edc-49d2-b21f-3a816d2f0b5a None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:29.331783 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d76278-2edc-49d2-b21f-3a816d2f0b5a None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:29.333261 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d76278-2edc-49d2-b21f-3a816d2f0b5a None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:29.335257 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 208/423] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:29 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:29.340884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d76278-2edc-49d2-b21f-3a816d2f0b5a None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:29.443153 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d76278-2edc-49d2-b21f-3a816d2f0b5a None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:29.477811 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4289a-1ba2-44be-afa8-f3d4f6eb04b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:29.478678 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4289a-1ba2-44be-afa8-f3d4f6eb04b6 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:29.478958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4289a-1ba2-44be-afa8-f3d4f6eb04b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:29.479232 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4289a-1ba2-44be-afa8-f3d4f6eb04b6 None admin] PATH_INFO: `/v3/groups/6328aaa5c36642c48b34837f640c94da` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:29.480411 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4289a-1ba2-44be-afa8-f3d4f6eb04b6 None admin] RBAC: Authorizing `identity:get_group(group_id=6328aaa5c36642c48b34837f640c94da)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:29.481892 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4289a-1ba2-44be-afa8-f3d4f6eb04b6 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:29.483814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 209/424] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Apr 14 21:35:29 2022] GET /identity/v3/groups/6328aaa5c36642c48b34837f640c94da => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:29.489607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4289a-1ba2-44be-afa8-f3d4f6eb04b6 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:29.554902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5725c-bdd0-4c51-8f01-8cef81af9823 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:29.590273 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4289a-1ba2-44be-afa8-f3d4f6eb04b6 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:29.626198 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148887f9-3db0-4ac9-8da2-e7597541fca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:29.627059 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148887f9-3db0-4ac9-8da2-e7597541fca9 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:29.627339 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148887f9-3db0-4ac9-8da2-e7597541fca9 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:29.627613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148887f9-3db0-4ac9-8da2-e7597541fca9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:29.627711 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9555d-b390-4579-b092-6eea53aefa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:29.628455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9555d-b390-4579-b092-6eea53aefa51 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:29.628765 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9555d-b390-4579-b092-6eea53aefa51 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:29.629044 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9555d-b390-4579-b092-6eea53aefa51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:29.629882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9555d-b390-4579-b092-6eea53aefa51 None admin] RBAC: Adding query filter params (group.id=6328aaa5c36642c48b34837f640c94da, role.id=c25cb9d119a74c7281a986fa76a92af6, scope.project.id=830f37ab382049b4b39840d0c29b05c0) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:29.630196 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9555d-b390-4579-b092-6eea53aefa51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:29.631639 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9555d-b390-4579-b092-6eea53aefa51 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:29.638300 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 210/425] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Apr 14 21:35:29 2022] GET /identity/v3/role_assignments?group.id=6328aaa5c36642c48b34837f640c94da&scope.project.id=830f37ab382049b4b39840d0c29b05c0&role.id=c25cb9d119a74c7281a986fa76a92af6 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:29.661831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148887f9-3db0-4ac9-8da2-e7597541fca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:29.669206 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-148887f9-3db0-4ac9-8da2-e7597541fca9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:35:29.674929 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 216/426] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:29.680518 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9555d-b390-4579-b092-6eea53aefa51 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:29.742695 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d348-6470-43c2-b95b-f911c064103b None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:29.742881 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d348-6470-43c2-b95b-f911c064103b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:29.743160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d348-6470-43c2-b95b-f911c064103b None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:29.744864 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 217/427] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:35:29.758596 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c42fe-5404-400b-90b3-65d5d82a44ee None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:29.758922 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c42fe-5404-400b-90b3-65d5d82a44ee None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:29.759169 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c42fe-5404-400b-90b3-65d5d82a44ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:29.801784 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-fe5c42fe-5404-400b-90b3-65d5d82a44ee None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:29.802751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9555d-b390-4579-b092-6eea53aefa51 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:29.803018 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-fe5c42fe-5404-400b-90b3-65d5d82a44ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:29.854099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf3ed1-f2b4-434d-b099-c12a806f1ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:29.854803 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf3ed1-f2b4-434d-b099-c12a806f1ce0 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:29.855087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf3ed1-f2b4-434d-b099-c12a806f1ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:29.855364 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf3ed1-f2b4-434d-b099-c12a806f1ce0 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:29.856173 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf3ed1-f2b4-434d-b099-c12a806f1ce0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:29.856446 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf3ed1-f2b4-434d-b099-c12a806f1ce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:29.857877 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf3ed1-f2b4-434d-b099-c12a806f1ce0 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:29.871071 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 211/428] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:29.877804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf3ed1-f2b4-434d-b099-c12a806f1ce0 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:29.921010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 218/429] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:29.948515 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c42fe-5404-400b-90b3-65d5d82a44ee None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:30.011782 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf3ed1-f2b4-434d-b099-c12a806f1ce0 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:30.049910 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fbbdc-4546-4309-b263-7fd7e2d38c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:30.051229 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fbbdc-4546-4309-b263-7fd7e2d38c35 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:30.051229 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fbbdc-4546-4309-b263-7fd7e2d38c35 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:30.051437 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fbbdc-4546-4309-b263-7fd7e2d38c35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:30.087257 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c42fe-5404-400b-90b3-65d5d82a44ee None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:30.135728 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fbbdc-4546-4309-b263-7fd7e2d38c35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:30.136699 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fcffe-3f8e-483d-b403-001786b04083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:30.137253 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fbbdc-4546-4309-b263-7fd7e2d38c35 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:30.137972 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fcffe-3f8e-483d-b403-001786b04083 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:30.138448 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fcffe-3f8e-483d-b403-001786b04083 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:30.138913 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fcffe-3f8e-483d-b403-001786b04083 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:30.149886 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fcffe-3f8e-483d-b403-001786b04083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:30.161042 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-aa1fcffe-3f8e-483d-b403-001786b04083 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 14 21:35:30.162966 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 219/430] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:35:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:30.168885 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fcffe-3f8e-483d-b403-001786b04083 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:30.256204 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 212/431] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:30.257997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4bf00-d744-4619-84bb-db8168902f74 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:30.258353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4bf00-d744-4619-84bb-db8168902f74 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:30.258700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4bf00-d744-4619-84bb-db8168902f74 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:30.260202 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 213/432] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:30.261292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4bf00-d744-4619-84bb-db8168902f74 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:30.276235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fcffe-3f8e-483d-b403-001786b04083 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:30.310472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94494242-dd81-46a3-b8d6-2e75382becc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:30.311473 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94494242-dd81-46a3-b8d6-2e75382becc9 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:30.311947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94494242-dd81-46a3-b8d6-2e75382becc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:30.312411 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94494242-dd81-46a3-b8d6-2e75382becc9 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:30.313402 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94494242-dd81-46a3-b8d6-2e75382becc9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:30.313850 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94494242-dd81-46a3-b8d6-2e75382becc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:30.315379 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94494242-dd81-46a3-b8d6-2e75382becc9 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:30.323609 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 220/433] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:30.324884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33fee5-9ebc-4522-b1e1-17af2c8a27da None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:30.325166 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33fee5-9ebc-4522-b1e1-17af2c8a27da None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:30.325436 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33fee5-9ebc-4522-b1e1-17af2c8a27da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:30.343106 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-2d33fee5-9ebc-4522-b1e1-17af2c8a27da None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:30.344277 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-2d33fee5-9ebc-4522-b1e1-17af2c8a27da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:30.365599 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4bf00-d744-4619-84bb-db8168902f74 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:30.398112 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01566de-1b83-421f-90cb-c1a61ec90e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:30.398963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01566de-1b83-421f-90cb-c1a61ec90e39 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:30.399246 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01566de-1b83-421f-90cb-c1a61ec90e39 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:30.399520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01566de-1b83-421f-90cb-c1a61ec90e39 None admin] PATH_INFO: `/v3/projects/830f37ab382049b4b39840d0c29b05c0` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:30.400755 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01566de-1b83-421f-90cb-c1a61ec90e39 None admin] RBAC: Authorizing `identity:get_project(project_id=830f37ab382049b4b39840d0c29b05c0)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:30.402181 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01566de-1b83-421f-90cb-c1a61ec90e39 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:30.404173 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 214/434] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:30 2022] GET /identity/v3/projects/830f37ab382049b4b39840d0c29b05c0 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:30.404969 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01566de-1b83-421f-90cb-c1a61ec90e39 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:30.414469 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 221/435] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:30.415294 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33fee5-9ebc-4522-b1e1-17af2c8a27da None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:30.512293 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33fee5-9ebc-4522-b1e1-17af2c8a27da None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:30.514712 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01566de-1b83-421f-90cb-c1a61ec90e39 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:30.546627 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ff5a8-01ea-42b5-9518-0fbc370305eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:30.547408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ff5a8-01ea-42b5-9518-0fbc370305eb None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:30.548270 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ff5a8-01ea-42b5-9518-0fbc370305eb None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:30.548645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ff5a8-01ea-42b5-9518-0fbc370305eb None admin] PATH_INFO: `/v3/groups/6328aaa5c36642c48b34837f640c94da` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:30.549846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ff5a8-01ea-42b5-9518-0fbc370305eb None admin] RBAC: Authorizing `identity:get_group(group_id=6328aaa5c36642c48b34837f640c94da)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:30.551288 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ff5a8-01ea-42b5-9518-0fbc370305eb None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:30.557589 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 222/436] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Apr 14 21:35:30 2022] GET /identity/v3/groups/6328aaa5c36642c48b34837f640c94da => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:30.557589 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ff5a8-01ea-42b5-9518-0fbc370305eb None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:30.558215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8d349-16b0-4115-a1ea-84a9ef6ea7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:30.558378 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8d349-16b0-4115-a1ea-84a9ef6ea7b5 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:30.558745 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8d349-16b0-4115-a1ea-84a9ef6ea7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:30.559019 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8d349-16b0-4115-a1ea-84a9ef6ea7b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:30.628514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8d349-16b0-4115-a1ea-84a9ef6ea7b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:30.629914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8d349-16b0-4115-a1ea-84a9ef6ea7b5 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:30.659483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ff5a8-01ea-42b5-9518-0fbc370305eb None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:30.693591 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deff0a2-0329-4894-a017-4748ea30df6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:30.694387 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deff0a2-0329-4894-a017-4748ea30df6c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:30.694666 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deff0a2-0329-4894-a017-4748ea30df6c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:30.694967 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deff0a2-0329-4894-a017-4748ea30df6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:30.705674 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deff0a2-0329-4894-a017-4748ea30df6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:30.713313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-8deff0a2-0329-4894-a017-4748ea30df6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 14 21:35:30.714535 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 223/437] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:30.715303 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deff0a2-0329-4894-a017-4748ea30df6c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:30.730950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 215/438] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:30.731785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8d349-16b0-4115-a1ea-84a9ef6ea7b5 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:30.816414 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deff0a2-0329-4894-a017-4748ea30df6c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:30.831485 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8d349-16b0-4115-a1ea-84a9ef6ea7b5 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:30.849902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4d403-75ba-4ecf-8bff-778d163436c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:30.850548 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4d403-75ba-4ecf-8bff-778d163436c1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:30.850833 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4d403-75ba-4ecf-8bff-778d163436c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:30.851112 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4d403-75ba-4ecf-8bff-778d163436c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:30.851955 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4d403-75ba-4ecf-8bff-778d163436c1 None admin] RBAC: Adding query filter params (group.id=6328aaa5c36642c48b34837f640c94da, role.id=4a3588df731c452fba80b071fc342f78, scope.project.id=830f37ab382049b4b39840d0c29b05c0) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:30.852259 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4d403-75ba-4ecf-8bff-778d163436c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:30.853741 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4d403-75ba-4ecf-8bff-778d163436c1 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:30.868634 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 224/439] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Apr 14 21:35:30 2022] GET /identity/v3/role_assignments?group.id=6328aaa5c36642c48b34837f640c94da&scope.project.id=830f37ab382049b4b39840d0c29b05c0&role.id=4a3588df731c452fba80b071fc342f78 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:30.868634 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4d403-75ba-4ecf-8bff-778d163436c1 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:30.878327 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b0652-39c9-4395-a057-2b02695205d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:30.879512 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b0652-39c9-4395-a057-2b02695205d7 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:30.880076 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b0652-39c9-4395-a057-2b02695205d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:30.880356 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b0652-39c9-4395-a057-2b02695205d7 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:30.881395 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b0652-39c9-4395-a057-2b02695205d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:30.881708 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b0652-39c9-4395-a057-2b02695205d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:30.883542 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b0652-39c9-4395-a057-2b02695205d7 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:30.895807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 216/440] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:35:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:30.901543 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b0652-39c9-4395-a057-2b02695205d7 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:30.985371 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4d403-75ba-4ecf-8bff-778d163436c1 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:31.022588 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7edd4-6139-4e01-a868-53d69998773d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:31.023460 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7edd4-6139-4e01-a868-53d69998773d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:31.023743 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7edd4-6139-4e01-a868-53d69998773d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:31.024018 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7edd4-6139-4e01-a868-53d69998773d None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:31.025287 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7edd4-6139-4e01-a868-53d69998773d None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:31.025908 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b0652-39c9-4395-a057-2b02695205d7 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:31.026770 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7edd4-6139-4e01-a868-53d69998773d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:31.032615 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 225/441] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:30 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:31.034482 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7edd4-6139-4e01-a868-53d69998773d None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:31.067993 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30520c3-efde-4498-836c-13c5f7631f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:31.069106 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30520c3-efde-4498-836c-13c5f7631f0f None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:31.069594 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30520c3-efde-4498-836c-13c5f7631f0f None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:31.070112 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30520c3-efde-4498-836c-13c5f7631f0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:31.151488 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30520c3-efde-4498-836c-13c5f7631f0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:31.153930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30520c3-efde-4498-836c-13c5f7631f0f None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:31.158010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7edd4-6139-4e01-a868-53d69998773d None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:31.200535 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d83c5-5b07-4a9f-979f-ead825d83191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:31.201454 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d83c5-5b07-4a9f-979f-ead825d83191 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:31.201735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d83c5-5b07-4a9f-979f-ead825d83191 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:31.202008 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d83c5-5b07-4a9f-979f-ead825d83191 None admin] PATH_INFO: `/v3/groups/6328aaa5c36642c48b34837f640c94da` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:31.203553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d83c5-5b07-4a9f-979f-ead825d83191 None admin] RBAC: Authorizing `identity:get_group(group_id=6328aaa5c36642c48b34837f640c94da)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:31.206285 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d83c5-5b07-4a9f-979f-ead825d83191 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:31.208637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 226/442] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Apr 14 21:35:31 2022] GET /identity/v3/groups/6328aaa5c36642c48b34837f640c94da => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:31.215868 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d83c5-5b07-4a9f-979f-ead825d83191 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:31.290959 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 217/443] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:31.296421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30520c3-efde-4498-836c-13c5f7631f0f None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:31.332445 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d83c5-5b07-4a9f-979f-ead825d83191 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:31.368270 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4f657-627c-40cc-903d-d167f3b7cbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:31.369050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4f657-627c-40cc-903d-d167f3b7cbbd None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:31.369341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4f657-627c-40cc-903d-d167f3b7cbbd None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:31.369619 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4f657-627c-40cc-903d-d167f3b7cbbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:31.370456 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4f657-627c-40cc-903d-d167f3b7cbbd None admin] RBAC: Adding query filter params (group.id=6328aaa5c36642c48b34837f640c94da, role.id=c25cb9d119a74c7281a986fa76a92af6, scope.project.id=10c2fefd8bd2453d918573810f1d5ecb) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:31.370775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4f657-627c-40cc-903d-d167f3b7cbbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:31.372220 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4f657-627c-40cc-903d-d167f3b7cbbd None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:31.379140 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 227/444] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Apr 14 21:35:31 2022] GET /identity/v3/role_assignments?group.id=6328aaa5c36642c48b34837f640c94da&scope.project.id=10c2fefd8bd2453d918573810f1d5ecb&role.id=c25cb9d119a74c7281a986fa76a92af6 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:31.380409 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2915f9-2752-4211-a991-945760a181b6 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:31.380794 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2915f9-2752-4211-a991-945760a181b6 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:31.381071 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2915f9-2752-4211-a991-945760a181b6 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:31.382646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 228/445] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:31.388760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ae228-161a-47dc-b2a0-8320412621fc None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:31.389090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ae228-161a-47dc-b2a0-8320412621fc None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:31.389595 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ae228-161a-47dc-b2a0-8320412621fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:31.407589 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-013ae228-161a-47dc-b2a0-8320412621fc None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:31.408867 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-013ae228-161a-47dc-b2a0-8320412621fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:31.417710 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30520c3-efde-4498-836c-13c5f7631f0f None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:31.451775 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e2237-b63c-4200-8e5d-edc5156ee502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:31.455963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e2237-b63c-4200-8e5d-edc5156ee502 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:31.455963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e2237-b63c-4200-8e5d-edc5156ee502 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:31.455963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e2237-b63c-4200-8e5d-edc5156ee502 None admin] PATH_INFO: `/v3/projects/10c2fefd8bd2453d918573810f1d5ecb` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:31.455963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e2237-b63c-4200-8e5d-edc5156ee502 None admin] RBAC: Authorizing `identity:get_project(project_id=10c2fefd8bd2453d918573810f1d5ecb)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:31.457095 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e2237-b63c-4200-8e5d-edc5156ee502 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:31.459065 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 218/446] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:31 2022] GET /identity/v3/projects/10c2fefd8bd2453d918573810f1d5ecb => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:31.464707 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e2237-b63c-4200-8e5d-edc5156ee502 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:31.497309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 229/447] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:31.526889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ae228-161a-47dc-b2a0-8320412621fc None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:31.571607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e2237-b63c-4200-8e5d-edc5156ee502 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:31.607782 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79f7a2-bc1c-422a-80c0-30ad314ca163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:31.608753 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79f7a2-bc1c-422a-80c0-30ad314ca163 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:31.609032 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79f7a2-bc1c-422a-80c0-30ad314ca163 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:31.609302 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79f7a2-bc1c-422a-80c0-30ad314ca163 None admin] PATH_INFO: `/v3/groups/6328aaa5c36642c48b34837f640c94da` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:31.610605 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79f7a2-bc1c-422a-80c0-30ad314ca163 None admin] RBAC: Authorizing `identity:get_group(group_id=6328aaa5c36642c48b34837f640c94da)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:31.612045 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79f7a2-bc1c-422a-80c0-30ad314ca163 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:31.614060 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 219/448] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Apr 14 21:35:31 2022] GET /identity/v3/groups/6328aaa5c36642c48b34837f640c94da => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:31.619465 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79f7a2-bc1c-422a-80c0-30ad314ca163 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:31.643946 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ae228-161a-47dc-b2a0-8320412621fc None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:31.678619 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc682da5-596b-40be-9b0f-fc571a4f1423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:31.679412 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc682da5-596b-40be-9b0f-fc571a4f1423 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:31.679692 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc682da5-596b-40be-9b0f-fc571a4f1423 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:31.679965 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc682da5-596b-40be-9b0f-fc571a4f1423 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:31.690444 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc682da5-596b-40be-9b0f-fc571a4f1423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:31.697468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-cc682da5-596b-40be-9b0f-fc571a4f1423 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:35:31.698693 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 230/449] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:35:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:31.705070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc682da5-596b-40be-9b0f-fc571a4f1423 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:31.721039 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79f7a2-bc1c-422a-80c0-30ad314ca163 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:31.753310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2ca1d-d1e7-4926-9f36-e5b462ee29ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:31.753967 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2ca1d-d1e7-4926-9f36-e5b462ee29ad None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:31.754250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2ca1d-d1e7-4926-9f36-e5b462ee29ad None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:31.754526 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2ca1d-d1e7-4926-9f36-e5b462ee29ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:31.755365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2ca1d-d1e7-4926-9f36-e5b462ee29ad None admin] RBAC: Adding query filter params (group.id=6328aaa5c36642c48b34837f640c94da, role.id=4a3588df731c452fba80b071fc342f78, scope.project.id=10c2fefd8bd2453d918573810f1d5ecb) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:31.755663 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2ca1d-d1e7-4926-9f36-e5b462ee29ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:31.757129 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2ca1d-d1e7-4926-9f36-e5b462ee29ad None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:31.762728 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 220/450] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Apr 14 21:35:31 2022] GET /identity/v3/role_assignments?group.id=6328aaa5c36642c48b34837f640c94da&scope.project.id=10c2fefd8bd2453d918573810f1d5ecb&role.id=4a3588df731c452fba80b071fc342f78 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:31.803479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc682da5-596b-40be-9b0f-fc571a4f1423 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:31.839407 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3250fb-1bd0-4f9a-b9fc-0a1e797e8926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:31.840086 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3250fb-1bd0-4f9a-b9fc-0a1e797e8926 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:31.840365 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3250fb-1bd0-4f9a-b9fc-0a1e797e8926 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:31.840671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3250fb-1bd0-4f9a-b9fc-0a1e797e8926 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:31.841437 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3250fb-1bd0-4f9a-b9fc-0a1e797e8926 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:31.841744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3250fb-1bd0-4f9a-b9fc-0a1e797e8926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:31.843176 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3250fb-1bd0-4f9a-b9fc-0a1e797e8926 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:31.852248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 231/451] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:31.858087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2ca1d-d1e7-4926-9f36-e5b462ee29ad None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:31.960063 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2ca1d-d1e7-4926-9f36-e5b462ee29ad None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:31.995180 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74b438-cb6f-4bcb-931b-345c8f357e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:31.995656 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74b438-cb6f-4bcb-931b-345c8f357e99 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:31.995938 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74b438-cb6f-4bcb-931b-345c8f357e99 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:31.996215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74b438-cb6f-4bcb-931b-345c8f357e99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:32.062542 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74b438-cb6f-4bcb-931b-345c8f357e99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:32.064747 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74b438-cb6f-4bcb-931b-345c8f357e99 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:32.160603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 221/452] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:32.166570 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3250fb-1bd0-4f9a-b9fc-0a1e797e8926 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:32.268801 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3250fb-1bd0-4f9a-b9fc-0a1e797e8926 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:32.302167 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d6c06-1d10-4e14-b703-991d0cf5b3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:32.303019 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d6c06-1d10-4e14-b703-991d0cf5b3d5 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:32.303302 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d6c06-1d10-4e14-b703-991d0cf5b3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:32.303577 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d6c06-1d10-4e14-b703-991d0cf5b3d5 None admin] PATH_INFO: `/v3/projects/a2a4691b0f66431db71e4f1cd4001c61` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:32.304789 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d6c06-1d10-4e14-b703-991d0cf5b3d5 None admin] RBAC: Authorizing `identity:get_project(project_id=a2a4691b0f66431db71e4f1cd4001c61)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:32.306237 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d6c06-1d10-4e14-b703-991d0cf5b3d5 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:32.307945 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 232/453] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:35:32 2022] GET /identity/v3/projects/a2a4691b0f66431db71e4f1cd4001c61 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:32.313588 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74b438-cb6f-4bcb-931b-345c8f357e99 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:32.405425 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74b438-cb6f-4bcb-931b-345c8f357e99 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:32.438051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd1c02-7780-49a6-b8d1-db014931011b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:32.439320 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1c02-7780-49a6-b8d1-db014931011b None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:32.439596 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1c02-7780-49a6-b8d1-db014931011b None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:32.439869 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1c02-7780-49a6-b8d1-db014931011b None admin] PATH_INFO: `/v3/groups/016838dd035149a182f761bcf15b0601` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:32.441049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd1c02-7780-49a6-b8d1-db014931011b None admin] RBAC: Authorizing `identity:get_group(group_id=016838dd035149a182f761bcf15b0601)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:32.442471 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd1c02-7780-49a6-b8d1-db014931011b None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:32.444060 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 222/454] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Apr 14 21:35:32 2022] GET /identity/v3/groups/016838dd035149a182f761bcf15b0601 => generated 229 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:32.449857 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d6c06-1d10-4e14-b703-991d0cf5b3d5 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:32.544115 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d6c06-1d10-4e14-b703-991d0cf5b3d5 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:32.576050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e937b-1373-473c-9023-7ab28593884d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:32.576714 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e937b-1373-473c-9023-7ab28593884d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:32.576998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e937b-1373-473c-9023-7ab28593884d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:32.577274 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e937b-1373-473c-9023-7ab28593884d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:32.578101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e937b-1373-473c-9023-7ab28593884d None admin] RBAC: Adding query filter params (group.id=016838dd035149a182f761bcf15b0601, role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=a2a4691b0f66431db71e4f1cd4001c61) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:32.578416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e937b-1373-473c-9023-7ab28593884d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:32.579942 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e937b-1373-473c-9023-7ab28593884d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:32.585551 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 233/455] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Apr 14 21:35:32 2022] GET /identity/v3/role_assignments?group.id=016838dd035149a182f761bcf15b0601&scope.project.id=a2a4691b0f66431db71e4f1cd4001c61&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:35.424549 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd693318-4c01-46be-940f-bf0c204d58d2 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:35.425088 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd693318-4c01-46be-940f-bf0c204d58d2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:35.425088 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd693318-4c01-46be-940f-bf0c204d58d2 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:35.426731 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 223/456] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:35.432223 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5bc18-61c4-4250-a8be-479388479ef8 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:35.432674 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5bc18-61c4-4250-a8be-479388479ef8 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:35.432852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5bc18-61c4-4250-a8be-479388479ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:35.454137 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-a4c5bc18-61c4-4250-a8be-479388479ef8 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:35.455363 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-a4c5bc18-61c4-4250-a8be-479388479ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:35.502179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91cbfc-bdfd-4c3e-8868-b7e333477aae None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:35.502791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91cbfc-bdfd-4c3e-8868-b7e333477aae None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:35.503263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91cbfc-bdfd-4c3e-8868-b7e333477aae None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:35.505128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 224/457] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:35.513609 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1713379-9154-4bfc-a011-e293deab574d None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:35.514169 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1713379-9154-4bfc-a011-e293deab574d None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:35.514664 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1713379-9154-4bfc-a011-e293deab574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:35.535733 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-a1713379-9154-4bfc-a011-e293deab574d None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:35.537299 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a1713379-9154-4bfc-a011-e293deab574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:35.560437 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 234/458] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:35.601917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5bc18-61c4-4250-a8be-479388479ef8 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:35.631718 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 225/459] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:35.657645 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1713379-9154-4bfc-a011-e293deab574d None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:35.791662 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5bc18-61c4-4250-a8be-479388479ef8 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:35.827842 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1713379-9154-4bfc-a011-e293deab574d None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:35.835366 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ec48a-f1f4-4c50-a2f4-8158fd41ab68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:35.837209 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ec48a-f1f4-4c50-a2f4-8158fd41ab68 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:35.837699 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ec48a-f1f4-4c50-a2f4-8158fd41ab68 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:35.838546 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ec48a-f1f4-4c50-a2f4-8158fd41ab68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:35.853386 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ec48a-f1f4-4c50-a2f4-8158fd41ab68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:35.854852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ec48a-f1f4-4c50-a2f4-8158fd41ab68 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:35.867299 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721733e0-bace-45e9-aa71-797b131d9c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:35.867856 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721733e0-bace-45e9-aa71-797b131d9c53 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:35.868134 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721733e0-bace-45e9-aa71-797b131d9c53 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:35.868405 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721733e0-bace-45e9-aa71-797b131d9c53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:35.878868 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-755ec48a-f1f4-4c50-a2f4-8158fd41ab68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:35.879051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721733e0-bace-45e9-aa71-797b131d9c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:35.880768 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 235/460] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:35.882188 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2d34-a953-491b-9723-d7c11f79129a None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:35.882650 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2d34-a953-491b-9723-d7c11f79129a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:35.883102 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2d34-a953-491b-9723-d7c11f79129a None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:35.884842 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 236/461] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:35.884948 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721733e0-bace-45e9-aa71-797b131d9c53 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:35.888990 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2d34-a953-491b-9723-d7c11f79129a None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:35.910675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-721733e0-bace-45e9-aa71-797b131d9c53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:35.912912 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 226/462] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:35.918053 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea680255-64bc-4270-a9fd-452b8fe56a21 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:35.918169 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea680255-64bc-4270-a9fd-452b8fe56a21 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:35.918556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea680255-64bc-4270-a9fd-452b8fe56a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:35.939162 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-ea680255-64bc-4270-a9fd-452b8fe56a21 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:35.941129 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ea680255-64bc-4270-a9fd-452b8fe56a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:36.005379 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2d34-a953-491b-9723-d7c11f79129a None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:36.036913 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 227/463] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:36.038058 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea680255-64bc-4270-a9fd-452b8fe56a21 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:36.043714 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f7a7c-14b2-42ae-b4c5-f0de2486d4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:36.044468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f7a7c-14b2-42ae-b4c5-f0de2486d4a3 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:36.044874 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f7a7c-14b2-42ae-b4c5-f0de2486d4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:36.045246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f7a7c-14b2-42ae-b4c5-f0de2486d4a3 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:36.046248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f7a7c-14b2-42ae-b4c5-f0de2486d4a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:36.046659 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f7a7c-14b2-42ae-b4c5-f0de2486d4a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:36.052635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f7a7c-14b2-42ae-b4c5-f0de2486d4a3 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:36.069329 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 237/464] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:36.074004 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff412ba-78d5-4113-a175-0e9deec2daed None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:36.074285 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff412ba-78d5-4113-a175-0e9deec2daed None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:36.074557 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff412ba-78d5-4113-a175-0e9deec2daed None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:36.076071 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 238/465] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:36.076711 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff412ba-78d5-4113-a175-0e9deec2daed None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:36.157707 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea680255-64bc-4270-a9fd-452b8fe56a21 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:36.175525 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff412ba-78d5-4113-a175-0e9deec2daed None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:36.193557 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61442d63-3fcb-4dbd-b410-614ac54f96f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:36.194230 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61442d63-3fcb-4dbd-b410-614ac54f96f0 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:36.194511 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61442d63-3fcb-4dbd-b410-614ac54f96f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:36.194787 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61442d63-3fcb-4dbd-b410-614ac54f96f0 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:36.195512 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61442d63-3fcb-4dbd-b410-614ac54f96f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:36.195820 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61442d63-3fcb-4dbd-b410-614ac54f96f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:36.197216 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61442d63-3fcb-4dbd-b410-614ac54f96f0 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:36.209015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 228/466] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:36.209894 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61442d63-3fcb-4dbd-b410-614ac54f96f0 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:36.216135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887d131-81df-462c-a431-82e915658c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:36.217177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887d131-81df-462c-a431-82e915658c0f None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:36.217464 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887d131-81df-462c-a431-82e915658c0f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:36.217739 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887d131-81df-462c-a431-82e915658c0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:36.227936 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887d131-81df-462c-a431-82e915658c0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:36.229422 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887d131-81df-462c-a431-82e915658c0f None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:36.246187 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-b887d131-81df-462c-a431-82e915658c0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:36.247584 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 239/467] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:36.248632 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd124aa4-adad-4e23-af45-e1bde85c4677 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:36.248918 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd124aa4-adad-4e23-af45-e1bde85c4677 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:36.249193 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd124aa4-adad-4e23-af45-e1bde85c4677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:36.265763 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-dd124aa4-adad-4e23-af45-e1bde85c4677 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:36.267721 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-dd124aa4-adad-4e23-af45-e1bde85c4677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:36.321438 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61442d63-3fcb-4dbd-b410-614ac54f96f0 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:36.339250 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 240/468] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:36.340415 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd124aa4-adad-4e23-af45-e1bde85c4677 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:36.358086 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b5194-4a88-4bf4-9544-cf67f1beaa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:36.358763 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b5194-4a88-4bf4-9544-cf67f1beaa64 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:36.359046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b5194-4a88-4bf4-9544-cf67f1beaa64 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:36.359324 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b5194-4a88-4bf4-9544-cf67f1beaa64 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:36.360077 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b5194-4a88-4bf4-9544-cf67f1beaa64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:36.361661 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b5194-4a88-4bf4-9544-cf67f1beaa64 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:36.440645 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 229/469] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:35:36 2022] POST /identity/v3/users => generated 248 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:35:36.441567 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b5194-4a88-4bf4-9544-cf67f1beaa64 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:36.442200 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd124aa4-adad-4e23-af45-e1bde85c4677 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:36.492787 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114eadb-99c1-43c8-be44-e39fbaf87ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:36.493924 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114eadb-99c1-43c8-be44-e39fbaf87ec4 None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:36.494426 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114eadb-99c1-43c8-be44-e39fbaf87ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:36.494891 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114eadb-99c1-43c8-be44-e39fbaf87ec4 None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:36.495801 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114eadb-99c1-43c8-be44-e39fbaf87ec4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:36.497548 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114eadb-99c1-43c8-be44-e39fbaf87ec4 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:36.567189 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b5194-4a88-4bf4-9544-cf67f1beaa64 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:36.595736 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 241/470] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:35:36 2022] POST /identity/v3/users => generated 246 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:35:36.597494 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114eadb-99c1-43c8-be44-e39fbaf87ec4 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:36.629689 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d0d52-3440-46db-b9bf-c0c911515672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:36.631005 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d0d52-3440-46db-b9bf-c0c911515672 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:36.633043 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d0d52-3440-46db-b9bf-c0c911515672 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:36.633334 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d0d52-3440-46db-b9bf-c0c911515672 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:36.634143 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d0d52-3440-46db-b9bf-c0c911515672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:36.634462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d0d52-3440-46db-b9bf-c0c911515672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:36.635906 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d0d52-3440-46db-b9bf-c0c911515672 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:36.659773 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 230/471] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:36.666727 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d0d52-3440-46db-b9bf-c0c911515672 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:36.746392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114eadb-99c1-43c8-be44-e39fbaf87ec4 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:36.778834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d0d52-3440-46db-b9bf-c0c911515672 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:36.784626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4583a-cee0-4d8b-990b-3af376f25288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:36.785774 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4583a-cee0-4d8b-990b-3af376f25288 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:36.786286 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4583a-cee0-4d8b-990b-3af376f25288 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:36.786761 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4583a-cee0-4d8b-990b-3af376f25288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:36.798158 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4583a-cee0-4d8b-990b-3af376f25288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:36.799992 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4583a-cee0-4d8b-990b-3af376f25288 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:36.815911 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06836178-3d03-40e6-b4a9-21aa9e905142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:36.816610 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06836178-3d03-40e6-b4a9-21aa9e905142 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:36.816903 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06836178-3d03-40e6-b4a9-21aa9e905142 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:36.817177 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06836178-3d03-40e6-b4a9-21aa9e905142 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:36.817901 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06836178-3d03-40e6-b4a9-21aa9e905142 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:36.819349 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06836178-3d03-40e6-b4a9-21aa9e905142 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:36.821439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-aec4583a-cee0-4d8b-990b-3af376f25288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:36.823180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 242/472] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:36.830858 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4583a-cee0-4d8b-990b-3af376f25288 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:36.923495 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 231/473] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:35:36 2022] POST /identity/v3/users => generated 248 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:35:36.951423 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4583a-cee0-4d8b-990b-3af376f25288 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:36.995386 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35e7c6-aa2d-4288-9ca9-ea2944cbbd80 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:36.995806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35e7c6-aa2d-4288-9ca9-ea2944cbbd80 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:36.996235 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35e7c6-aa2d-4288-9ca9-ea2944cbbd80 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:36.996836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ca993-b88a-4f77-a3c9-2f15d7fffe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:36.997712 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ca993-b88a-4f77-a3c9-2f15d7fffe8c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:36.998027 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 232/474] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:36.998363 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ca993-b88a-4f77-a3c9-2f15d7fffe8c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:36.998770 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ca993-b88a-4f77-a3c9-2f15d7fffe8c None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:36.999706 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ca993-b88a-4f77-a3c9-2f15d7fffe8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:37.000751 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ca993-b88a-4f77-a3c9-2f15d7fffe8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:37.002413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ca993-b88a-4f77-a3c9-2f15d7fffe8c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:37.004514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a125344-5a99-4c9f-b765-d6fbe85f92f5 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:37.004866 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a125344-5a99-4c9f-b765-d6fbe85f92f5 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:37.005144 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a125344-5a99-4c9f-b765-d6fbe85f92f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:37.020371 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 243/475] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:37.023496 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ca993-b88a-4f77-a3c9-2f15d7fffe8c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:37.049480 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-3a125344-5a99-4c9f-b765-d6fbe85f92f5 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:37.050716 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-3a125344-5a99-4c9f-b765-d6fbe85f92f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:37.166585 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ca993-b88a-4f77-a3c9-2f15d7fffe8c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:37.187399 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 233/476] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:37.214527 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301e256-8977-4227-8d94-f78d279bf8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:37.215441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301e256-8977-4227-8d94-f78d279bf8bb None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:37.215891 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301e256-8977-4227-8d94-f78d279bf8bb None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:37.216324 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301e256-8977-4227-8d94-f78d279bf8bb None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:37.217416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301e256-8977-4227-8d94-f78d279bf8bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:37.218183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a125344-5a99-4c9f-b765-d6fbe85f92f5 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:37.219540 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301e256-8977-4227-8d94-f78d279bf8bb None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:37.322818 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a125344-5a99-4c9f-b765-d6fbe85f92f5 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:37.337123 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 244/477] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:35:37 2022] POST /identity/v3/users => generated 249 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:35:37.365342 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4885a-950f-45db-b7a4-d6f150bf1b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:37.366379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4885a-950f-45db-b7a4-d6f150bf1b09 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:37.366808 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4885a-950f-45db-b7a4-d6f150bf1b09 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:37.367223 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4885a-950f-45db-b7a4-d6f150bf1b09 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:37.368196 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4885a-950f-45db-b7a4-d6f150bf1b09 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:37.369774 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4885a-950f-45db-b7a4-d6f150bf1b09 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:37.408654 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.sql.core [None req-13f4885a-950f-45db-b7a4-d6f150bf1b09 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 14 21:35:37.408654 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 14 21:35:37.408654 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [parameters: {'id': '9c63634e2a544ce98a73b8f51c5a253c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 14 21:35:37.408654 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86771) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 14 21:35:37.424028 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-13f4885a-950f-45db-b7a4-d6f150bf1b09 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 14 21:35:37.433323 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 234/478] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Apr 14 21:35:37 2022] POST /identity/v3/roles => generated 144 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:37.440089 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301e256-8977-4227-8d94-f78d279bf8bb None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:37.556340 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301e256-8977-4227-8d94-f78d279bf8bb None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:37.607680 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cb196-1234-4b9a-a821-7b6af6868f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:37.608497 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cb196-1234-4b9a-a821-7b6af6868f91 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:37.608798 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cb196-1234-4b9a-a821-7b6af6868f91 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:37.609069 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cb196-1234-4b9a-a821-7b6af6868f91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:37.619969 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cb196-1234-4b9a-a821-7b6af6868f91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:37.627914 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-d89cb196-1234-4b9a-a821-7b6af6868f91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 14 21:35:37.629495 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 245/479] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:35:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:37.634778 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4885a-950f-45db-b7a4-d6f150bf1b09 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:37.743488 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4885a-950f-45db-b7a4-d6f150bf1b09 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:37.782514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d3e08-1445-42e4-a960-a0dd09ed9c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:37.783203 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d3e08-1445-42e4-a960-a0dd09ed9c61 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:37.783481 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d3e08-1445-42e4-a960-a0dd09ed9c61 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:37.783751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d3e08-1445-42e4-a960-a0dd09ed9c61 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:37.784512 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d3e08-1445-42e4-a960-a0dd09ed9c61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:37.784851 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d3e08-1445-42e4-a960-a0dd09ed9c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:37.786241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d3e08-1445-42e4-a960-a0dd09ed9c61 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:37.796213 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 235/480] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:39.314581 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d38c2e-ac6e-4a61-af05-174b68bc33c2 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:39.315079 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d38c2e-ac6e-4a61-af05-174b68bc33c2 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:39.315079 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d38c2e-ac6e-4a61-af05-174b68bc33c2 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:39.316834 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 246/481] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:39.334461 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d6377-d881-44c3-8615-c0866d974898 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:39.335402 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d6377-d881-44c3-8615-c0866d974898 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:39.335876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d6377-d881-44c3-8615-c0866d974898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:39.357614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-a76d6377-d881-44c3-8615-c0866d974898 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:39.358833 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a76d6377-d881-44c3-8615-c0866d974898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:39.443933 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58551fef-82c5-4ccb-9647-827b19dea9b1 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:39.444571 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58551fef-82c5-4ccb-9647-827b19dea9b1 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:39.445066 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58551fef-82c5-4ccb-9647-827b19dea9b1 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:39.450499 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 247/482] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:39.452312 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01680151-4d5b-464a-8307-25a20a95d873 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:39.452851 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01680151-4d5b-464a-8307-25a20a95d873 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:39.453914 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01680151-4d5b-464a-8307-25a20a95d873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:39.460551 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 236/483] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:39.483758 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d6377-d881-44c3-8615-c0866d974898 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:39.489583 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-01680151-4d5b-464a-8307-25a20a95d873 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:39.490801 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-01680151-4d5b-464a-8307-25a20a95d873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:39.582061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d6377-d881-44c3-8615-c0866d974898 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:39.617938 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9d37c-4826-41aa-b262-7cf74bd972fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:39.618853 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9d37c-4826-41aa-b262-7cf74bd972fe None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:39.619131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9d37c-4826-41aa-b262-7cf74bd972fe None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:39.619399 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9d37c-4826-41aa-b262-7cf74bd972fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:39.630877 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9d37c-4826-41aa-b262-7cf74bd972fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:39.638127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-9fd9d37c-4826-41aa-b262-7cf74bd972fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:35:39.639811 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 237/484] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:39.646111 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9d37c-4826-41aa-b262-7cf74bd972fe None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:39.663459 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 248/485] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:35:39.709998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01680151-4d5b-464a-8307-25a20a95d873 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:39.747510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9d37c-4826-41aa-b262-7cf74bd972fe None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:39.792634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1668d-2926-4360-bdce-42ae2ccb3147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:39.793308 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1668d-2926-4360-bdce-42ae2ccb3147 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:39.793583 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1668d-2926-4360-bdce-42ae2ccb3147 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:39.793853 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1668d-2926-4360-bdce-42ae2ccb3147 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:39.794597 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1668d-2926-4360-bdce-42ae2ccb3147 None admin] RBAC: Adding query filter params (name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:39.794898 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1668d-2926-4360-bdce-42ae2ccb3147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:39.796283 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1668d-2926-4360-bdce-42ae2ccb3147 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:39.810470 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 238/486] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:35:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:39.812202 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22dce2-e30d-4795-adb0-dd455922f777 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:39.813231 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22dce2-e30d-4795-adb0-dd455922f777 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:39.813704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22dce2-e30d-4795-adb0-dd455922f777 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:39.818933 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 239/487] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:39.818933 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22dce2-e30d-4795-adb0-dd455922f777 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:39.868173 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01680151-4d5b-464a-8307-25a20a95d873 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:39.909898 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67107031-282e-4ba8-a6d6-fc5fd8c0b1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:39.913899 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67107031-282e-4ba8-a6d6-fc5fd8c0b1e3 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:39.913899 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67107031-282e-4ba8-a6d6-fc5fd8c0b1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:39.913899 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67107031-282e-4ba8-a6d6-fc5fd8c0b1e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:39.925414 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67107031-282e-4ba8-a6d6-fc5fd8c0b1e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:39.934976 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-67107031-282e-4ba8-a6d6-fc5fd8c0b1e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:35:39.936204 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22dce2-e30d-4795-adb0-dd455922f777 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:39.936616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 249/488] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:39.938854 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7848d-f35c-490c-8957-0add84bb1df1 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:39.938854 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7848d-f35c-490c-8957-0add84bb1df1 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:39.938854 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7848d-f35c-490c-8957-0add84bb1df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:39.958495 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-0ae7848d-f35c-490c-8957-0add84bb1df1 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:39.960168 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-0ae7848d-f35c-490c-8957-0add84bb1df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:39.996392 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93029272-1ded-41d3-a50e-24bb6862bd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:39.997351 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93029272-1ded-41d3-a50e-24bb6862bd88 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:39.997961 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93029272-1ded-41d3-a50e-24bb6862bd88 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:39.998751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93029272-1ded-41d3-a50e-24bb6862bd88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:40.013669 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93029272-1ded-41d3-a50e-24bb6862bd88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:40.016435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93029272-1ded-41d3-a50e-24bb6862bd88 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:40.039958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-93029272-1ded-41d3-a50e-24bb6862bd88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:40.041863 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 240/489] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:40.047804 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 250/490] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:40.048085 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93029272-1ded-41d3-a50e-24bb6862bd88 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:40.049140 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7848d-f35c-490c-8957-0add84bb1df1 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:40.167625 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7848d-f35c-490c-8957-0add84bb1df1 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:40.212247 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93029272-1ded-41d3-a50e-24bb6862bd88 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:40.215710 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1b7f1-787d-4d51-852b-7d914ae63a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:40.216661 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1b7f1-787d-4d51-852b-7d914ae63a89 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:40.217160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1b7f1-787d-4d51-852b-7d914ae63a89 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:40.217626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1b7f1-787d-4d51-852b-7d914ae63a89 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:40.218541 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1b7f1-787d-4d51-852b-7d914ae63a89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:40.220322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1b7f1-787d-4d51-852b-7d914ae63a89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:40.222472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1b7f1-787d-4d51-852b-7d914ae63a89 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:40.237065 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 251/491] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:40.241831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1b7f1-787d-4d51-852b-7d914ae63a89 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:40.255250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cb6c4-28c5-4d9d-80c9-acaa9278351c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:40.255930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cb6c4-28c5-4d9d-80c9-acaa9278351c None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:40.256214 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cb6c4-28c5-4d9d-80c9-acaa9278351c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:40.256491 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cb6c4-28c5-4d9d-80c9-acaa9278351c None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:40.257604 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cb6c4-28c5-4d9d-80c9-acaa9278351c None admin] RBAC: Adding query filter params (name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:40.257913 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cb6c4-28c5-4d9d-80c9-acaa9278351c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:40.259590 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cb6c4-28c5-4d9d-80c9-acaa9278351c None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:40.270150 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 241/492] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:35:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:40.276021 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cb6c4-28c5-4d9d-80c9-acaa9278351c None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:40.360847 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1b7f1-787d-4d51-852b-7d914ae63a89 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:40.394831 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cb6c4-28c5-4d9d-80c9-acaa9278351c None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:40.397104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4559b26-3be3-4d73-b8b2-0055bf5a64d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:40.397904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4559b26-3be3-4d73-b8b2-0055bf5a64d0 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:40.398895 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4559b26-3be3-4d73-b8b2-0055bf5a64d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:40.398895 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4559b26-3be3-4d73-b8b2-0055bf5a64d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:40.410292 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4559b26-3be3-4d73-b8b2-0055bf5a64d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:40.417446 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-c4559b26-3be3-4d73-b8b2-0055bf5a64d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:35:40.424016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 252/493] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:40.424840 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4559b26-3be3-4d73-b8b2-0055bf5a64d0 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:40.431738 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e84b5-b979-493a-887e-a19f5b3fb970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:40.432894 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e84b5-b979-493a-887e-a19f5b3fb970 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:40.433366 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e84b5-b979-493a-887e-a19f5b3fb970 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:40.433845 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e84b5-b979-493a-887e-a19f5b3fb970 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:40.442553 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e84b5-b979-493a-887e-a19f5b3fb970 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:40.444253 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e84b5-b979-493a-887e-a19f5b3fb970 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:40.458295 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-802e84b5-b979-493a-887e-a19f5b3fb970 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 14 21:35:40.464669 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 242/494] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:40.465782 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e84b5-b979-493a-887e-a19f5b3fb970 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:40.525864 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4559b26-3be3-4d73-b8b2-0055bf5a64d0 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:40.561411 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba91f71-56db-4dc5-b670-0b60a6445aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:40.562498 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba91f71-56db-4dc5-b670-0b60a6445aa7 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:40.562960 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba91f71-56db-4dc5-b670-0b60a6445aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:40.563439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba91f71-56db-4dc5-b670-0b60a6445aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:40.569294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e84b5-b979-493a-887e-a19f5b3fb970 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:40.574196 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba91f71-56db-4dc5-b670-0b60a6445aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:40.575681 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba91f71-56db-4dc5-b670-0b60a6445aa7 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:40.592309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-5ba91f71-56db-4dc5-b670-0b60a6445aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:40.598660 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 253/495] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:40.598660 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba91f71-56db-4dc5-b670-0b60a6445aa7 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:40.607658 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d990c-a8d2-40d5-982e-fcd3c28425ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:40.608413 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d990c-a8d2-40d5-982e-fcd3c28425ec None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:40.608726 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d990c-a8d2-40d5-982e-fcd3c28425ec None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:40.608997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d990c-a8d2-40d5-982e-fcd3c28425ec None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:40.610854 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d990c-a8d2-40d5-982e-fcd3c28425ec None admin] RBAC: Adding query filter params (name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:40.611160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d990c-a8d2-40d5-982e-fcd3c28425ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:40.612550 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d990c-a8d2-40d5-982e-fcd3c28425ec None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:40.620327 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 243/496] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:35:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:40.621586 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd1d58-9b77-47f8-b483-e7de3a8e194e None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:40.621871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd1d58-9b77-47f8-b483-e7de3a8e194e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:40.622129 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd1d58-9b77-47f8-b483-e7de3a8e194e None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:40.623510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 244/497] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:40.624001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd1d58-9b77-47f8-b483-e7de3a8e194e None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:40.703207 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba91f71-56db-4dc5-b670-0b60a6445aa7 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:40.726201 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd1d58-9b77-47f8-b483-e7de3a8e194e None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:40.739018 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb4788-e278-4ed3-a399-0b8ccc8e7a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:40.739698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb4788-e278-4ed3-a399-0b8ccc8e7a86 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:40.739971 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb4788-e278-4ed3-a399-0b8ccc8e7a86 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:40.740783 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb4788-e278-4ed3-a399-0b8ccc8e7a86 None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:40.741114 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb4788-e278-4ed3-a399-0b8ccc8e7a86 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:40.741905 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb4788-e278-4ed3-a399-0b8ccc8e7a86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:40.742855 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb4788-e278-4ed3-a399-0b8ccc8e7a86 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:40.760102 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29370897-1313-4bee-a1c7-88e0c2cd3ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:40.760791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29370897-1313-4bee-a1c7-88e0c2cd3ea9 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:40.761067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29370897-1313-4bee-a1c7-88e0c2cd3ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:40.761333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29370897-1313-4bee-a1c7-88e0c2cd3ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:40.762049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29370897-1313-4bee-a1c7-88e0c2cd3ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:40.762347 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29370897-1313-4bee-a1c7-88e0c2cd3ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:40.763709 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29370897-1313-4bee-a1c7-88e0c2cd3ea9 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:40.775862 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 245/498] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:40.776806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29370897-1313-4bee-a1c7-88e0c2cd3ea9 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:40.786909 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 254/499] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Apr 14 21:35:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:40.788914 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d0092-dae9-4d71-9d3e-a2643b688b13 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:40.789765 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d0092-dae9-4d71-9d3e-a2643b688b13 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:40.790270 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d0092-dae9-4d71-9d3e-a2643b688b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:40.807871 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-1e6d0092-dae9-4d71-9d3e-a2643b688b13 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:40.809113 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-1e6d0092-dae9-4d71-9d3e-a2643b688b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:40.884605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 255/500] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:40.884605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d0092-dae9-4d71-9d3e-a2643b688b13 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:40.884892 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29370897-1313-4bee-a1c7-88e0c2cd3ea9 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:40.919486 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0cd41-1e4b-45b2-ad52-1527b0ed28e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:40.920365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0cd41-1e4b-45b2-ad52-1527b0ed28e0 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:40.920669 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0cd41-1e4b-45b2-ad52-1527b0ed28e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:40.920938 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0cd41-1e4b-45b2-ad52-1527b0ed28e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:40.930672 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0cd41-1e4b-45b2-ad52-1527b0ed28e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:40.932164 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0cd41-1e4b-45b2-ad52-1527b0ed28e0 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:40.948312 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-80b0cd41-1e4b-45b2-ad52-1527b0ed28e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:40.949502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 246/501] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:40.950263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0cd41-1e4b-45b2-ad52-1527b0ed28e0 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:40.982108 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d0092-dae9-4d71-9d3e-a2643b688b13 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:41.021790 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f9293-5b32-425e-a7c2-248feeef185c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:41.022572 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f9293-5b32-425e-a7c2-248feeef185c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:41.022851 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f9293-5b32-425e-a7c2-248feeef185c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:41.023122 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f9293-5b32-425e-a7c2-248feeef185c None admin] PATH_INFO: `/v3/users/nova` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:41.030111 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f9293-5b32-425e-a7c2-248feeef185c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:41.032343 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f9293-5b32-425e-a7c2-248feeef185c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:41.045690 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-fc4f9293-5b32-425e-a7c2-248feeef185c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 14 21:35:41.046909 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 256/502] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Apr 14 21:35:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:41.047669 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f9293-5b32-425e-a7c2-248feeef185c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:41.055494 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0cd41-1e4b-45b2-ad52-1527b0ed28e0 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:41.088647 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c333a9a-bbae-4dfa-b90d-505e35a2cf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:41.089293 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c333a9a-bbae-4dfa-b90d-505e35a2cf90 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:41.089574 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c333a9a-bbae-4dfa-b90d-505e35a2cf90 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:41.089850 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c333a9a-bbae-4dfa-b90d-505e35a2cf90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:41.141968 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f9293-5b32-425e-a7c2-248feeef185c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:41.153689 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c333a9a-bbae-4dfa-b90d-505e35a2cf90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:41.155130 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c333a9a-bbae-4dfa-b90d-505e35a2cf90 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:41.173533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc98c5f-26c2-4f4f-acb9-0f7a6f981e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:41.174315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc98c5f-26c2-4f4f-acb9-0f7a6f981e09 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:41.174591 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc98c5f-26c2-4f4f-acb9-0f7a6f981e09 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:41.174865 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc98c5f-26c2-4f4f-acb9-0f7a6f981e09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:41.184415 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc98c5f-26c2-4f4f-acb9-0f7a6f981e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:41.191815 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-fcc98c5f-26c2-4f4f-acb9-0f7a6f981e09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:35:41.193020 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 257/503] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:41.194180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc82f5-8ab2-404e-b984-08dda216d89f None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:41.194454 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc82f5-8ab2-404e-b984-08dda216d89f None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:41.194722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc82f5-8ab2-404e-b984-08dda216d89f None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:41.195957 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 258/504] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:41.196645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc82f5-8ab2-404e-b984-08dda216d89f None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:41.252928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 247/505] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:41.253987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c333a9a-bbae-4dfa-b90d-505e35a2cf90 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:41.293688 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc82f5-8ab2-404e-b984-08dda216d89f None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:41.325398 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf6ecc-fedf-47b4-a533-18553beced1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:41.326052 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf6ecc-fedf-47b4-a533-18553beced1f None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:41.326341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf6ecc-fedf-47b4-a533-18553beced1f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:41.326611 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf6ecc-fedf-47b4-a533-18553beced1f None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:41.327331 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf6ecc-fedf-47b4-a533-18553beced1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:41.327639 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf6ecc-fedf-47b4-a533-18553beced1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:41.329150 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf6ecc-fedf-47b4-a533-18553beced1f None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:41.340751 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 259/506] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:41.341368 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf6ecc-fedf-47b4-a533-18553beced1f None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:41.349560 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c333a9a-bbae-4dfa-b90d-505e35a2cf90 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:41.382357 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89413828-fddc-4b28-b21e-47f0c76977f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:41.383018 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89413828-fddc-4b28-b21e-47f0c76977f1 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:41.383297 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89413828-fddc-4b28-b21e-47f0c76977f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:41.383570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89413828-fddc-4b28-b21e-47f0c76977f1 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:41.384402 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89413828-fddc-4b28-b21e-47f0c76977f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:41.384740 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89413828-fddc-4b28-b21e-47f0c76977f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:41.386215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89413828-fddc-4b28-b21e-47f0c76977f1 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:41.422717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 248/507] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Apr 14 21:35:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:41.424080 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42822a6c-0ce9-46d6-89e8-b20686fecc97 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:41.424365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42822a6c-0ce9-46d6-89e8-b20686fecc97 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:41.424662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42822a6c-0ce9-46d6-89e8-b20686fecc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:41.435099 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf6ecc-fedf-47b4-a533-18553beced1f None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:41.441204 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-42822a6c-0ce9-46d6-89e8-b20686fecc97 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:41.442400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-42822a6c-0ce9-46d6-89e8-b20686fecc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:41.468405 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff7129-8bed-4fc2-aab1-9e0db14c5944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:41.469205 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff7129-8bed-4fc2-aab1-9e0db14c5944 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:41.469481 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff7129-8bed-4fc2-aab1-9e0db14c5944 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:41.469748 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff7129-8bed-4fc2-aab1-9e0db14c5944 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:41.470493 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff7129-8bed-4fc2-aab1-9e0db14c5944 None admin] RBAC: Adding query filter params (name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:41.470799 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff7129-8bed-4fc2-aab1-9e0db14c5944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:41.472159 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff7129-8bed-4fc2-aab1-9e0db14c5944 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:41.479775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 260/508] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:35:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:41.480555 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff7129-8bed-4fc2-aab1-9e0db14c5944 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:41.506203 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 249/509] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:41.506974 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42822a6c-0ce9-46d6-89e8-b20686fecc97 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:41.583377 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff7129-8bed-4fc2-aab1-9e0db14c5944 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:41.601332 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42822a6c-0ce9-46d6-89e8-b20686fecc97 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:41.615528 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793fa1f-8e6c-40e7-8363-0eb6e81887f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:41.616315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793fa1f-8e6c-40e7-8363-0eb6e81887f6 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:41.616612 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793fa1f-8e6c-40e7-8363-0eb6e81887f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:41.616883 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793fa1f-8e6c-40e7-8363-0eb6e81887f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:41.627647 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793fa1f-8e6c-40e7-8363-0eb6e81887f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:41.629139 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793fa1f-8e6c-40e7-8363-0eb6e81887f6 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:41.635132 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ca7a4-abf3-46a2-9911-2c8c26e7f65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:41.635913 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ca7a4-abf3-46a2-9911-2c8c26e7f65b None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:41.636189 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ca7a4-abf3-46a2-9911-2c8c26e7f65b None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:41.636456 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ca7a4-abf3-46a2-9911-2c8c26e7f65b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:41.644231 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ca7a4-abf3-46a2-9911-2c8c26e7f65b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:41.645189 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-0793fa1f-8e6c-40e7-8363-0eb6e81887f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:41.645677 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ca7a4-abf3-46a2-9911-2c8c26e7f65b None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:41.646607 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 261/510] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:41.647123 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793fa1f-8e6c-40e7-8363-0eb6e81887f6 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:41.660341 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-878ca7a4-abf3-46a2-9911-2c8c26e7f65b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 14 21:35:41.661703 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 250/511] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:41.662313 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ca7a4-abf3-46a2-9911-2c8c26e7f65b None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:41.742639 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793fa1f-8e6c-40e7-8363-0eb6e81887f6 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:41.755904 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ca7a4-abf3-46a2-9911-2c8c26e7f65b None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:41.774200 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbf551-696d-4817-94fd-a129a51b3c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:41.774782 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbf551-696d-4817-94fd-a129a51b3c2d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:41.775069 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbf551-696d-4817-94fd-a129a51b3c2d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:41.775339 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbf551-696d-4817-94fd-a129a51b3c2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:41.787793 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8863006-2471-42cd-83fa-7b75f36f4699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:41.788596 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8863006-2471-42cd-83fa-7b75f36f4699 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:41.788889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8863006-2471-42cd-83fa-7b75f36f4699 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:41.789160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8863006-2471-42cd-83fa-7b75f36f4699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:41.799249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8863006-2471-42cd-83fa-7b75f36f4699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:41.800788 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8863006-2471-42cd-83fa-7b75f36f4699 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:41.817646 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-a8863006-2471-42cd-83fa-7b75f36f4699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:41.818834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 251/512] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:41.819667 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8863006-2471-42cd-83fa-7b75f36f4699 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:41.840376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbf551-696d-4817-94fd-a129a51b3c2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:41.841875 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbf551-696d-4817-94fd-a129a51b3c2d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:41.913305 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8863006-2471-42cd-83fa-7b75f36f4699 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:41.933581 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 262/513] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:41.934424 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbf551-696d-4817-94fd-a129a51b3c2d None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:41.945928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584f356-3053-4248-8d1c-22fd4ad79162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:41.946722 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f356-3053-4248-8d1c-22fd4ad79162 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:41.947002 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f356-3053-4248-8d1c-22fd4ad79162 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:41.947277 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f356-3053-4248-8d1c-22fd4ad79162 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:41.957826 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584f356-3053-4248-8d1c-22fd4ad79162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:41.959285 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584f356-3053-4248-8d1c-22fd4ad79162 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:41.975918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-e584f356-3053-4248-8d1c-22fd4ad79162 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:41.977160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 252/514] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:41.977937 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584f356-3053-4248-8d1c-22fd4ad79162 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:42.032142 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbf551-696d-4817-94fd-a129a51b3c2d None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:42.063829 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4904c-2caf-45f4-9ae7-5ec3afea08e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:42.064479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4904c-2caf-45f4-9ae7-5ec3afea08e5 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:42.064775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4904c-2caf-45f4-9ae7-5ec3afea08e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:42.065047 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4904c-2caf-45f4-9ae7-5ec3afea08e5 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:42.065757 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4904c-2caf-45f4-9ae7-5ec3afea08e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:42.066057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4904c-2caf-45f4-9ae7-5ec3afea08e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:42.067424 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4904c-2caf-45f4-9ae7-5ec3afea08e5 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:42.074152 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584f356-3053-4248-8d1c-22fd4ad79162 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:42.077918 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 263/515] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:42.079589 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4904c-2caf-45f4-9ae7-5ec3afea08e5 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:42.107232 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889056a-d4f9-4746-96a0-4f34efd2c446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:42.107890 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889056a-d4f9-4746-96a0-4f34efd2c446 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:42.108170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889056a-d4f9-4746-96a0-4f34efd2c446 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:42.108444 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889056a-d4f9-4746-96a0-4f34efd2c446 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:42.109352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889056a-d4f9-4746-96a0-4f34efd2c446 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:42.109651 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889056a-d4f9-4746-96a0-4f34efd2c446 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:42.111069 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889056a-d4f9-4746-96a0-4f34efd2c446 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:42.127981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 253/516] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Apr 14 21:35:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:42.128807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889056a-d4f9-4746-96a0-4f34efd2c446 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:42.174184 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4904c-2caf-45f4-9ae7-5ec3afea08e5 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:42.206463 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab0120-8526-49c9-a0a2-4b6ddf348e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:42.207198 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab0120-8526-49c9-a0a2-4b6ddf348e63 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:42.207411 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab0120-8526-49c9-a0a2-4b6ddf348e63 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:42.207681 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab0120-8526-49c9-a0a2-4b6ddf348e63 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:42.208398 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab0120-8526-49c9-a0a2-4b6ddf348e63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:42.208738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab0120-8526-49c9-a0a2-4b6ddf348e63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:42.210105 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab0120-8526-49c9-a0a2-4b6ddf348e63 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:42.222125 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 264/517] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:42.222339 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889056a-d4f9-4746-96a0-4f34efd2c446 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:42.222915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab0120-8526-49c9-a0a2-4b6ddf348e63 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:42.254965 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca57693-08dc-4d87-9fb0-e3161c097668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:42.255744 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca57693-08dc-4d87-9fb0-e3161c097668 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:42.256022 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca57693-08dc-4d87-9fb0-e3161c097668 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:42.256291 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca57693-08dc-4d87-9fb0-e3161c097668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:42.266519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca57693-08dc-4d87-9fb0-e3161c097668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:42.268033 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca57693-08dc-4d87-9fb0-e3161c097668 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:42.284491 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-0ca57693-08dc-4d87-9fb0-e3161c097668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:42.285635 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 254/518] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:42.286397 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca57693-08dc-4d87-9fb0-e3161c097668 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:42.319183 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab0120-8526-49c9-a0a2-4b6ddf348e63 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:42.350807 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224b0cd-8522-411e-9380-0a0cd868b1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:42.351462 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224b0cd-8522-411e-9380-0a0cd868b1c3 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:42.351745 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224b0cd-8522-411e-9380-0a0cd868b1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:42.352020 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224b0cd-8522-411e-9380-0a0cd868b1c3 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:42.352764 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224b0cd-8522-411e-9380-0a0cd868b1c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:42.353071 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224b0cd-8522-411e-9380-0a0cd868b1c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:42.354435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224b0cd-8522-411e-9380-0a0cd868b1c3 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:42.365796 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 265/519] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:42.366608 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224b0cd-8522-411e-9380-0a0cd868b1c3 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:42.380371 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca57693-08dc-4d87-9fb0-e3161c097668 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:42.412820 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed705a0-015a-45e1-8c88-4841ae35f2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:42.413602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed705a0-015a-45e1-8c88-4841ae35f2ec None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:42.413882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed705a0-015a-45e1-8c88-4841ae35f2ec None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:42.414151 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed705a0-015a-45e1-8c88-4841ae35f2ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:42.420592 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed705a0-015a-45e1-8c88-4841ae35f2ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:42.422638 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed705a0-015a-45e1-8c88-4841ae35f2ec None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:42.435782 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-5ed705a0-015a-45e1-8c88-4841ae35f2ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:35:42.437036 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 255/520] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:42.438028 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed705a0-015a-45e1-8c88-4841ae35f2ec None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:42.462025 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224b0cd-8522-411e-9380-0a0cd868b1c3 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:42.493682 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbf559-ed9d-414a-8daf-b6dc6bbf217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:42.494331 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbf559-ed9d-414a-8daf-b6dc6bbf217f None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:42.494611 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbf559-ed9d-414a-8daf-b6dc6bbf217f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:42.494884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbf559-ed9d-414a-8daf-b6dc6bbf217f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:42.534023 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed705a0-015a-45e1-8c88-4841ae35f2ec None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:42.557490 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbf559-ed9d-414a-8daf-b6dc6bbf217f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:42.558884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbf559-ed9d-414a-8daf-b6dc6bbf217f None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:42.565197 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9e899-2256-47d5-9087-4c6689911e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:42.565975 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9e899-2256-47d5-9087-4c6689911e84 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:42.566255 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9e899-2256-47d5-9087-4c6689911e84 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:42.566522 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9e899-2256-47d5-9087-4c6689911e84 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:42.573665 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9e899-2256-47d5-9087-4c6689911e84 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:42.575084 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9e899-2256-47d5-9087-4c6689911e84 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:42.589461 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-eef9e899-2256-47d5-9087-4c6689911e84 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 14 21:35:42.590607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 256/521] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:42.591656 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9e899-2256-47d5-9087-4c6689911e84 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:42.652394 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 266/522] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:42.653253 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbf559-ed9d-414a-8daf-b6dc6bbf217f None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:42.684853 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9e899-2256-47d5-9087-4c6689911e84 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:42.717525 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2641305-73c5-4a3f-9186-5fc57ea9f1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:42.718175 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2641305-73c5-4a3f-9186-5fc57ea9f1df None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:42.718448 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2641305-73c5-4a3f-9186-5fc57ea9f1df None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:42.718847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2641305-73c5-4a3f-9186-5fc57ea9f1df None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:42.719837 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2641305-73c5-4a3f-9186-5fc57ea9f1df None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:42.720142 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2641305-73c5-4a3f-9186-5fc57ea9f1df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:42.721525 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2641305-73c5-4a3f-9186-5fc57ea9f1df None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:42.732485 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 257/523] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:42.733284 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2641305-73c5-4a3f-9186-5fc57ea9f1df None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:42.746938 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbf559-ed9d-414a-8daf-b6dc6bbf217f None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:42.779751 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a0365-52ad-45df-911e-dfe2f19d5bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:42.780410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a0365-52ad-45df-911e-dfe2f19d5bfe None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:42.780718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a0365-52ad-45df-911e-dfe2f19d5bfe None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:42.780993 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a0365-52ad-45df-911e-dfe2f19d5bfe None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:42.781845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a0365-52ad-45df-911e-dfe2f19d5bfe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:42.783291 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a0365-52ad-45df-911e-dfe2f19d5bfe None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:42.829585 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2641305-73c5-4a3f-9186-5fc57ea9f1df None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:42.861493 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0b6e6-1abe-42bb-9e90-7ca9cfeb5bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:42.862134 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0b6e6-1abe-42bb-9e90-7ca9cfeb5bc6 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:42.862411 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0b6e6-1abe-42bb-9e90-7ca9cfeb5bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:42.862679 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0b6e6-1abe-42bb-9e90-7ca9cfeb5bc6 None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:42.863449 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0b6e6-1abe-42bb-9e90-7ca9cfeb5bc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:42.863749 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0b6e6-1abe-42bb-9e90-7ca9cfeb5bc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:42.865216 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0b6e6-1abe-42bb-9e90-7ca9cfeb5bc6 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:42.882466 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 258/524] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:35:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:42.883241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0b6e6-1abe-42bb-9e90-7ca9cfeb5bc6 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:42.894687 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 267/525] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:35:42 2022] POST /identity/v3/users => generated 247 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:35:42.895515 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a0365-52ad-45df-911e-dfe2f19d5bfe None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:43.008646 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0b6e6-1abe-42bb-9e90-7ca9cfeb5bc6 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:43.037016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a0365-52ad-45df-911e-dfe2f19d5bfe None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:43.061359 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058111c1-4615-442d-b08e-774e50fbeb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:43.062119 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058111c1-4615-442d-b08e-774e50fbeb56 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:43.063123 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058111c1-4615-442d-b08e-774e50fbeb56 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:43.063584 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058111c1-4615-442d-b08e-774e50fbeb56 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:43.064450 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058111c1-4615-442d-b08e-774e50fbeb56 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:43.064801 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058111c1-4615-442d-b08e-774e50fbeb56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:43.066389 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058111c1-4615-442d-b08e-774e50fbeb56 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:43.079061 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f00255-f235-43bd-8f67-ea28dd284657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:43.079984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f00255-f235-43bd-8f67-ea28dd284657 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:43.080084 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f00255-f235-43bd-8f67-ea28dd284657 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:43.081198 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f00255-f235-43bd-8f67-ea28dd284657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:43.092449 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f00255-f235-43bd-8f67-ea28dd284657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:43.094478 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f00255-f235-43bd-8f67-ea28dd284657 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:43.096786 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 259/526] 10.222.0.52 () {56 vars in 1139 bytes} [Thu Apr 14 21:35:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:43.098597 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058111c1-4615-442d-b08e-774e50fbeb56 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:43.115132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-f1f00255-f235-43bd-8f67-ea28dd284657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:43.119083 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 268/527] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:43.119083 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f00255-f235-43bd-8f67-ea28dd284657 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:43.223700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058111c1-4615-442d-b08e-774e50fbeb56 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:43.227684 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f00255-f235-43bd-8f67-ea28dd284657 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:43.262015 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4427210-4325-4486-b0b0-84b6653ea427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:43.262215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87566795-2df2-445d-9726-e168281b66ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:43.262883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87566795-2df2-445d-9726-e168281b66ef None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:43.263160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87566795-2df2-445d-9726-e168281b66ef None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:43.263430 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87566795-2df2-445d-9726-e168281b66ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:43.263787 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4427210-4325-4486-b0b0-84b6653ea427 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:43.264254 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4427210-4325-4486-b0b0-84b6653ea427 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:43.264815 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4427210-4325-4486-b0b0-84b6653ea427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:43.266505 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4427210-4325-4486-b0b0-84b6653ea427 None admin] RBAC: Adding query filter params (role.id=44e1b9c3f51e473a8af9b883e80a74d2, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=3d261ec6e42f4be08c4d584fd3d00850) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:43.267032 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4427210-4325-4486-b0b0-84b6653ea427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:43.268710 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4427210-4325-4486-b0b0-84b6653ea427 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:43.271275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87566795-2df2-445d-9726-e168281b66ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:43.272743 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87566795-2df2-445d-9726-e168281b66ef None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:43.275471 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 269/528] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:35:43 2022] GET /identity/v3/role_assignments?user.id=3d261ec6e42f4be08c4d584fd3d00850&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=44e1b9c3f51e473a8af9b883e80a74d2 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:43.276567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4427210-4325-4486-b0b0-84b6653ea427 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:43.320429 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-87566795-2df2-445d-9726-e168281b66ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:35:43.329306 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 260/529] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:43.330246 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87566795-2df2-445d-9726-e168281b66ef None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:43.387464 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4427210-4325-4486-b0b0-84b6653ea427 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:43.424381 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553241e-1d00-4953-8a7b-3baa433a8293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:43.425448 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553241e-1d00-4953-8a7b-3baa433a8293 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:43.425929 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553241e-1d00-4953-8a7b-3baa433a8293 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:43.426398 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553241e-1d00-4953-8a7b-3baa433a8293 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:43.497287 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87566795-2df2-445d-9726-e168281b66ef None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:43.522670 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553241e-1d00-4953-8a7b-3baa433a8293 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:43.524154 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553241e-1d00-4953-8a7b-3baa433a8293 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:43.532988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90979fb-99ed-43f2-8847-39e43921e733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:43.533848 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90979fb-99ed-43f2-8847-39e43921e733 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:43.534298 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90979fb-99ed-43f2-8847-39e43921e733 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:43.534719 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90979fb-99ed-43f2-8847-39e43921e733 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:43.535580 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90979fb-99ed-43f2-8847-39e43921e733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:43.536041 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90979fb-99ed-43f2-8847-39e43921e733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:43.537561 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90979fb-99ed-43f2-8847-39e43921e733 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:43.550336 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 261/530] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:43.551457 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90979fb-99ed-43f2-8847-39e43921e733 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:43.623127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 270/531] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:43.624181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553241e-1d00-4953-8a7b-3baa433a8293 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:43.656670 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90979fb-99ed-43f2-8847-39e43921e733 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:43.691984 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b2745-39e7-496e-a13e-18f4f6f64152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:43.692961 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b2745-39e7-496e-a13e-18f4f6f64152 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:43.693386 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b2745-39e7-496e-a13e-18f4f6f64152 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:43.693801 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b2745-39e7-496e-a13e-18f4f6f64152 None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:43.694731 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b2745-39e7-496e-a13e-18f4f6f64152 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:43.695179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b2745-39e7-496e-a13e-18f4f6f64152 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:43.696786 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b2745-39e7-496e-a13e-18f4f6f64152 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:43.709398 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 262/532] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:35:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:43.710664 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b2745-39e7-496e-a13e-18f4f6f64152 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:43.733978 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553241e-1d00-4953-8a7b-3baa433a8293 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:43.772750 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71adb1e-a12e-49d3-95cc-9c778afcf5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:43.773814 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71adb1e-a12e-49d3-95cc-9c778afcf5f7 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:43.774252 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71adb1e-a12e-49d3-95cc-9c778afcf5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:43.774526 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71adb1e-a12e-49d3-95cc-9c778afcf5f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:43.781325 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71adb1e-a12e-49d3-95cc-9c778afcf5f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:43.782780 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71adb1e-a12e-49d3-95cc-9c778afcf5f7 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:43.795610 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-b71adb1e-a12e-49d3-95cc-9c778afcf5f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:35:43.801735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 271/533] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:43.801735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71adb1e-a12e-49d3-95cc-9c778afcf5f7 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:43.831767 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b2745-39e7-496e-a13e-18f4f6f64152 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:43.874056 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c902e00-e3bd-445d-be75-312958bb4c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:43.875547 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c902e00-e3bd-445d-be75-312958bb4c8c None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:43.876032 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c902e00-e3bd-445d-be75-312958bb4c8c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:43.876318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c902e00-e3bd-445d-be75-312958bb4c8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:43.889060 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c902e00-e3bd-445d-be75-312958bb4c8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:43.891217 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c902e00-e3bd-445d-be75-312958bb4c8c None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:43.911474 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71adb1e-a12e-49d3-95cc-9c778afcf5f7 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:43.912677 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-5c902e00-e3bd-445d-be75-312958bb4c8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:43.919870 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 263/534] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:43.920762 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c902e00-e3bd-445d-be75-312958bb4c8c None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:43.949984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad44393-bd7a-437a-9393-ebf65851d9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:43.950827 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad44393-bd7a-437a-9393-ebf65851d9cc None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:43.951109 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad44393-bd7a-437a-9393-ebf65851d9cc None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:43.951703 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad44393-bd7a-437a-9393-ebf65851d9cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:43.953550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad44393-bd7a-437a-9393-ebf65851d9cc None admin] RBAC: Adding query filter params (role.id=44e1b9c3f51e473a8af9b883e80a74d2, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=e7f3ea629181433eb8c6d5dbc354c141) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:43.953992 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad44393-bd7a-437a-9393-ebf65851d9cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:43.956195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad44393-bd7a-437a-9393-ebf65851d9cc None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:43.964126 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 272/535] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:35:43 2022] GET /identity/v3/role_assignments?user.id=e7f3ea629181433eb8c6d5dbc354c141&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=44e1b9c3f51e473a8af9b883e80a74d2 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:43.965154 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad44393-bd7a-437a-9393-ebf65851d9cc None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:44.093142 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad44393-bd7a-437a-9393-ebf65851d9cc None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:44.136418 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ce4c9-3a8c-4704-be59-8fe0b093f9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:44.137222 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ce4c9-3a8c-4704-be59-8fe0b093f9a2 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:44.137511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ce4c9-3a8c-4704-be59-8fe0b093f9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:44.137784 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ce4c9-3a8c-4704-be59-8fe0b093f9a2 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:44.138523 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ce4c9-3a8c-4704-be59-8fe0b093f9a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:44.138833 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ce4c9-3a8c-4704-be59-8fe0b093f9a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:44.144606 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ce4c9-3a8c-4704-be59-8fe0b093f9a2 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:44.150881 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c902e00-e3bd-445d-be75-312958bb4c8c None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:44.155714 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 273/536] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:44.162147 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ce4c9-3a8c-4704-be59-8fe0b093f9a2 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:44.216433 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb102c-07a9-428b-8a05-4bc37fe187dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:44.217138 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb102c-07a9-428b-8a05-4bc37fe187dc None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:44.217473 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb102c-07a9-428b-8a05-4bc37fe187dc None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:44.217752 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb102c-07a9-428b-8a05-4bc37fe187dc None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:44.219155 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb102c-07a9-428b-8a05-4bc37fe187dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:44.219466 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb102c-07a9-428b-8a05-4bc37fe187dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:44.222847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb102c-07a9-428b-8a05-4bc37fe187dc None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:44.237947 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 264/537] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:35:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:44.243323 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb102c-07a9-428b-8a05-4bc37fe187dc None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:44.315145 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ce4c9-3a8c-4704-be59-8fe0b093f9a2 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:44.355090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca526a-d47f-49cf-80f0-8b4199431e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:44.355877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca526a-d47f-49cf-80f0-8b4199431e30 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:44.356154 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca526a-d47f-49cf-80f0-8b4199431e30 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:44.356425 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca526a-d47f-49cf-80f0-8b4199431e30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:44.372000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca526a-d47f-49cf-80f0-8b4199431e30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:44.373482 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca526a-d47f-49cf-80f0-8b4199431e30 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:44.407491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-d7ca526a-d47f-49cf-80f0-8b4199431e30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:35:44.410425 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 274/538] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:44.414006 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb102c-07a9-428b-8a05-4bc37fe187dc None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:44.416227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca526a-d47f-49cf-80f0-8b4199431e30 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:44.477366 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3166426-7828-4aba-a285-8eeaa6820843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:44.478029 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3166426-7828-4aba-a285-8eeaa6820843 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:44.478305 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3166426-7828-4aba-a285-8eeaa6820843 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:44.478571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3166426-7828-4aba-a285-8eeaa6820843 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:44.479470 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3166426-7828-4aba-a285-8eeaa6820843 None admin] RBAC: Adding query filter params (role.id=44e1b9c3f51e473a8af9b883e80a74d2, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=f7f96ebcce204c729bf8e59d21dcc5d9) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:44.479779 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3166426-7828-4aba-a285-8eeaa6820843 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:44.481318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3166426-7828-4aba-a285-8eeaa6820843 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:44.499334 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 265/539] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:35:44 2022] GET /identity/v3/role_assignments?user.id=f7f96ebcce204c729bf8e59d21dcc5d9&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=44e1b9c3f51e473a8af9b883e80a74d2 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:44.557227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca526a-d47f-49cf-80f0-8b4199431e30 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:44.593154 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb64111-f1d9-4ca6-8fe9-23abe69154a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:44.594091 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb64111-f1d9-4ca6-8fe9-23abe69154a2 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:44.594398 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb64111-f1d9-4ca6-8fe9-23abe69154a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:44.594698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb64111-f1d9-4ca6-8fe9-23abe69154a2 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:44.595500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb64111-f1d9-4ca6-8fe9-23abe69154a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:44.595804 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb64111-f1d9-4ca6-8fe9-23abe69154a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:44.597290 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb64111-f1d9-4ca6-8fe9-23abe69154a2 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:44.617644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 275/540] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:35:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:44.623369 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3166426-7828-4aba-a285-8eeaa6820843 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:44.786164 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3166426-7828-4aba-a285-8eeaa6820843 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:44.820764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a3499-0e83-414c-ad2d-6ed7fb26fa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:44.821786 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a3499-0e83-414c-ad2d-6ed7fb26fa97 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:44.822271 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a3499-0e83-414c-ad2d-6ed7fb26fa97 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:44.822755 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a3499-0e83-414c-ad2d-6ed7fb26fa97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:44.823799 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a3499-0e83-414c-ad2d-6ed7fb26fa97 None admin] RBAC: Adding query filter params (role.id=44e1b9c3f51e473a8af9b883e80a74d2, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=1bfbd6a387e44037a58e521230783347) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:44.824328 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a3499-0e83-414c-ad2d-6ed7fb26fa97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:44.826092 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a3499-0e83-414c-ad2d-6ed7fb26fa97 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:44.836691 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 266/541] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:35:44 2022] GET /identity/v3/role_assignments?user.id=1bfbd6a387e44037a58e521230783347&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=44e1b9c3f51e473a8af9b883e80a74d2 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:45.450048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36d84d-4976-4be9-bee2-5725a0a4417e None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:45.450781 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36d84d-4976-4be9-bee2-5725a0a4417e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:45.451270 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36d84d-4976-4be9-bee2-5725a0a4417e None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:45.453364 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 276/542] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:45.459611 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58351868-390e-44bd-8382-49abf318a744 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:45.460257 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58351868-390e-44bd-8382-49abf318a744 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:45.460809 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58351868-390e-44bd-8382-49abf318a744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:45.486179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-58351868-390e-44bd-8382-49abf318a744 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:45.487791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-58351868-390e-44bd-8382-49abf318a744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:45.573785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 267/543] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:45.618504 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36d84d-4976-4be9-bee2-5725a0a4417e None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:45.742486 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36d84d-4976-4be9-bee2-5725a0a4417e None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:45.793852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea4a86-4d1e-49f9-b659-10e25353e5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:45.795009 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea4a86-4d1e-49f9-b659-10e25353e5a9 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:45.795492 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea4a86-4d1e-49f9-b659-10e25353e5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:45.795984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea4a86-4d1e-49f9-b659-10e25353e5a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:45.817474 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea4a86-4d1e-49f9-b659-10e25353e5a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:45.824796 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-36ea4a86-4d1e-49f9-b659-10e25353e5a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:35:45.826584 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 277/544] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:45.832299 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58351868-390e-44bd-8382-49abf318a744 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:45.930485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1109d8-c0a0-4db4-ba5b-321652f537b8 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:45.930772 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1109d8-c0a0-4db4-ba5b-321652f537b8 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:45.931031 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1109d8-c0a0-4db4-ba5b-321652f537b8 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:45.932521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 278/545] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:35:45.937895 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836aacbb-44e1-4803-9e7e-3be24dce2217 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:45.938510 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836aacbb-44e1-4803-9e7e-3be24dce2217 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:45.939015 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836aacbb-44e1-4803-9e7e-3be24dce2217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:45.939118 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58351868-390e-44bd-8382-49abf318a744 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:45.957527 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-836aacbb-44e1-4803-9e7e-3be24dce2217 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:45.959139 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-836aacbb-44e1-4803-9e7e-3be24dce2217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:45.977196 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb0a4a-ce51-4459-bec7-caaf09b80c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:45.978187 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb0a4a-ce51-4459-bec7-caaf09b80c8a None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:45.978646 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb0a4a-ce51-4459-bec7-caaf09b80c8a None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:45.979094 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb0a4a-ce51-4459-bec7-caaf09b80c8a None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:45.980025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb0a4a-ce51-4459-bec7-caaf09b80c8a None admin] RBAC: Adding query filter params (name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:45.980508 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb0a4a-ce51-4459-bec7-caaf09b80c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:45.982263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb0a4a-ce51-4459-bec7-caaf09b80c8a None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:46.005949 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 268/546] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:35:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:46.010044 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb0a4a-ce51-4459-bec7-caaf09b80c8a None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:46.119241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 279/547] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:35:46.132757 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb0a4a-ce51-4459-bec7-caaf09b80c8a None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:46.156050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836aacbb-44e1-4803-9e7e-3be24dce2217 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:46.177069 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bfbbb-0dd1-4714-9f05-e6bf032d439b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:46.178264 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bfbbb-0dd1-4714-9f05-e6bf032d439b None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:46.178751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bfbbb-0dd1-4714-9f05-e6bf032d439b None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:46.179248 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bfbbb-0dd1-4714-9f05-e6bf032d439b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:46.196564 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bfbbb-0dd1-4714-9f05-e6bf032d439b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:46.198076 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bfbbb-0dd1-4714-9f05-e6bf032d439b None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:46.228194 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-b37bfbbb-0dd1-4714-9f05-e6bf032d439b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:46.237531 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 269/548] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:46.243018 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bfbbb-0dd1-4714-9f05-e6bf032d439b None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:46.278515 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836aacbb-44e1-4803-9e7e-3be24dce2217 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:46.321084 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61ea9a-9172-4cfb-8b20-0f6e7a7f12a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:46.322236 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61ea9a-9172-4cfb-8b20-0f6e7a7f12a7 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:46.323825 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61ea9a-9172-4cfb-8b20-0f6e7a7f12a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:46.324331 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61ea9a-9172-4cfb-8b20-0f6e7a7f12a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:46.347855 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61ea9a-9172-4cfb-8b20-0f6e7a7f12a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:46.356267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-0f61ea9a-9172-4cfb-8b20-0f6e7a7f12a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:35:46.358627 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 280/549] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:46.369644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61ea9a-9172-4cfb-8b20-0f6e7a7f12a7 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:46.416679 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bfbbb-0dd1-4714-9f05-e6bf032d439b None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:46.451955 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b62a6-054a-4f0d-bb2c-18f1a3a641b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:46.452655 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b62a6-054a-4f0d-bb2c-18f1a3a641b0 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:46.453678 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b62a6-054a-4f0d-bb2c-18f1a3a641b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:46.453856 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b62a6-054a-4f0d-bb2c-18f1a3a641b0 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:46.454699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b62a6-054a-4f0d-bb2c-18f1a3a641b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:46.454879 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b62a6-054a-4f0d-bb2c-18f1a3a641b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:46.456294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b62a6-054a-4f0d-bb2c-18f1a3a641b0 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:46.469842 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 270/550] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:46.476029 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b62a6-054a-4f0d-bb2c-18f1a3a641b0 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:46.520243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61ea9a-9172-4cfb-8b20-0f6e7a7f12a7 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:46.563473 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339013e-b6f7-47cb-bac7-406e79381816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:46.564485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339013e-b6f7-47cb-bac7-406e79381816 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:46.565022 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339013e-b6f7-47cb-bac7-406e79381816 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:46.565495 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339013e-b6f7-47cb-bac7-406e79381816 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:46.566519 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339013e-b6f7-47cb-bac7-406e79381816 None admin] RBAC: Adding query filter params (name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:46.567039 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339013e-b6f7-47cb-bac7-406e79381816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:46.568657 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339013e-b6f7-47cb-bac7-406e79381816 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:46.577117 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b62a6-054a-4f0d-bb2c-18f1a3a641b0 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:46.579046 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 281/551] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:35:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:46.585549 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339013e-b6f7-47cb-bac7-406e79381816 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:46.612649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ad3e5-6a62-4290-badd-cf9f91d868a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:46.613199 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ad3e5-6a62-4290-badd-cf9f91d868a3 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:46.613476 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ad3e5-6a62-4290-badd-cf9f91d868a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:46.613744 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ad3e5-6a62-4290-badd-cf9f91d868a3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:46.621267 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ad3e5-6a62-4290-badd-cf9f91d868a3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:46.622699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ad3e5-6a62-4290-badd-cf9f91d868a3 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:46.637756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-298ad3e5-6a62-4290-badd-cf9f91d868a3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 14 21:35:46.638996 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 271/552] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:35:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:46.644919 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ad3e5-6a62-4290-badd-cf9f91d868a3 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:46.780022 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339013e-b6f7-47cb-bac7-406e79381816 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:46.821933 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ad3e5-6a62-4290-badd-cf9f91d868a3 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:46.846664 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb27ec4-4b65-4f9d-8be4-0afa83f00ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:46.847467 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb27ec4-4b65-4f9d-8be4-0afa83f00ae8 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:46.847745 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb27ec4-4b65-4f9d-8be4-0afa83f00ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:46.848012 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb27ec4-4b65-4f9d-8be4-0afa83f00ae8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:46.857884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed312e7e-0e92-4215-b09a-ed923d62d5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:46.858712 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed312e7e-0e92-4215-b09a-ed923d62d5f6 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:46.859747 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed312e7e-0e92-4215-b09a-ed923d62d5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:46.860149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed312e7e-0e92-4215-b09a-ed923d62d5f6 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:46.864600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed312e7e-0e92-4215-b09a-ed923d62d5f6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:46.864600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed312e7e-0e92-4215-b09a-ed923d62d5f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:46.864600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed312e7e-0e92-4215-b09a-ed923d62d5f6 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:46.874676 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb27ec4-4b65-4f9d-8be4-0afa83f00ae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:46.876970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb27ec4-4b65-4f9d-8be4-0afa83f00ae8 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:46.883218 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 272/553] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Apr 14 21:35:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:46.889058 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed312e7e-0e92-4215-b09a-ed923d62d5f6 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:46.903633 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-1fb27ec4-4b65-4f9d-8be4-0afa83f00ae8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:46.905506 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 282/554] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:46.906984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc31db-af0b-412f-bd9d-c0b61781667e None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:46.907572 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc31db-af0b-412f-bd9d-c0b61781667e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:46.908151 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc31db-af0b-412f-bd9d-c0b61781667e None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:46.909637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 283/555] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:46.920712 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc31db-af0b-412f-bd9d-c0b61781667e None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:46.998047 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed312e7e-0e92-4215-b09a-ed923d62d5f6 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:47.042415 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39105933-a0f1-407e-a02b-8fbb1772e2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:47.045576 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39105933-a0f1-407e-a02b-8fbb1772e2db None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:47.045576 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39105933-a0f1-407e-a02b-8fbb1772e2db None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:47.045576 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39105933-a0f1-407e-a02b-8fbb1772e2db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:47.049024 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc31db-af0b-412f-bd9d-c0b61781667e None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:47.083793 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeb038-fe36-43fa-b3a4-34f60ebdd93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:47.084406 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeb038-fe36-43fa-b3a4-34f60ebdd93d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:47.084718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeb038-fe36-43fa-b3a4-34f60ebdd93d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:47.084992 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeb038-fe36-43fa-b3a4-34f60ebdd93d None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:47.085718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeb038-fe36-43fa-b3a4-34f60ebdd93d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:47.086275 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeb038-fe36-43fa-b3a4-34f60ebdd93d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:47.087783 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeb038-fe36-43fa-b3a4-34f60ebdd93d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:47.104113 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 284/556] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:47.105504 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f30d0a-d35e-4bdd-88f0-bd50012a1ce1 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:47.105795 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f30d0a-d35e-4bdd-88f0-bd50012a1ce1 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:47.106073 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f30d0a-d35e-4bdd-88f0-bd50012a1ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:47.117656 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39105933-a0f1-407e-a02b-8fbb1772e2db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:47.119319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39105933-a0f1-407e-a02b-8fbb1772e2db None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:47.123933 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-c8f30d0a-d35e-4bdd-88f0-bd50012a1ce1 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:47.125720 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c8f30d0a-d35e-4bdd-88f0-bd50012a1ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:47.197799 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 285/557] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:47.199110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f30d0a-d35e-4bdd-88f0-bd50012a1ce1 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:47.225290 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 273/558] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 14 21:35:47.232859 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39105933-a0f1-407e-a02b-8fbb1772e2db None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:47.316832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f30d0a-d35e-4bdd-88f0-bd50012a1ce1 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:47.334576 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39105933-a0f1-407e-a02b-8fbb1772e2db None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:47.352985 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95ebbf-a4ed-41be-8935-fd8b9317ddf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:47.354039 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95ebbf-a4ed-41be-8935-fd8b9317ddf8 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:47.354465 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95ebbf-a4ed-41be-8935-fd8b9317ddf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:47.354902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95ebbf-a4ed-41be-8935-fd8b9317ddf8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:47.365241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95ebbf-a4ed-41be-8935-fd8b9317ddf8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:47.367151 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95ebbf-a4ed-41be-8935-fd8b9317ddf8 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:47.369538 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49336d7c-a085-4b6d-8089-354fe4b919f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:47.370443 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49336d7c-a085-4b6d-8089-354fe4b919f9 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:47.370610 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49336d7c-a085-4b6d-8089-354fe4b919f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:47.370883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49336d7c-a085-4b6d-8089-354fe4b919f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:47.382029 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49336d7c-a085-4b6d-8089-354fe4b919f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:47.383485 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49336d7c-a085-4b6d-8089-354fe4b919f9 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:47.384765 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-af95ebbf-a4ed-41be-8935-fd8b9317ddf8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 14 21:35:47.391646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 286/559] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:47.392733 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95ebbf-a4ed-41be-8935-fd8b9317ddf8 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:47.402157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-49336d7c-a085-4b6d-8089-354fe4b919f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:47.408214 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 274/560] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:47.409269 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49336d7c-a085-4b6d-8089-354fe4b919f9 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:47.517893 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49336d7c-a085-4b6d-8089-354fe4b919f9 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:47.523049 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95ebbf-a4ed-41be-8935-fd8b9317ddf8 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:47.557017 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510661ea-53be-4ff5-8045-8aec0edb9522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:47.557689 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510661ea-53be-4ff5-8045-8aec0edb9522 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:47.557967 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510661ea-53be-4ff5-8045-8aec0edb9522 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:47.558084 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff4712-211c-4d82-8945-18254599d929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:47.558263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510661ea-53be-4ff5-8045-8aec0edb9522 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:47.558896 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff4712-211c-4d82-8945-18254599d929 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:47.559063 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510661ea-53be-4ff5-8045-8aec0edb9522 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:47.559211 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff4712-211c-4d82-8945-18254599d929 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:47.559369 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510661ea-53be-4ff5-8045-8aec0edb9522 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:47.559461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff4712-211c-4d82-8945-18254599d929 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:47.560809 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510661ea-53be-4ff5-8045-8aec0edb9522 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:47.570728 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff4712-211c-4d82-8945-18254599d929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:47.578528 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-bfff4712-211c-4d82-8945-18254599d929 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:35:47.578997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 275/561] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Apr 14 21:35:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:47.579847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510661ea-53be-4ff5-8045-8aec0edb9522 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:47.580768 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 287/562] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:47.582195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac69bb-2f86-4563-b592-c4abd262cf4a None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:47.582606 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac69bb-2f86-4563-b592-c4abd262cf4a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:47.583197 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac69bb-2f86-4563-b592-c4abd262cf4a None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:47.585131 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 288/563] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:47.586380 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac69bb-2f86-4563-b592-c4abd262cf4a None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:47.683082 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510661ea-53be-4ff5-8045-8aec0edb9522 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:47.686992 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac69bb-2f86-4563-b592-c4abd262cf4a None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:47.716848 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fffa2-5efc-4539-872e-804978a66f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:47.717519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fffa2-5efc-4539-872e-804978a66f40 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:47.717800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fffa2-5efc-4539-872e-804978a66f40 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:47.718076 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fffa2-5efc-4539-872e-804978a66f40 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:47.718948 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fffa2-5efc-4539-872e-804978a66f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:47.719315 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fffa2-5efc-4539-872e-804978a66f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:47.720709 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fffa2-5efc-4539-872e-804978a66f40 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:47.722691 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177241b-fef1-474a-9aa2-15a78a234e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:47.723515 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177241b-fef1-474a-9aa2-15a78a234e69 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:47.723792 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177241b-fef1-474a-9aa2-15a78a234e69 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:47.724062 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177241b-fef1-474a-9aa2-15a78a234e69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:47.732016 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 276/564] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:47.732849 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fffa2-5efc-4539-872e-804978a66f40 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:47.739444 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177241b-fef1-474a-9aa2-15a78a234e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:47.741027 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177241b-fef1-474a-9aa2-15a78a234e69 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:47.758840 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-2177241b-fef1-474a-9aa2-15a78a234e69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:47.764301 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 289/565] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:47.764301 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32556fa-dea3-4a0a-85d7-c297826795aa None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:47.764301 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32556fa-dea3-4a0a-85d7-c297826795aa None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:47.764301 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32556fa-dea3-4a0a-85d7-c297826795aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:47.782373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-c32556fa-dea3-4a0a-85d7-c297826795aa None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:47.783906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c32556fa-dea3-4a0a-85d7-c297826795aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:47.838586 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fffa2-5efc-4539-872e-804978a66f40 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:47.849694 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 290/566] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:47.850602 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32556fa-dea3-4a0a-85d7-c297826795aa None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:47.870857 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca53b0a-a349-48ec-8a84-d6b181c0874d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:47.871523 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca53b0a-a349-48ec-8a84-d6b181c0874d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:47.871804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca53b0a-a349-48ec-8a84-d6b181c0874d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:47.872079 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca53b0a-a349-48ec-8a84-d6b181c0874d None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:47.872852 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca53b0a-a349-48ec-8a84-d6b181c0874d None admin] RBAC: Adding query filter params (name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:47.873158 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca53b0a-a349-48ec-8a84-d6b181c0874d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:47.874564 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca53b0a-a349-48ec-8a84-d6b181c0874d None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:47.882482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 277/567] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:35:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:47.883263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca53b0a-a349-48ec-8a84-d6b181c0874d None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:47.944740 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32556fa-dea3-4a0a-85d7-c297826795aa None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:47.977615 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717bce1-e8bd-4e4b-9752-9762a17519e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:47.978443 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717bce1-e8bd-4e4b-9752-9762a17519e1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:47.978728 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717bce1-e8bd-4e4b-9752-9762a17519e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:47.978995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717bce1-e8bd-4e4b-9752-9762a17519e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:47.980496 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca53b0a-a349-48ec-8a84-d6b181c0874d None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:47.986031 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717bce1-e8bd-4e4b-9752-9762a17519e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:47.987135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717bce1-e8bd-4e4b-9752-9762a17519e1 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:48.000633 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-3717bce1-e8bd-4e4b-9752-9762a17519e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:35:48.001820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 291/568] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:48.003013 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c34b1c-e45e-4e42-93ee-a226b4f4cdb1 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:48.003298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c34b1c-e45e-4e42-93ee-a226b4f4cdb1 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:48.003575 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c34b1c-e45e-4e42-93ee-a226b4f4cdb1 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:48.004985 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 292/569] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:48.005529 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c34b1c-e45e-4e42-93ee-a226b4f4cdb1 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:48.015383 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacad0b8-8289-447f-9b57-fe26c5390b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:48.016053 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacad0b8-8289-447f-9b57-fe26c5390b01 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:48.016339 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacad0b8-8289-447f-9b57-fe26c5390b01 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:48.016632 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacad0b8-8289-447f-9b57-fe26c5390b01 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:48.017355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacad0b8-8289-447f-9b57-fe26c5390b01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:48.017660 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacad0b8-8289-447f-9b57-fe26c5390b01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:48.019036 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacad0b8-8289-447f-9b57-fe26c5390b01 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:48.035548 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 278/570] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:48.035548 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacad0b8-8289-447f-9b57-fe26c5390b01 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:48.103267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c34b1c-e45e-4e42-93ee-a226b4f4cdb1 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:48.127556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacad0b8-8289-447f-9b57-fe26c5390b01 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:48.137655 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f6c88-e0d3-4324-abfa-c002c80bd6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:48.138439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f6c88-e0d3-4324-abfa-c002c80bd6cb None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:48.138718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f6c88-e0d3-4324-abfa-c002c80bd6cb None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:48.138988 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f6c88-e0d3-4324-abfa-c002c80bd6cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:48.151476 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f6c88-e0d3-4324-abfa-c002c80bd6cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:48.160070 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ac290-1d5d-4461-b40f-6155093d2889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:48.160893 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac290-1d5d-4461-b40f-6155093d2889 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:48.161174 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac290-1d5d-4461-b40f-6155093d2889 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:48.161266 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-435f6c88-e0d3-4324-abfa-c002c80bd6cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:35:48.161444 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac290-1d5d-4461-b40f-6155093d2889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:48.162441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 293/571] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:48.163233 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f6c88-e0d3-4324-abfa-c002c80bd6cb None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:48.172376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ac290-1d5d-4461-b40f-6155093d2889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:48.173845 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ac290-1d5d-4461-b40f-6155093d2889 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:48.190652 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-684ac290-1d5d-4461-b40f-6155093d2889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:48.191840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 279/572] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:48.193110 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808fe66-a5d5-4115-86b8-6cfa1e0d0eeb None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:48.193397 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808fe66-a5d5-4115-86b8-6cfa1e0d0eeb None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:48.193677 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808fe66-a5d5-4115-86b8-6cfa1e0d0eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:48.209971 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-f808fe66-a5d5-4115-86b8-6cfa1e0d0eeb None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:48.211425 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f808fe66-a5d5-4115-86b8-6cfa1e0d0eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:48.258255 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f6c88-e0d3-4324-abfa-c002c80bd6cb None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:48.274585 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 280/573] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:48.275392 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808fe66-a5d5-4115-86b8-6cfa1e0d0eeb None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:48.291183 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7120a2-4815-418a-a7d1-5f4cef0b38b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:48.291837 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7120a2-4815-418a-a7d1-5f4cef0b38b7 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:48.292204 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7120a2-4815-418a-a7d1-5f4cef0b38b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:48.292447 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7120a2-4815-418a-a7d1-5f4cef0b38b7 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:48.293181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7120a2-4815-418a-a7d1-5f4cef0b38b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:48.293487 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7120a2-4815-418a-a7d1-5f4cef0b38b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:48.294920 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7120a2-4815-418a-a7d1-5f4cef0b38b7 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:48.307441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 294/574] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:35:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:48.308337 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7120a2-4815-418a-a7d1-5f4cef0b38b7 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:48.377056 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808fe66-a5d5-4115-86b8-6cfa1e0d0eeb None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:48.402523 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7120a2-4815-418a-a7d1-5f4cef0b38b7 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:48.409381 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf91af3-47d1-4ed2-be54-a1096616d62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:48.410238 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf91af3-47d1-4ed2-be54-a1096616d62f None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:48.410519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf91af3-47d1-4ed2-be54-a1096616d62f None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:48.410790 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf91af3-47d1-4ed2-be54-a1096616d62f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:48.417498 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf91af3-47d1-4ed2-be54-a1096616d62f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:48.418933 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf91af3-47d1-4ed2-be54-a1096616d62f None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:48.432330 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-ecf91af3-47d1-4ed2-be54-a1096616d62f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:35:48.433544 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 281/575] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:48.434310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf91af3-47d1-4ed2-be54-a1096616d62f None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:48.435084 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca086c-66f1-41af-98b1-d0df9a6d7586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:48.435750 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca086c-66f1-41af-98b1-d0df9a6d7586 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:48.436031 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca086c-66f1-41af-98b1-d0df9a6d7586 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:48.436305 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca086c-66f1-41af-98b1-d0df9a6d7586 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:48.437668 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca086c-66f1-41af-98b1-d0df9a6d7586 None admin] RBAC: Adding query filter params (name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:48.438011 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca086c-66f1-41af-98b1-d0df9a6d7586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:48.439507 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca086c-66f1-41af-98b1-d0df9a6d7586 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:48.447454 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 295/576] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:35:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:48.448243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca086c-66f1-41af-98b1-d0df9a6d7586 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:48.529343 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf91af3-47d1-4ed2-be54-a1096616d62f None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:48.541489 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca086c-66f1-41af-98b1-d0df9a6d7586 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:48.561135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be7d4d-b89d-431a-86a0-fb211fe17767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:48.561793 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be7d4d-b89d-431a-86a0-fb211fe17767 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:48.562705 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be7d4d-b89d-431a-86a0-fb211fe17767 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:48.562970 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be7d4d-b89d-431a-86a0-fb211fe17767 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:48.563786 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be7d4d-b89d-431a-86a0-fb211fe17767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:48.564095 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be7d4d-b89d-431a-86a0-fb211fe17767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:48.565475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be7d4d-b89d-431a-86a0-fb211fe17767 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:48.573739 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc45530-3dd8-4c9b-a5e1-98750cacaa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:48.574518 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc45530-3dd8-4c9b-a5e1-98750cacaa5c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:48.574800 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc45530-3dd8-4c9b-a5e1-98750cacaa5c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:48.575069 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc45530-3dd8-4c9b-a5e1-98750cacaa5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:48.576586 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 282/577] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:48.577382 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be7d4d-b89d-431a-86a0-fb211fe17767 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:48.585551 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc45530-3dd8-4c9b-a5e1-98750cacaa5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:48.592766 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-9cc45530-3dd8-4c9b-a5e1-98750cacaa5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:35:48.594226 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 296/578] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:48.594968 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc45530-3dd8-4c9b-a5e1-98750cacaa5c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:48.676878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be7d4d-b89d-431a-86a0-fb211fe17767 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:48.688417 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc45530-3dd8-4c9b-a5e1-98750cacaa5c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:48.709632 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5e238-1ed2-4c6b-a651-d5c8dbc72d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:48.710280 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5e238-1ed2-4c6b-a651-d5c8dbc72d66 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:48.710560 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5e238-1ed2-4c6b-a651-d5c8dbc72d66 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:48.711095 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5e238-1ed2-4c6b-a651-d5c8dbc72d66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:48.711917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5e238-1ed2-4c6b-a651-d5c8dbc72d66 None admin] RBAC: Adding query filter params (role.id=44e1b9c3f51e473a8af9b883e80a74d2, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=360bf55488d046c4be98a903d113c0fc) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:48.712226 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5e238-1ed2-4c6b-a651-d5c8dbc72d66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:48.713688 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5e238-1ed2-4c6b-a651-d5c8dbc72d66 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:48.718967 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 283/579] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:35:48 2022] GET /identity/v3/role_assignments?user.id=360bf55488d046c4be98a903d113c0fc&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=44e1b9c3f51e473a8af9b883e80a74d2 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:48.719729 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5e238-1ed2-4c6b-a651-d5c8dbc72d66 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:48.720773 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7e34d-e5f6-48fe-84ee-f21a1bc8cea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:48.721435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7e34d-e5f6-48fe-84ee-f21a1bc8cea8 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:48.721747 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7e34d-e5f6-48fe-84ee-f21a1bc8cea8 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:48.722029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7e34d-e5f6-48fe-84ee-f21a1bc8cea8 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:48.722823 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7e34d-e5f6-48fe-84ee-f21a1bc8cea8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:48.723140 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7e34d-e5f6-48fe-84ee-f21a1bc8cea8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:48.724633 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7e34d-e5f6-48fe-84ee-f21a1bc8cea8 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:48.743470 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 297/580] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:35:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:48.744709 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7e34d-e5f6-48fe-84ee-f21a1bc8cea8 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:48.829043 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5e238-1ed2-4c6b-a651-d5c8dbc72d66 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:48.855221 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7e34d-e5f6-48fe-84ee-f21a1bc8cea8 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:48.864708 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b6736-45a8-49f9-8ab2-b3ab0e83ca71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:48.865514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b6736-45a8-49f9-8ab2-b3ab0e83ca71 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:48.865789 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b6736-45a8-49f9-8ab2-b3ab0e83ca71 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:48.866067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b6736-45a8-49f9-8ab2-b3ab0e83ca71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:48.877567 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b6736-45a8-49f9-8ab2-b3ab0e83ca71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:48.879050 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b6736-45a8-49f9-8ab2-b3ab0e83ca71 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:48.895967 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac02a90-c30f-4f9a-9adf-29dcb50d0203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:48.897029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac02a90-c30f-4f9a-9adf-29dcb50d0203 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:48.897489 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac02a90-c30f-4f9a-9adf-29dcb50d0203 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:48.897615 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-b18b6736-45a8-49f9-8ab2-b3ab0e83ca71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:48.898059 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac02a90-c30f-4f9a-9adf-29dcb50d0203 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:48.898746 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 284/581] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:48.899507 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b6736-45a8-49f9-8ab2-b3ab0e83ca71 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:48.910236 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac02a90-c30f-4f9a-9adf-29dcb50d0203 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:48.911791 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac02a90-c30f-4f9a-9adf-29dcb50d0203 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:48.925743 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-bac02a90-c30f-4f9a-9adf-29dcb50d0203 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 14 21:35:48.931621 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 298/582] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Apr 14 21:35:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:48.931621 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac02a90-c30f-4f9a-9adf-29dcb50d0203 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:49.018522 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b6736-45a8-49f9-8ab2-b3ab0e83ca71 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:49.026643 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac02a90-c30f-4f9a-9adf-29dcb50d0203 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:49.053342 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b61977-7f3d-4e19-9694-c19bb7d24281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:49.054015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61977-7f3d-4e19-9694-c19bb7d24281 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:49.054296 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61977-7f3d-4e19-9694-c19bb7d24281 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:49.054571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61977-7f3d-4e19-9694-c19bb7d24281 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:49.055317 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b61977-7f3d-4e19-9694-c19bb7d24281 None admin] RBAC: Adding query filter params (name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:49.055619 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b61977-7f3d-4e19-9694-c19bb7d24281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:49.057071 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b61977-7f3d-4e19-9694-c19bb7d24281 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:49.059630 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bc87a-00eb-4133-8d5f-9e0ee970994b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:49.060507 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bc87a-00eb-4133-8d5f-9e0ee970994b None admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:49.060807 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bc87a-00eb-4133-8d5f-9e0ee970994b None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:49.061071 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bc87a-00eb-4133-8d5f-9e0ee970994b None admin] PATH_INFO: `/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/3d261ec6e42f4be08c4d584fd3d00850/roles/44e1b9c3f51e473a8af9b883e80a74d2` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:49.065063 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 285/583] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:35:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:49.065849 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b61977-7f3d-4e19-9694-c19bb7d24281 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:49.082549 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bc87a-00eb-4133-8d5f-9e0ee970994b None admin] RBAC: Authorizing `identity:create_grant(project_id=a3c1bb37aa1c407782b2f5501ae1f10a, user_id=3d261ec6e42f4be08c4d584fd3d00850, role_id=44e1b9c3f51e473a8af9b883e80a74d2)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:49.084048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bc87a-00eb-4133-8d5f-9e0ee970994b None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:49.162540 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b61977-7f3d-4e19-9694-c19bb7d24281 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:49.172878 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 299/584] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:35:48 2022] PUT /identity/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/3d261ec6e42f4be08c4d584fd3d00850/roles/44e1b9c3f51e473a8af9b883e80a74d2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:35:49.173956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bc87a-00eb-4133-8d5f-9e0ee970994b None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:49.202266 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1f66c-fcd4-44a2-93c2-e16439a344d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:49.203615 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1f66c-fcd4-44a2-93c2-e16439a344d6 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:49.203859 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1f66c-fcd4-44a2-93c2-e16439a344d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:49.204231 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1f66c-fcd4-44a2-93c2-e16439a344d6 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:49.205141 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1f66c-fcd4-44a2-93c2-e16439a344d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:49.205548 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1f66c-fcd4-44a2-93c2-e16439a344d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:49.207280 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1f66c-fcd4-44a2-93c2-e16439a344d6 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:49.224944 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 286/585] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:49.224944 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1f66c-fcd4-44a2-93c2-e16439a344d6 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:49.319908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bc87a-00eb-4133-8d5f-9e0ee970994b None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:49.334064 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1f66c-fcd4-44a2-93c2-e16439a344d6 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:49.362484 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd6cb5-c64d-407f-baff-e30163306415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:49.363162 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd6cb5-c64d-407f-baff-e30163306415 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:49.363445 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd6cb5-c64d-407f-baff-e30163306415 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:49.363718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd6cb5-c64d-407f-baff-e30163306415 None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:49.364550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd6cb5-c64d-407f-baff-e30163306415 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:49.364897 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd6cb5-c64d-407f-baff-e30163306415 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:49.366361 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd6cb5-c64d-407f-baff-e30163306415 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:49.376390 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843dabe-ad67-4c07-bda3-af0bb5c07b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:49.377259 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843dabe-ad67-4c07-bda3-af0bb5c07b98 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:49.377534 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843dabe-ad67-4c07-bda3-af0bb5c07b98 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:49.377802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843dabe-ad67-4c07-bda3-af0bb5c07b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:49.387959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 300/586] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Apr 14 21:35:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:49.389399 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd6cb5-c64d-407f-baff-e30163306415 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:49.390950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843dabe-ad67-4c07-bda3-af0bb5c07b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:49.392417 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843dabe-ad67-4c07-bda3-af0bb5c07b98 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:49.413139 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-d843dabe-ad67-4c07-bda3-af0bb5c07b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:49.414987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 287/587] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:49.415972 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843dabe-ad67-4c07-bda3-af0bb5c07b98 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:49.508150 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd6cb5-c64d-407f-baff-e30163306415 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:49.526746 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843dabe-ad67-4c07-bda3-af0bb5c07b98 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:49.543386 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b171b10-9a3b-4049-aabe-3620ab164d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:49.544188 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b171b10-9a3b-4049-aabe-3620ab164d40 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:49.544466 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b171b10-9a3b-4049-aabe-3620ab164d40 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:49.544863 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b171b10-9a3b-4049-aabe-3620ab164d40 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:49.553332 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b171b10-9a3b-4049-aabe-3620ab164d40 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:49.554959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b171b10-9a3b-4049-aabe-3620ab164d40 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:49.566034 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358d5c1-65eb-4507-8a26-daa34243a526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:49.567237 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358d5c1-65eb-4507-8a26-daa34243a526 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:49.567736 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358d5c1-65eb-4507-8a26-daa34243a526 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:49.568236 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358d5c1-65eb-4507-8a26-daa34243a526 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:49.568749 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-8b171b10-9a3b-4049-aabe-3620ab164d40 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 14 21:35:49.574518 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 301/588] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:49.575350 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b171b10-9a3b-4049-aabe-3620ab164d40 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:49.580311 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358d5c1-65eb-4507-8a26-daa34243a526 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:49.582162 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358d5c1-65eb-4507-8a26-daa34243a526 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:49.601241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-6358d5c1-65eb-4507-8a26-daa34243a526 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:49.607329 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 288/589] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:49.608461 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358d5c1-65eb-4507-8a26-daa34243a526 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:49.676607 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b171b10-9a3b-4049-aabe-3620ab164d40 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:49.709876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358d5c1-65eb-4507-8a26-daa34243a526 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:49.710419 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e15685-7e27-4194-b5ee-6f5074dedb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:49.710712 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e15685-7e27-4194-b5ee-6f5074dedb38 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:49.711244 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e15685-7e27-4194-b5ee-6f5074dedb38 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:49.711513 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e15685-7e27-4194-b5ee-6f5074dedb38 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:49.712233 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e15685-7e27-4194-b5ee-6f5074dedb38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:49.712537 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e15685-7e27-4194-b5ee-6f5074dedb38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:49.713946 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e15685-7e27-4194-b5ee-6f5074dedb38 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:49.730533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 302/590] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:49.731244 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e15685-7e27-4194-b5ee-6f5074dedb38 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:49.748015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb402d-1ef4-4606-9a22-e6a72118fc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:49.749009 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb402d-1ef4-4606-9a22-e6a72118fc39 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:49.750170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb402d-1ef4-4606-9a22-e6a72118fc39 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:49.750642 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb402d-1ef4-4606-9a22-e6a72118fc39 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:49.751695 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb402d-1ef4-4606-9a22-e6a72118fc39 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:49.752210 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb402d-1ef4-4606-9a22-e6a72118fc39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:49.753865 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb402d-1ef4-4606-9a22-e6a72118fc39 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:49.772091 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 289/591] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Apr 14 21:35:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:49.773357 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb402d-1ef4-4606-9a22-e6a72118fc39 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:49.837581 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e15685-7e27-4194-b5ee-6f5074dedb38 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:49.873269 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de50ba-efe3-40d2-86f9-63568b7c3be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:49.873930 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de50ba-efe3-40d2-86f9-63568b7c3be8 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:49.874201 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de50ba-efe3-40d2-86f9-63568b7c3be8 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:49.874514 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de50ba-efe3-40d2-86f9-63568b7c3be8 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:49.875241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de50ba-efe3-40d2-86f9-63568b7c3be8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:49.875556 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de50ba-efe3-40d2-86f9-63568b7c3be8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:49.877044 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de50ba-efe3-40d2-86f9-63568b7c3be8 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:49.878642 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb402d-1ef4-4606-9a22-e6a72118fc39 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:49.894291 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 303/592] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:49.894291 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de50ba-efe3-40d2-86f9-63568b7c3be8 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:49.919388 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d06a39-7341-44b0-a34d-1bc2595b6bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:49.920529 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d06a39-7341-44b0-a34d-1bc2595b6bd3 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:49.921054 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d06a39-7341-44b0-a34d-1bc2595b6bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:49.922061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d06a39-7341-44b0-a34d-1bc2595b6bd3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:49.929729 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d06a39-7341-44b0-a34d-1bc2595b6bd3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:49.931432 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d06a39-7341-44b0-a34d-1bc2595b6bd3 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:49.946514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-77d06a39-7341-44b0-a34d-1bc2595b6bd3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 14 21:35:49.948323 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 290/593] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:49.949389 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d06a39-7341-44b0-a34d-1bc2595b6bd3 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:50.004441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de50ba-efe3-40d2-86f9-63568b7c3be8 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:50.040124 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887f372-73a0-46f9-ba21-ff2c8ff9d808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:50.040912 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887f372-73a0-46f9-ba21-ff2c8ff9d808 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:50.041197 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887f372-73a0-46f9-ba21-ff2c8ff9d808 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:50.041474 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887f372-73a0-46f9-ba21-ff2c8ff9d808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:50.054073 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887f372-73a0-46f9-ba21-ff2c8ff9d808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:50.055581 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887f372-73a0-46f9-ba21-ff2c8ff9d808 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:50.059497 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d06a39-7341-44b0-a34d-1bc2595b6bd3 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:50.077110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-c887f372-73a0-46f9-ba21-ff2c8ff9d808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:50.083961 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 304/594] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:50.084843 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887f372-73a0-46f9-ba21-ff2c8ff9d808 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:50.100947 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046dbe4-6911-47e7-bd93-d1d782018ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:50.102218 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046dbe4-6911-47e7-bd93-d1d782018ecc None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:50.103058 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046dbe4-6911-47e7-bd93-d1d782018ecc None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:50.103553 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046dbe4-6911-47e7-bd93-d1d782018ecc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:50.113224 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046dbe4-6911-47e7-bd93-d1d782018ecc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:50.114689 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046dbe4-6911-47e7-bd93-d1d782018ecc None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:50.130282 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-f046dbe4-6911-47e7-bd93-d1d782018ecc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:35:50.136122 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 291/595] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:50.136122 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046dbe4-6911-47e7-bd93-d1d782018ecc None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:50.219509 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887f372-73a0-46f9-ba21-ff2c8ff9d808 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:50.239020 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046dbe4-6911-47e7-bd93-d1d782018ecc None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:50.267648 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3833d-e096-4361-a3aa-b24d8422ea8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:50.268325 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3833d-e096-4361-a3aa-b24d8422ea8b None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:50.268613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3833d-e096-4361-a3aa-b24d8422ea8b None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:50.268895 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3833d-e096-4361-a3aa-b24d8422ea8b None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:50.269744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3833d-e096-4361-a3aa-b24d8422ea8b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:50.270050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3833d-e096-4361-a3aa-b24d8422ea8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:50.271613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3833d-e096-4361-a3aa-b24d8422ea8b None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:50.282133 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8b535-3123-4977-bb99-4c8834f49d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:50.283200 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8b535-3123-4977-bb99-4c8834f49d66 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:50.283681 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8b535-3123-4977-bb99-4c8834f49d66 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:50.284182 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8b535-3123-4977-bb99-4c8834f49d66 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:50.285198 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8b535-3123-4977-bb99-4c8834f49d66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:50.285718 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8b535-3123-4977-bb99-4c8834f49d66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:50.288268 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8b535-3123-4977-bb99-4c8834f49d66 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:50.294378 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 305/596] 10.222.0.52 () {56 vars in 1139 bytes} [Thu Apr 14 21:35:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:50.295207 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3833d-e096-4361-a3aa-b24d8422ea8b None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:50.303761 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 292/597] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:50.304950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8b535-3123-4977-bb99-4c8834f49d66 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:50.406730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3833d-e096-4361-a3aa-b24d8422ea8b None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:50.427040 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8b535-3123-4977-bb99-4c8834f49d66 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:50.451642 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb81b8-2625-4eeb-92eb-fd63591ee41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:50.452885 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb81b8-2625-4eeb-92eb-fd63591ee41c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:50.453655 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb81b8-2625-4eeb-92eb-fd63591ee41c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:50.454409 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb81b8-2625-4eeb-92eb-fd63591ee41c None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:50.455548 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb81b8-2625-4eeb-92eb-fd63591ee41c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:50.456356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb81b8-2625-4eeb-92eb-fd63591ee41c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:50.458624 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb81b8-2625-4eeb-92eb-fd63591ee41c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:50.461101 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173fed6-0397-4182-9814-c9e2d4cf2e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:50.461893 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173fed6-0397-4182-9814-c9e2d4cf2e11 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:50.462171 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173fed6-0397-4182-9814-c9e2d4cf2e11 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:50.462444 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173fed6-0397-4182-9814-c9e2d4cf2e11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:50.473650 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173fed6-0397-4182-9814-c9e2d4cf2e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:50.475133 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173fed6-0397-4182-9814-c9e2d4cf2e11 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:50.480689 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 306/598] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:50.482272 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb81b8-2625-4eeb-92eb-fd63591ee41c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:50.497001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-c173fed6-0397-4182-9814-c9e2d4cf2e11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:50.503013 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 293/599] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:50.503838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173fed6-0397-4182-9814-c9e2d4cf2e11 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:50.598836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb81b8-2625-4eeb-92eb-fd63591ee41c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:50.615046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173fed6-0397-4182-9814-c9e2d4cf2e11 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:50.640368 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dcbd3-fd25-40df-bf78-444f91681459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:50.641613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dcbd3-fd25-40df-bf78-444f91681459 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:50.642130 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dcbd3-fd25-40df-bf78-444f91681459 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:50.642623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dcbd3-fd25-40df-bf78-444f91681459 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:50.649192 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd29522-f01e-4744-8fd6-3b7aa82f6e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:50.650076 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd29522-f01e-4744-8fd6-3b7aa82f6e08 None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:50.650356 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd29522-f01e-4744-8fd6-3b7aa82f6e08 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:50.650627 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd29522-f01e-4744-8fd6-3b7aa82f6e08 None admin] PATH_INFO: `/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/e7f3ea629181433eb8c6d5dbc354c141/roles/44e1b9c3f51e473a8af9b883e80a74d2` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:50.651406 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314dcbd3-fd25-40df-bf78-444f91681459 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:50.653318 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314dcbd3-fd25-40df-bf78-444f91681459 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:50.665769 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd29522-f01e-4744-8fd6-3b7aa82f6e08 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3c1bb37aa1c407782b2f5501ae1f10a, user_id=e7f3ea629181433eb8c6d5dbc354c141, role_id=44e1b9c3f51e473a8af9b883e80a74d2)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:50.667651 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd29522-f01e-4744-8fd6-3b7aa82f6e08 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:50.669117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-314dcbd3-fd25-40df-bf78-444f91681459 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:35:50.676035 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 307/600] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:50.676035 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dcbd3-fd25-40df-bf78-444f91681459 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:50.768283 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 294/601] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:35:50 2022] PUT /identity/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/e7f3ea629181433eb8c6d5dbc354c141/roles/44e1b9c3f51e473a8af9b883e80a74d2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:35:50.770429 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd29522-f01e-4744-8fd6-3b7aa82f6e08 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:50.789899 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dcbd3-fd25-40df-bf78-444f91681459 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:50.850261 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5aa4f6-181d-4ff9-98ac-1d174daf607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:50.850846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aa4f6-181d-4ff9-98ac-1d174daf607c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:50.851123 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aa4f6-181d-4ff9-98ac-1d174daf607c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:50.851397 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aa4f6-181d-4ff9-98ac-1d174daf607c None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:50.852175 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5aa4f6-181d-4ff9-98ac-1d174daf607c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:50.852485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5aa4f6-181d-4ff9-98ac-1d174daf607c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:50.853959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5aa4f6-181d-4ff9-98ac-1d174daf607c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:50.875828 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 308/602] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:50.882919 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd29522-f01e-4744-8fd6-3b7aa82f6e08 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:50.890296 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5aa4f6-181d-4ff9-98ac-1d174daf607c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:50.920744 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389abba9-d2fd-4f64-a1b6-7ff392c48845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:50.922055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389abba9-d2fd-4f64-a1b6-7ff392c48845 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:50.922339 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389abba9-d2fd-4f64-a1b6-7ff392c48845 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:50.922615 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389abba9-d2fd-4f64-a1b6-7ff392c48845 None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:50.923436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389abba9-d2fd-4f64-a1b6-7ff392c48845 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:50.923746 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389abba9-d2fd-4f64-a1b6-7ff392c48845 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:50.925256 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389abba9-d2fd-4f64-a1b6-7ff392c48845 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:50.938000 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 295/603] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:50.944275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389abba9-d2fd-4f64-a1b6-7ff392c48845 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:51.062485 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389abba9-d2fd-4f64-a1b6-7ff392c48845 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:51.087504 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5aa4f6-181d-4ff9-98ac-1d174daf607c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:51.101336 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88166b-927e-4df7-8d05-addedb47ffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:51.102343 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88166b-927e-4df7-8d05-addedb47ffd4 None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:51.103035 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88166b-927e-4df7-8d05-addedb47ffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:51.103322 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88166b-927e-4df7-8d05-addedb47ffd4 None admin] PATH_INFO: `/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/f7f96ebcce204c729bf8e59d21dcc5d9/roles/44e1b9c3f51e473a8af9b883e80a74d2` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:51.124037 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88166b-927e-4df7-8d05-addedb47ffd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3c1bb37aa1c407782b2f5501ae1f10a, user_id=f7f96ebcce204c729bf8e59d21dcc5d9, role_id=44e1b9c3f51e473a8af9b883e80a74d2)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:51.125051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcd890-f797-4f97-a5b2-0e9066709b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:51.125614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88166b-927e-4df7-8d05-addedb47ffd4 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:51.126039 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd890-f797-4f97-a5b2-0e9066709b77 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:51.126322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd890-f797-4f97-a5b2-0e9066709b77 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:51.126591 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd890-f797-4f97-a5b2-0e9066709b77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:51.134304 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcd890-f797-4f97-a5b2-0e9066709b77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:51.135761 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcd890-f797-4f97-a5b2-0e9066709b77 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:51.150254 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-27bcd890-f797-4f97-a5b2-0e9066709b77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:35:51.151760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 309/604] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:51.153091 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff5300-90e1-4c84-865a-90bf7d155cc2 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:51.153382 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff5300-90e1-4c84-865a-90bf7d155cc2 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:51.153660 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff5300-90e1-4c84-865a-90bf7d155cc2 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:51.155147 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 310/605] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:51.158661 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff5300-90e1-4c84-865a-90bf7d155cc2 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:51.245752 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 296/606] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:35:50 2022] PUT /identity/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/f7f96ebcce204c729bf8e59d21dcc5d9/roles/44e1b9c3f51e473a8af9b883e80a74d2 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:35:51.247045 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bad39-1929-47cb-9383-db7fc5139f5b None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:51.247332 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bad39-1929-47cb-9383-db7fc5139f5b None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:51.247607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bad39-1929-47cb-9383-db7fc5139f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:51.275506 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-096bad39-1929-47cb-9383-db7fc5139f5b None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:51.275959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff5300-90e1-4c84-865a-90bf7d155cc2 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:51.276734 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-096bad39-1929-47cb-9383-db7fc5139f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:51.344555 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbb040-fec9-4896-8e57-f5cd9b0af126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:51.345251 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbb040-fec9-4896-8e57-f5cd9b0af126 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:51.345533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbb040-fec9-4896-8e57-f5cd9b0af126 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:51.345808 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbb040-fec9-4896-8e57-f5cd9b0af126 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:51.347468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbb040-fec9-4896-8e57-f5cd9b0af126 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:51.347822 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbb040-fec9-4896-8e57-f5cd9b0af126 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:51.352887 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbb040-fec9-4896-8e57-f5cd9b0af126 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:51.378131 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 311/607] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:35:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:51.383074 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbb040-fec9-4896-8e57-f5cd9b0af126 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:51.415769 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 297/608] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:51.452450 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bad39-1929-47cb-9383-db7fc5139f5b None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:51.535484 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbb040-fec9-4896-8e57-f5cd9b0af126 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:51.571642 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd7d12-557a-439c-9055-56017d7557d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:51.572563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd7d12-557a-439c-9055-56017d7557d1 None admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:51.572563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd7d12-557a-439c-9055-56017d7557d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:51.573132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd7d12-557a-439c-9055-56017d7557d1 None admin] PATH_INFO: `/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/1bfbd6a387e44037a58e521230783347/roles/44e1b9c3f51e473a8af9b883e80a74d2` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:51.588900 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd7d12-557a-439c-9055-56017d7557d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3c1bb37aa1c407782b2f5501ae1f10a, user_id=1bfbd6a387e44037a58e521230783347, role_id=44e1b9c3f51e473a8af9b883e80a74d2)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:51.589411 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bad39-1929-47cb-9383-db7fc5139f5b None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:51.590364 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd7d12-557a-439c-9055-56017d7557d1 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:51.630677 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a046e3-1e27-40c0-b7cc-e81225b25b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:51.632159 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a046e3-1e27-40c0-b7cc-e81225b25b69 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:51.632669 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a046e3-1e27-40c0-b7cc-e81225b25b69 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:51.633162 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a046e3-1e27-40c0-b7cc-e81225b25b69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:51.645064 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a046e3-1e27-40c0-b7cc-e81225b25b69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:51.653172 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-04a046e3-1e27-40c0-b7cc-e81225b25b69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:35:51.655048 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 298/609] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:51.657326 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6281360-eb0f-4fc1-aa53-3a5aa110f339 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:51.657817 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6281360-eb0f-4fc1-aa53-3a5aa110f339 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:51.658303 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6281360-eb0f-4fc1-aa53-3a5aa110f339 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:51.660114 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 299/610] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:51.664337 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6281360-eb0f-4fc1-aa53-3a5aa110f339 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:51.684605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 312/611] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:35:51 2022] PUT /identity/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/1bfbd6a387e44037a58e521230783347/roles/44e1b9c3f51e473a8af9b883e80a74d2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:35:51.684907 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b148d1-10e7-468c-a54a-e8b7ec444155 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:51.685745 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b148d1-10e7-468c-a54a-e8b7ec444155 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:51.686646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b148d1-10e7-468c-a54a-e8b7ec444155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:51.731242 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-78b148d1-10e7-468c-a54a-e8b7ec444155 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:51.733640 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-78b148d1-10e7-468c-a54a-e8b7ec444155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:51.886717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6281360-eb0f-4fc1-aa53-3a5aa110f339 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:51.894015 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 313/612] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:51.922705 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b148d1-10e7-468c-a54a-e8b7ec444155 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:51.930695 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d72ec-d8a7-48c4-9193-7b02f6d9c9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:51.931365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d72ec-d8a7-48c4-9193-7b02f6d9c9ae None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:51.931639 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d72ec-d8a7-48c4-9193-7b02f6d9c9ae None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:51.931909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d72ec-d8a7-48c4-9193-7b02f6d9c9ae None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:51.932803 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d72ec-d8a7-48c4-9193-7b02f6d9c9ae None admin] RBAC: Adding query filter params (name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:51.933009 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d72ec-d8a7-48c4-9193-7b02f6d9c9ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:51.934498 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d72ec-d8a7-48c4-9193-7b02f6d9c9ae None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:51.944863 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 300/613] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:35:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:51.951724 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d72ec-d8a7-48c4-9193-7b02f6d9c9ae None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:52.030882 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b148d1-10e7-468c-a54a-e8b7ec444155 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:52.061677 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d72ec-d8a7-48c4-9193-7b02f6d9c9ae None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:52.068842 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2f55e-d613-4c32-ad21-8665c8c4750d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:52.070006 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2f55e-d613-4c32-ad21-8665c8c4750d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:52.070489 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2f55e-d613-4c32-ad21-8665c8c4750d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:52.070962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2f55e-d613-4c32-ad21-8665c8c4750d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:52.081921 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2f55e-d613-4c32-ad21-8665c8c4750d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:52.089664 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-bef2f55e-d613-4c32-ad21-8665c8c4750d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:35:52.094799 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 314/614] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:52.097913 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2f55e-d613-4c32-ad21-8665c8c4750d None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:52.106349 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb19ea9-48b7-4d1b-a9f3-44f269184459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:52.107364 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb19ea9-48b7-4d1b-a9f3-44f269184459 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:52.107832 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb19ea9-48b7-4d1b-a9f3-44f269184459 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:52.109104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb19ea9-48b7-4d1b-a9f3-44f269184459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:52.135002 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb19ea9-48b7-4d1b-a9f3-44f269184459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:52.136527 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb19ea9-48b7-4d1b-a9f3-44f269184459 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:52.162814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-beb19ea9-48b7-4d1b-a9f3-44f269184459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:52.173903 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 301/615] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:52.181606 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb19ea9-48b7-4d1b-a9f3-44f269184459 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:52.205392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2f55e-d613-4c32-ad21-8665c8c4750d None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:52.240393 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3dc36-90d3-4a44-add2-92176c3586ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:52.241464 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3dc36-90d3-4a44-add2-92176c3586ab None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:52.241946 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3dc36-90d3-4a44-add2-92176c3586ab None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:52.242417 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3dc36-90d3-4a44-add2-92176c3586ab None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:52.243370 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3dc36-90d3-4a44-add2-92176c3586ab None admin] RBAC: Adding query filter params (name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:52.243875 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3dc36-90d3-4a44-add2-92176c3586ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:52.245494 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3dc36-90d3-4a44-add2-92176c3586ab None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:52.259339 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 315/616] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:35:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:52.260948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3dc36-90d3-4a44-add2-92176c3586ab None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:52.361676 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3dc36-90d3-4a44-add2-92176c3586ab None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:52.370069 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb19ea9-48b7-4d1b-a9f3-44f269184459 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:52.395863 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87f331-0b16-4026-879d-fc5b9c659f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:52.397000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87f331-0b16-4026-879d-fc5b9c659f35 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:52.397484 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87f331-0b16-4026-879d-fc5b9c659f35 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:52.397973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87f331-0b16-4026-879d-fc5b9c659f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:52.409312 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87f331-0b16-4026-879d-fc5b9c659f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:52.411077 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87f331-0b16-4026-879d-fc5b9c659f35 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:52.433819 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ae837-1de7-4ff1-a0ba-a8c164ee9da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:52.434780 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ae837-1de7-4ff1-a0ba-a8c164ee9da9 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:52.435265 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ae837-1de7-4ff1-a0ba-a8c164ee9da9 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:52.435757 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ae837-1de7-4ff1-a0ba-a8c164ee9da9 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:52.436759 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ae837-1de7-4ff1-a0ba-a8c164ee9da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:52.437428 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-ba87f331-0b16-4026-879d-fc5b9c659f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:52.437940 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ae837-1de7-4ff1-a0ba-a8c164ee9da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:52.439500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ae837-1de7-4ff1-a0ba-a8c164ee9da9 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:52.440967 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 316/617] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:52.453917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 302/618] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:52.457117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87f331-0b16-4026-879d-fc5b9c659f35 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:52.471229 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ae837-1de7-4ff1-a0ba-a8c164ee9da9 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:52.599496 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ae837-1de7-4ff1-a0ba-a8c164ee9da9 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:52.641719 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87f331-0b16-4026-879d-fc5b9c659f35 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:52.664514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331a04a-fff0-4a70-926a-6f63eed1cc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:52.666651 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331a04a-fff0-4a70-926a-6f63eed1cc30 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:52.667928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331a04a-fff0-4a70-926a-6f63eed1cc30 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:52.668407 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331a04a-fff0-4a70-926a-6f63eed1cc30 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:52.681758 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331a04a-fff0-4a70-926a-6f63eed1cc30 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:52.683258 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331a04a-fff0-4a70-926a-6f63eed1cc30 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:52.702029 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-0331a04a-fff0-4a70-926a-6f63eed1cc30 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 14 21:35:52.708681 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 303/619] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:35:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:52.710368 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331a04a-fff0-4a70-926a-6f63eed1cc30 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:52.714870 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfa9db-0a73-4b7b-b683-ae959d457e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:52.715566 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa9db-0a73-4b7b-b683-ae959d457e78 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:52.715844 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa9db-0a73-4b7b-b683-ae959d457e78 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:52.716118 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa9db-0a73-4b7b-b683-ae959d457e78 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:52.716877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfa9db-0a73-4b7b-b683-ae959d457e78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:52.717183 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfa9db-0a73-4b7b-b683-ae959d457e78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:52.719740 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfa9db-0a73-4b7b-b683-ae959d457e78 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:52.743606 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 317/620] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:52.748889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfa9db-0a73-4b7b-b683-ae959d457e78 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:52.869051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfa9db-0a73-4b7b-b683-ae959d457e78 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:52.904101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376bb6a-e271-4d6e-96f0-5240104bd718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:52.906363 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376bb6a-e271-4d6e-96f0-5240104bd718 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:52.906883 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376bb6a-e271-4d6e-96f0-5240104bd718 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:52.907435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376bb6a-e271-4d6e-96f0-5240104bd718 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:52.915344 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376bb6a-e271-4d6e-96f0-5240104bd718 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:52.917061 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376bb6a-e271-4d6e-96f0-5240104bd718 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:52.923014 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331a04a-fff0-4a70-926a-6f63eed1cc30 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:52.932232 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-5376bb6a-e271-4d6e-96f0-5240104bd718 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 14 21:35:52.934154 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 318/621] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:52.939967 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376bb6a-e271-4d6e-96f0-5240104bd718 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:52.998307 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a895d0e-36b6-4e16-8d12-7d7e47e5fece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:52.998990 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895d0e-36b6-4e16-8d12-7d7e47e5fece None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:52.999328 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895d0e-36b6-4e16-8d12-7d7e47e5fece None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:52.999597 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895d0e-36b6-4e16-8d12-7d7e47e5fece None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:53.000442 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a895d0e-36b6-4e16-8d12-7d7e47e5fece None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:53.000873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a895d0e-36b6-4e16-8d12-7d7e47e5fece None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:53.002303 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a895d0e-36b6-4e16-8d12-7d7e47e5fece None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:53.035171 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 304/622] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Apr 14 21:35:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:53.049986 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a895d0e-36b6-4e16-8d12-7d7e47e5fece None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:53.119762 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376bb6a-e271-4d6e-96f0-5240104bd718 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:53.193581 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417905e-cee4-4e8e-abbd-203e358f8171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:53.194605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417905e-cee4-4e8e-abbd-203e358f8171 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:53.195104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417905e-cee4-4e8e-abbd-203e358f8171 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:53.195567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417905e-cee4-4e8e-abbd-203e358f8171 None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:53.196612 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417905e-cee4-4e8e-abbd-203e358f8171 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:53.197130 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417905e-cee4-4e8e-abbd-203e358f8171 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:53.198743 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417905e-cee4-4e8e-abbd-203e358f8171 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:53.231166 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 319/623] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Apr 14 21:35:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:53.238157 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417905e-cee4-4e8e-abbd-203e358f8171 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:53.251708 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a895d0e-36b6-4e16-8d12-7d7e47e5fece None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:53.316427 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb482c-6793-4725-bb9d-2ebe681da824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:53.317600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb482c-6793-4725-bb9d-2ebe681da824 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:53.318089 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb482c-6793-4725-bb9d-2ebe681da824 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:53.318552 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb482c-6793-4725-bb9d-2ebe681da824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:53.337763 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb482c-6793-4725-bb9d-2ebe681da824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:53.340617 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb482c-6793-4725-bb9d-2ebe681da824 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:53.368867 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-28cb482c-6793-4725-bb9d-2ebe681da824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:53.378105 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 305/624] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:53.384964 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb482c-6793-4725-bb9d-2ebe681da824 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:53.428114 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417905e-cee4-4e8e-abbd-203e358f8171 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:53.490812 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01032c9-c7ea-4a61-a1c7-479a344d8e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:53.491387 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01032c9-c7ea-4a61-a1c7-479a344d8e83 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:53.491663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01032c9-c7ea-4a61-a1c7-479a344d8e83 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:53.491933 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01032c9-c7ea-4a61-a1c7-479a344d8e83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:53.511493 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb482c-6793-4725-bb9d-2ebe681da824 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:53.547574 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82b95e-2e6f-492e-9b7b-d6680f647b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:53.548611 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82b95e-2e6f-492e-9b7b-d6680f647b66 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:53.549087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82b95e-2e6f-492e-9b7b-d6680f647b66 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:53.549548 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82b95e-2e6f-492e-9b7b-d6680f647b66 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:53.550481 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82b95e-2e6f-492e-9b7b-d6680f647b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:53.550975 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82b95e-2e6f-492e-9b7b-d6680f647b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:53.552530 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82b95e-2e6f-492e-9b7b-d6680f647b66 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:53.564652 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 306/625] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:35:53.566247 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04708132-03bb-440f-8323-b8a95f63be1c None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:53.566745 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04708132-03bb-440f-8323-b8a95f63be1c None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:53.567226 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04708132-03bb-440f-8323-b8a95f63be1c None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:53.568876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 307/626] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:53.569866 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04708132-03bb-440f-8323-b8a95f63be1c None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:53.582341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01032c9-c7ea-4a61-a1c7-479a344d8e83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:53.583819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01032c9-c7ea-4a61-a1c7-479a344d8e83 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:53.676387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04708132-03bb-440f-8323-b8a95f63be1c None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:53.692477 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 320/627] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:53.693941 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc23f0e-068e-4340-afb4-cad9056c9c1b None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:53.694119 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc23f0e-068e-4340-afb4-cad9056c9c1b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:53.694392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc23f0e-068e-4340-afb4-cad9056c9c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:53.711448 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-cfc23f0e-068e-4340-afb4-cad9056c9c1b None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:53.712628 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-cfc23f0e-068e-4340-afb4-cad9056c9c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:53.712988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119c519-f63a-41bc-9a22-dee05203e3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:53.713986 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119c519-f63a-41bc-9a22-dee05203e3de None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:53.714455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119c519-f63a-41bc-9a22-dee05203e3de None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:53.714937 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119c519-f63a-41bc-9a22-dee05203e3de None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:53.722053 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119c519-f63a-41bc-9a22-dee05203e3de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:53.723754 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119c519-f63a-41bc-9a22-dee05203e3de None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:53.738034 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-9119c519-f63a-41bc-9a22-dee05203e3de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:35:53.739821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 308/628] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:35:53.740890 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119c519-f63a-41bc-9a22-dee05203e3de None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:53.788413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 321/629] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:53.789317 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc23f0e-068e-4340-afb4-cad9056c9c1b None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:53.841092 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119c519-f63a-41bc-9a22-dee05203e3de None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:53.875827 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7461b49-7e25-4b6f-a860-9bb198cb0c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:53.877043 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7461b49-7e25-4b6f-a860-9bb198cb0c69 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:53.877537 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7461b49-7e25-4b6f-a860-9bb198cb0c69 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:53.878001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7461b49-7e25-4b6f-a860-9bb198cb0c69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:53.888355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7461b49-7e25-4b6f-a860-9bb198cb0c69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:53.890729 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7461b49-7e25-4b6f-a860-9bb198cb0c69 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:53.908916 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-c7461b49-7e25-4b6f-a860-9bb198cb0c69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:53.910627 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 309/630] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:53.911551 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7461b49-7e25-4b6f-a860-9bb198cb0c69 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:53.912781 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc23f0e-068e-4340-afb4-cad9056c9c1b None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:53.949479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000280d-899d-4040-857d-cd12d167b105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:53.950254 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000280d-899d-4040-857d-cd12d167b105 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:53.950602 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000280d-899d-4040-857d-cd12d167b105 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:53.950946 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000280d-899d-4040-857d-cd12d167b105 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:53.951799 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000280d-899d-4040-857d-cd12d167b105 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:53.952171 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000280d-899d-4040-857d-cd12d167b105 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:53.955003 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000280d-899d-4040-857d-cd12d167b105 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:53.968003 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 322/631] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:35:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:53.969158 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000280d-899d-4040-857d-cd12d167b105 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:54.027995 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7461b49-7e25-4b6f-a860-9bb198cb0c69 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:54.060431 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ac817-8bd4-4be2-a952-510266fa3623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:54.061276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac817-8bd4-4be2-a952-510266fa3623 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:54.062058 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac817-8bd4-4be2-a952-510266fa3623 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:54.062340 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac817-8bd4-4be2-a952-510266fa3623 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:54.072303 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000280d-899d-4040-857d-cd12d167b105 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:54.074436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ac817-8bd4-4be2-a952-510266fa3623 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:54.082518 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-836ac817-8bd4-4be2-a952-510266fa3623 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:35:54.083803 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 310/632] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:54.084597 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ac817-8bd4-4be2-a952-510266fa3623 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:54.115790 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d70c0d-9f22-4ae8-ab56-a1652b89f0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:54.116453 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d70c0d-9f22-4ae8-ab56-a1652b89f0dd None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:54.116768 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d70c0d-9f22-4ae8-ab56-a1652b89f0dd None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:54.117039 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d70c0d-9f22-4ae8-ab56-a1652b89f0dd None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:54.117761 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d70c0d-9f22-4ae8-ab56-a1652b89f0dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:54.118061 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d70c0d-9f22-4ae8-ab56-a1652b89f0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:54.119421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d70c0d-9f22-4ae8-ab56-a1652b89f0dd None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:54.136141 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 323/633] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:54.136141 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dca300-2e83-4c8c-a425-fda8ba281ec1 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:54.136141 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dca300-2e83-4c8c-a425-fda8ba281ec1 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:54.136141 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dca300-2e83-4c8c-a425-fda8ba281ec1 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:54.136141 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 324/634] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:54.136141 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dca300-2e83-4c8c-a425-fda8ba281ec1 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:54.195525 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ac817-8bd4-4be2-a952-510266fa3623 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:54.231381 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c48e3-16c5-4e97-b772-4afe6c3c0c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:54.232263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c48e3-16c5-4e97-b772-4afe6c3c0c9b None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:54.232540 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c48e3-16c5-4e97-b772-4afe6c3c0c9b None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:54.232847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c48e3-16c5-4e97-b772-4afe6c3c0c9b None admin] PATH_INFO: `/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/360bf55488d046c4be98a903d113c0fc/roles/44e1b9c3f51e473a8af9b883e80a74d2` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:54.238563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dca300-2e83-4c8c-a425-fda8ba281ec1 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:54.247554 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c48e3-16c5-4e97-b772-4afe6c3c0c9b None admin] RBAC: Authorizing `identity:create_grant(project_id=a3c1bb37aa1c407782b2f5501ae1f10a, user_id=360bf55488d046c4be98a903d113c0fc, role_id=44e1b9c3f51e473a8af9b883e80a74d2)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:54.249024 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c48e3-16c5-4e97-b772-4afe6c3c0c9b None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:54.271443 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b5f19-765b-487f-a56e-d9c03d3c58d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:54.272101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b5f19-765b-487f-a56e-d9c03d3c58d7 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:54.272374 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b5f19-765b-487f-a56e-d9c03d3c58d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:54.272667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b5f19-765b-487f-a56e-d9c03d3c58d7 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:54.274158 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b5f19-765b-487f-a56e-d9c03d3c58d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:54.274158 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b5f19-765b-487f-a56e-d9c03d3c58d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:54.275082 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b5f19-765b-487f-a56e-d9c03d3c58d7 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:54.283818 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 325/635] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:35:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:54.284357 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b5f19-765b-487f-a56e-d9c03d3c58d7 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:54.357246 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 311/636] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:35:54 2022] PUT /identity/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/360bf55488d046c4be98a903d113c0fc/roles/44e1b9c3f51e473a8af9b883e80a74d2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:35:54.357246 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c07556-6e33-4d14-a6e6-f15892f253f8 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:54.357246 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c07556-6e33-4d14-a6e6-f15892f253f8 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:54.357246 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c07556-6e33-4d14-a6e6-f15892f253f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:54.377630 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d6c07556-6e33-4d14-a6e6-f15892f253f8 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:54.378979 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d6c07556-6e33-4d14-a6e6-f15892f253f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:54.404830 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b5f19-765b-487f-a56e-d9c03d3c58d7 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:54.451795 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbfcab-9bff-45fb-8920-200e9f4de453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:54.452949 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbfcab-9bff-45fb-8920-200e9f4de453 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:54.453227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbfcab-9bff-45fb-8920-200e9f4de453 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:54.453499 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbfcab-9bff-45fb-8920-200e9f4de453 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:54.459806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 312/637] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:54.461067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c07556-6e33-4d14-a6e6-f15892f253f8 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:54.462401 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbfcab-9bff-45fb-8920-200e9f4de453 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:54.464123 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbfcab-9bff-45fb-8920-200e9f4de453 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:54.484745 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-05dbfcab-9bff-45fb-8920-200e9f4de453 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:35:54.486601 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 326/638] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:54.488208 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda04e8b-0abb-49ae-90c7-2b11eadd9cb6 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:54.488685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda04e8b-0abb-49ae-90c7-2b11eadd9cb6 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:54.488962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda04e8b-0abb-49ae-90c7-2b11eadd9cb6 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:54.491218 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 327/639] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:54.492556 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda04e8b-0abb-49ae-90c7-2b11eadd9cb6 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:54.570841 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c07556-6e33-4d14-a6e6-f15892f253f8 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:54.601978 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda04e8b-0abb-49ae-90c7-2b11eadd9cb6 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:54.604785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aec5b3-7b61-4c84-a826-60e07346a688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:54.605452 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aec5b3-7b61-4c84-a826-60e07346a688 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:54.605729 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aec5b3-7b61-4c84-a826-60e07346a688 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:54.606014 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aec5b3-7b61-4c84-a826-60e07346a688 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:54.618203 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aec5b3-7b61-4c84-a826-60e07346a688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:54.619659 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aec5b3-7b61-4c84-a826-60e07346a688 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:54.636942 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dd77a-e895-4adb-adcf-77a54e7b161f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:54.637870 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-19aec5b3-7b61-4c84-a826-60e07346a688 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:54.638410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dd77a-e895-4adb-adcf-77a54e7b161f None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:54.638904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dd77a-e895-4adb-adcf-77a54e7b161f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:54.639077 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 313/640] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:54.639594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dd77a-e895-4adb-adcf-77a54e7b161f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:54.639879 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aec5b3-7b61-4c84-a826-60e07346a688 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:54.653652 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dd77a-e895-4adb-adcf-77a54e7b161f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:54.661534 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-ac5dd77a-e895-4adb-adcf-77a54e7b161f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:35:54.662746 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 328/641] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:54.663907 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e651d6-9648-4a0a-a3cb-3ea05c3c5664 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:54.664184 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e651d6-9648-4a0a-a3cb-3ea05c3c5664 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:54.664452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e651d6-9648-4a0a-a3cb-3ea05c3c5664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:54.682263 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-53e651d6-9648-4a0a-a3cb-3ea05c3c5664 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:54.683432 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-53e651d6-9648-4a0a-a3cb-3ea05c3c5664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:54.746196 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aec5b3-7b61-4c84-a826-60e07346a688 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:54.750815 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 329/642] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:54.751832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e651d6-9648-4a0a-a3cb-3ea05c3c5664 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:54.780992 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854eb37-ed2e-4995-bba3-40aaff5e5636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:54.782013 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854eb37-ed2e-4995-bba3-40aaff5e5636 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:54.782292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854eb37-ed2e-4995-bba3-40aaff5e5636 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:54.782565 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854eb37-ed2e-4995-bba3-40aaff5e5636 None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:54.783359 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854eb37-ed2e-4995-bba3-40aaff5e5636 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:54.783665 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854eb37-ed2e-4995-bba3-40aaff5e5636 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:54.785112 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854eb37-ed2e-4995-bba3-40aaff5e5636 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:54.796964 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 314/643] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:35:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:54.797972 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854eb37-ed2e-4995-bba3-40aaff5e5636 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:54.876081 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e651d6-9648-4a0a-a3cb-3ea05c3c5664 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:54.895241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854eb37-ed2e-4995-bba3-40aaff5e5636 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:54.909267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccbd22-d9e6-4a20-b75a-1f30cc003507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:54.909926 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccbd22-d9e6-4a20-b75a-1f30cc003507 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:54.910206 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccbd22-d9e6-4a20-b75a-1f30cc003507 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:54.910486 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccbd22-d9e6-4a20-b75a-1f30cc003507 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:54.911331 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccbd22-d9e6-4a20-b75a-1f30cc003507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:54.911628 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccbd22-d9e6-4a20-b75a-1f30cc003507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:54.913033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccbd22-d9e6-4a20-b75a-1f30cc003507 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:54.924452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 330/644] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:54.928895 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccbd22-d9e6-4a20-b75a-1f30cc003507 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:54.933491 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa69fec-85c8-4270-82af-64b333c93e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:54.934163 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa69fec-85c8-4270-82af-64b333c93e1b None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:54.934854 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa69fec-85c8-4270-82af-64b333c93e1b None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:54.935163 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa69fec-85c8-4270-82af-64b333c93e1b None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:54.935934 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa69fec-85c8-4270-82af-64b333c93e1b None admin] RBAC: Adding query filter params (name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:54.936666 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa69fec-85c8-4270-82af-64b333c93e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:54.938046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa69fec-85c8-4270-82af-64b333c93e1b None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:54.946781 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 315/645] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:35:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:54.947467 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa69fec-85c8-4270-82af-64b333c93e1b None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:55.034539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccbd22-d9e6-4a20-b75a-1f30cc003507 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:55.053781 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa69fec-85c8-4270-82af-64b333c93e1b None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:55.072894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9663354-1a83-4ea0-8e8c-ae6bae4af069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:55.073684 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9663354-1a83-4ea0-8e8c-ae6bae4af069 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:55.073959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9663354-1a83-4ea0-8e8c-ae6bae4af069 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:55.074226 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9663354-1a83-4ea0-8e8c-ae6bae4af069 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:55.085407 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9663354-1a83-4ea0-8e8c-ae6bae4af069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:55.087435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab99b5d-bfb6-4970-bda6-6126ccac46bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:55.088090 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab99b5d-bfb6-4970-bda6-6126ccac46bc None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:55.088372 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab99b5d-bfb6-4970-bda6-6126ccac46bc None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:55.088674 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab99b5d-bfb6-4970-bda6-6126ccac46bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:55.089504 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab99b5d-bfb6-4970-bda6-6126ccac46bc None admin] RBAC: Adding query filter params (role.id=44e1b9c3f51e473a8af9b883e80a74d2, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=3d261ec6e42f4be08c4d584fd3d00850) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:55.089812 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab99b5d-bfb6-4970-bda6-6126ccac46bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:55.091257 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab99b5d-bfb6-4970-bda6-6126ccac46bc None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:55.092519 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-f9663354-1a83-4ea0-8e8c-ae6bae4af069 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:35:55.094658 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 331/646] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:55.095419 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9663354-1a83-4ea0-8e8c-ae6bae4af069 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:55.112976 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 316/647] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:35:54 2022] GET /identity/v3/role_assignments?user.id=3d261ec6e42f4be08c4d584fd3d00850&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=44e1b9c3f51e473a8af9b883e80a74d2 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:55.112976 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab99b5d-bfb6-4970-bda6-6126ccac46bc None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:55.220869 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9663354-1a83-4ea0-8e8c-ae6bae4af069 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:55.225835 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab99b5d-bfb6-4970-bda6-6126ccac46bc None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:55.258470 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5befa-847c-4258-b2fb-c13533d2d43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:55.259410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5befa-847c-4258-b2fb-c13533d2d43b None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:55.259760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5befa-847c-4258-b2fb-c13533d2d43b None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:55.260141 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5befa-847c-4258-b2fb-c13533d2d43b None admin] PATH_INFO: `/v3/users/nova` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:55.263578 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4ba71-b1e0-4457-86b1-903c8c2c2bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:55.264387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4ba71-b1e0-4457-86b1-903c8c2c2bff None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:55.265425 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4ba71-b1e0-4457-86b1-903c8c2c2bff None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:55.265838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4ba71-b1e0-4457-86b1-903c8c2c2bff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:55.269885 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5befa-847c-4258-b2fb-c13533d2d43b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:55.271509 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5befa-847c-4258-b2fb-c13533d2d43b None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:55.277683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4ba71-b1e0-4457-86b1-903c8c2c2bff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:55.279183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4ba71-b1e0-4457-86b1-903c8c2c2bff None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:55.286710 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-88c5befa-847c-4258-b2fb-c13533d2d43b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 14 21:35:55.292735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 332/648] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Apr 14 21:35:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:55.294467 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5befa-847c-4258-b2fb-c13533d2d43b None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:55.298937 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-b2d4ba71-b1e0-4457-86b1-903c8c2c2bff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:55.304804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 317/649] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:55.305684 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4ba71-b1e0-4457-86b1-903c8c2c2bff None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:55.410549 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5befa-847c-4258-b2fb-c13533d2d43b None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:55.434275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4ba71-b1e0-4457-86b1-903c8c2c2bff None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:55.458506 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ec3fc-544b-4d48-b009-a0ceb082cea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:55.459181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ec3fc-544b-4d48-b009-a0ceb082cea5 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:55.459461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ec3fc-544b-4d48-b009-a0ceb082cea5 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:55.459748 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ec3fc-544b-4d48-b009-a0ceb082cea5 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:55.461256 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ec3fc-544b-4d48-b009-a0ceb082cea5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:55.461578 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ec3fc-544b-4d48-b009-a0ceb082cea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:55.463216 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ec3fc-544b-4d48-b009-a0ceb082cea5 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:55.472092 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d8ec0-5336-4e90-8abc-380cfdce914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:55.473087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d8ec0-5336-4e90-8abc-380cfdce914e None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:55.473583 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d8ec0-5336-4e90-8abc-380cfdce914e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:55.474102 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d8ec0-5336-4e90-8abc-380cfdce914e None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:55.475187 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d8ec0-5336-4e90-8abc-380cfdce914e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:55.475692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d8ec0-5336-4e90-8abc-380cfdce914e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:55.477367 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d8ec0-5336-4e90-8abc-380cfdce914e None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:55.477693 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 333/650] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:35:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:55.478574 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ec3fc-544b-4d48-b009-a0ceb082cea5 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:55.496701 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 318/651] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Apr 14 21:35:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:55.497941 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d8ec0-5336-4e90-8abc-380cfdce914e None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:55.589777 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ec3fc-544b-4d48-b009-a0ceb082cea5 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:55.601140 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d8ec0-5336-4e90-8abc-380cfdce914e None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:55.626399 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d57198-a817-46d3-a66c-f9c46f73c468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:55.627068 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d57198-a817-46d3-a66c-f9c46f73c468 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:55.627350 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d57198-a817-46d3-a66c-f9c46f73c468 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:55.627788 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d57198-a817-46d3-a66c-f9c46f73c468 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:55.628517 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d57198-a817-46d3-a66c-f9c46f73c468 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:55.628879 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d57198-a817-46d3-a66c-f9c46f73c468 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:55.630377 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d57198-a817-46d3-a66c-f9c46f73c468 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:55.647780 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 334/652] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:55.648798 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d57198-a817-46d3-a66c-f9c46f73c468 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:55.651462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532e26a-eca1-48fe-95fc-22b905e80569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:55.652487 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532e26a-eca1-48fe-95fc-22b905e80569 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:55.653003 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532e26a-eca1-48fe-95fc-22b905e80569 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:55.653478 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532e26a-eca1-48fe-95fc-22b905e80569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:55.665237 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532e26a-eca1-48fe-95fc-22b905e80569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:55.667170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532e26a-eca1-48fe-95fc-22b905e80569 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:55.685559 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-e532e26a-eca1-48fe-95fc-22b905e80569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:55.687628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 319/653] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:55.688672 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532e26a-eca1-48fe-95fc-22b905e80569 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:55.755745 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d57198-a817-46d3-a66c-f9c46f73c468 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:55.789212 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18994c-5cd5-45f8-bf06-2e3ede896cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:55.789583 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532e26a-eca1-48fe-95fc-22b905e80569 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:55.789856 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18994c-5cd5-45f8-bf06-2e3ede896cc1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:55.790136 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18994c-5cd5-45f8-bf06-2e3ede896cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:55.790407 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18994c-5cd5-45f8-bf06-2e3ede896cc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:55.825096 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b077e96-a776-4ebc-b3ae-2ed046e986c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:55.826331 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b077e96-a776-4ebc-b3ae-2ed046e986c4 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:55.826890 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b077e96-a776-4ebc-b3ae-2ed046e986c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:55.828064 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b077e96-a776-4ebc-b3ae-2ed046e986c4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:55.836213 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b077e96-a776-4ebc-b3ae-2ed046e986c4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:55.837962 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b077e96-a776-4ebc-b3ae-2ed046e986c4 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:55.854408 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-8b077e96-a776-4ebc-b3ae-2ed046e986c4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 14 21:35:55.860426 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18994c-5cd5-45f8-bf06-2e3ede896cc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:55.860705 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 320/654] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:35:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:55.861250 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18994c-5cd5-45f8-bf06-2e3ede896cc1 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:55.861964 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b077e96-a776-4ebc-b3ae-2ed046e986c4 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:55.961912 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 335/655] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:55.962852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18994c-5cd5-45f8-bf06-2e3ede896cc1 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:55.965472 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b077e96-a776-4ebc-b3ae-2ed046e986c4 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:56.006462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633de9e5-4e70-49b8-9750-0d6317dec959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:56.007471 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633de9e5-4e70-49b8-9750-0d6317dec959 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:56.007958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633de9e5-4e70-49b8-9750-0d6317dec959 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:56.008435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633de9e5-4e70-49b8-9750-0d6317dec959 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:56.009393 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633de9e5-4e70-49b8-9750-0d6317dec959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:56.009934 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633de9e5-4e70-49b8-9750-0d6317dec959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:56.011559 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633de9e5-4e70-49b8-9750-0d6317dec959 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:56.028110 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 321/656] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:56.029376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633de9e5-4e70-49b8-9750-0d6317dec959 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:56.064899 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18994c-5cd5-45f8-bf06-2e3ede896cc1 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:56.102431 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a879f-47a2-4423-bf35-ba601b225435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:56.103105 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a879f-47a2-4423-bf35-ba601b225435 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:56.103404 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a879f-47a2-4423-bf35-ba601b225435 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:56.103658 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a879f-47a2-4423-bf35-ba601b225435 None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:56.104491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a879f-47a2-4423-bf35-ba601b225435 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:56.104829 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a879f-47a2-4423-bf35-ba601b225435 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:56.106284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a879f-47a2-4423-bf35-ba601b225435 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:56.129759 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 336/657] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Apr 14 21:35:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:56.129759 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a879f-47a2-4423-bf35-ba601b225435 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:56.153420 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633de9e5-4e70-49b8-9750-0d6317dec959 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:56.195205 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d4d8a-0111-40f8-8f03-c68e3b982723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:56.196588 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d4d8a-0111-40f8-8f03-c68e3b982723 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:56.196881 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d4d8a-0111-40f8-8f03-c68e3b982723 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:56.197152 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d4d8a-0111-40f8-8f03-c68e3b982723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:56.210470 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d4d8a-0111-40f8-8f03-c68e3b982723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:56.212960 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d4d8a-0111-40f8-8f03-c68e3b982723 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:56.235145 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-be2d4d8a-0111-40f8-8f03-c68e3b982723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:56.240710 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 322/658] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:56.242353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d4d8a-0111-40f8-8f03-c68e3b982723 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:56.250240 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a879f-47a2-4423-bf35-ba601b225435 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:56.292341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d75e5-391b-4670-a3e6-91718977f5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:56.293141 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d75e5-391b-4670-a3e6-91718977f5d2 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:56.293424 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d75e5-391b-4670-a3e6-91718977f5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:56.293699 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d75e5-391b-4670-a3e6-91718977f5d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:56.303964 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d75e5-391b-4670-a3e6-91718977f5d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:56.305811 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d75e5-391b-4670-a3e6-91718977f5d2 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:56.325635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-085d75e5-391b-4670-a3e6-91718977f5d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 14 21:35:56.328105 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 337/659] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:56.328770 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d75e5-391b-4670-a3e6-91718977f5d2 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:56.367270 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d4d8a-0111-40f8-8f03-c68e3b982723 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:56.409144 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf02886-eced-4136-a2b5-ba47ac9bc5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:56.409951 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf02886-eced-4136-a2b5-ba47ac9bc5fe None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:56.410239 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf02886-eced-4136-a2b5-ba47ac9bc5fe None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:56.410610 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf02886-eced-4136-a2b5-ba47ac9bc5fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:56.460308 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d75e5-391b-4670-a3e6-91718977f5d2 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:56.490277 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf02886-eced-4136-a2b5-ba47ac9bc5fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:56.492027 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf02886-eced-4136-a2b5-ba47ac9bc5fe None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:56.501672 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370250d-5fe1-42ab-9c4c-6bd28af86122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:56.502338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370250d-5fe1-42ab-9c4c-6bd28af86122 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:56.502619 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370250d-5fe1-42ab-9c4c-6bd28af86122 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:56.502894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370250d-5fe1-42ab-9c4c-6bd28af86122 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:56.503622 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370250d-5fe1-42ab-9c4c-6bd28af86122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:56.503927 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370250d-5fe1-42ab-9c4c-6bd28af86122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:56.506085 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370250d-5fe1-42ab-9c4c-6bd28af86122 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:56.526638 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 338/660] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:56.526638 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370250d-5fe1-42ab-9c4c-6bd28af86122 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:56.603645 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 323/661] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:56.604488 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf02886-eced-4136-a2b5-ba47ac9bc5fe None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:56.646770 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370250d-5fe1-42ab-9c4c-6bd28af86122 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:56.689444 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8225c07-91d3-4247-8072-6fe7735a4b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:56.690486 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8225c07-91d3-4247-8072-6fe7735a4b02 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:56.690968 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8225c07-91d3-4247-8072-6fe7735a4b02 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:56.691435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8225c07-91d3-4247-8072-6fe7735a4b02 None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:56.693026 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8225c07-91d3-4247-8072-6fe7735a4b02 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:56.693540 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8225c07-91d3-4247-8072-6fe7735a4b02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:56.695915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8225c07-91d3-4247-8072-6fe7735a4b02 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:56.715075 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 339/662] 10.222.0.52 () {56 vars in 1139 bytes} [Thu Apr 14 21:35:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:56.715738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8225c07-91d3-4247-8072-6fe7735a4b02 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:56.718171 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf02886-eced-4136-a2b5-ba47ac9bc5fe None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:56.752822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c082f4-7afa-44ed-b796-ba535ce6c239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:56.753639 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c082f4-7afa-44ed-b796-ba535ce6c239 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:56.753917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c082f4-7afa-44ed-b796-ba535ce6c239 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:56.754276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c082f4-7afa-44ed-b796-ba535ce6c239 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:56.761057 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c082f4-7afa-44ed-b796-ba535ce6c239 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:56.762410 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c082f4-7afa-44ed-b796-ba535ce6c239 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:56.775586 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-e3c082f4-7afa-44ed-b796-ba535ce6c239 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:35:56.776959 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 324/663] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:56.778138 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4db23-c7af-4141-8de6-c6cbfff1ff8a None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:56.778424 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4db23-c7af-4141-8de6-c6cbfff1ff8a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:56.778697 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4db23-c7af-4141-8de6-c6cbfff1ff8a None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:56.783968 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 325/664] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:56.783968 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4db23-c7af-4141-8de6-c6cbfff1ff8a None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:56.821904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8225c07-91d3-4247-8072-6fe7735a4b02 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:56.855673 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc700761-67ea-43bf-97a0-03f3b13e831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:56.856394 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700761-67ea-43bf-97a0-03f3b13e831a None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:56.856699 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700761-67ea-43bf-97a0-03f3b13e831a None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:56.856970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700761-67ea-43bf-97a0-03f3b13e831a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:56.867447 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc700761-67ea-43bf-97a0-03f3b13e831a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:56.868915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc700761-67ea-43bf-97a0-03f3b13e831a None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:56.885518 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-dc700761-67ea-43bf-97a0-03f3b13e831a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:56.891614 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 340/665] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:56.891614 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc700761-67ea-43bf-97a0-03f3b13e831a None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:56.893618 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4db23-c7af-4141-8de6-c6cbfff1ff8a None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:56.926701 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2e787-ebc8-429b-9084-ad7c3732b0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:56.927352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2e787-ebc8-429b-9084-ad7c3732b0be None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:56.927636 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2e787-ebc8-429b-9084-ad7c3732b0be None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:56.927909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2e787-ebc8-429b-9084-ad7c3732b0be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:56.995230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc700761-67ea-43bf-97a0-03f3b13e831a None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:57.002494 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2e787-ebc8-429b-9084-ad7c3732b0be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:57.004293 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2e787-ebc8-429b-9084-ad7c3732b0be None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:57.030767 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8138e-d11d-4ed6-9384-b65600cba3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:57.031554 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8138e-d11d-4ed6-9384-b65600cba3b2 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:57.031834 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8138e-d11d-4ed6-9384-b65600cba3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:57.032102 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8138e-d11d-4ed6-9384-b65600cba3b2 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:57.032927 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8138e-d11d-4ed6-9384-b65600cba3b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:57.033233 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8138e-d11d-4ed6-9384-b65600cba3b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:57.034660 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8138e-d11d-4ed6-9384-b65600cba3b2 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:57.045980 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 341/666] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:35:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:57.047368 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cd202-3dbd-420c-9772-77b29a1c3bed None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:57.047663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cd202-3dbd-420c-9772-77b29a1c3bed None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:57.047936 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cd202-3dbd-420c-9772-77b29a1c3bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:57.069228 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-012cd202-3dbd-420c-9772-77b29a1c3bed None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:57.070418 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-012cd202-3dbd-420c-9772-77b29a1c3bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:57.104888 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 326/667] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:57.105787 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2e787-ebc8-429b-9084-ad7c3732b0be None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:57.142149 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 342/668] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:57.142904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cd202-3dbd-420c-9772-77b29a1c3bed None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:57.218902 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2e787-ebc8-429b-9084-ad7c3732b0be None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:57.240150 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cd202-3dbd-420c-9772-77b29a1c3bed None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:57.255276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b522008-f7f3-4e7d-854c-addb30fe3fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:57.256260 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b522008-f7f3-4e7d-854c-addb30fe3fff None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:57.257075 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b522008-f7f3-4e7d-854c-addb30fe3fff None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:57.257440 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b522008-f7f3-4e7d-854c-addb30fe3fff None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:57.258534 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b522008-f7f3-4e7d-854c-addb30fe3fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:57.258909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b522008-f7f3-4e7d-854c-addb30fe3fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:57.260945 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b522008-f7f3-4e7d-854c-addb30fe3fff None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:57.282146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 327/669] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:57.282327 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b209c-cebc-49d7-b124-375eac16e273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:57.282327 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b209c-cebc-49d7-b124-375eac16e273 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:57.282503 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b522008-f7f3-4e7d-854c-addb30fe3fff None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:57.282575 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b209c-cebc-49d7-b124-375eac16e273 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:57.282575 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b209c-cebc-49d7-b124-375eac16e273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:57.282575 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b209c-cebc-49d7-b124-375eac16e273 None admin] RBAC: Adding query filter params (role.id=44e1b9c3f51e473a8af9b883e80a74d2, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=e7f3ea629181433eb8c6d5dbc354c141) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:57.282575 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b209c-cebc-49d7-b124-375eac16e273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:57.282575 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b209c-cebc-49d7-b124-375eac16e273 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:57.287578 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 343/670] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:35:57 2022] GET /identity/v3/role_assignments?user.id=e7f3ea629181433eb8c6d5dbc354c141&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=44e1b9c3f51e473a8af9b883e80a74d2 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:57.296706 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b209c-cebc-49d7-b124-375eac16e273 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:57.409730 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b522008-f7f3-4e7d-854c-addb30fe3fff None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:57.430194 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b209c-cebc-49d7-b124-375eac16e273 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:57.448037 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3802c1-01df-4a64-9b30-9cf7abbefb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:57.449783 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3802c1-01df-4a64-9b30-9cf7abbefb71 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:57.450353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3802c1-01df-4a64-9b30-9cf7abbefb71 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:57.450783 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3802c1-01df-4a64-9b30-9cf7abbefb71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:57.465241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3802c1-01df-4a64-9b30-9cf7abbefb71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:57.467945 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3802c1-01df-4a64-9b30-9cf7abbefb71 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:57.471947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad6932-f9ff-47b6-ae4a-8c93d455700c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:57.472939 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad6932-f9ff-47b6-ae4a-8c93d455700c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:57.473315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad6932-f9ff-47b6-ae4a-8c93d455700c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:57.473684 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad6932-f9ff-47b6-ae4a-8c93d455700c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:57.486891 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad6932-f9ff-47b6-ae4a-8c93d455700c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:35:57.489474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-ff3802c1-01df-4a64-9b30-9cf7abbefb71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:57.491160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 328/671] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:57.492081 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3802c1-01df-4a64-9b30-9cf7abbefb71 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:57.494546 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-2bad6932-f9ff-47b6-ae4a-8c93d455700c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:35:57.501298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 344/672] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:35:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:57.504358 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad6932-f9ff-47b6-ae4a-8c93d455700c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:57.602012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3802c1-01df-4a64-9b30-9cf7abbefb71 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:57.604758 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad6932-f9ff-47b6-ae4a-8c93d455700c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:57.637751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbb582-d8b3-44f2-b215-472e0e35a9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:57.639156 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbb582-d8b3-44f2-b215-472e0e35a9f9 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:57.639641 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbb582-d8b3-44f2-b215-472e0e35a9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:57.639791 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b472f49-f641-41b0-8c90-18f1661746ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:57.640464 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472f49-f641-41b0-8c90-18f1661746ae None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:57.640698 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbb582-d8b3-44f2-b215-472e0e35a9f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:57.640797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472f49-f641-41b0-8c90-18f1661746ae None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:57.641032 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472f49-f641-41b0-8c90-18f1661746ae None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:57.641787 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b472f49-f641-41b0-8c90-18f1661746ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:57.642091 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b472f49-f641-41b0-8c90-18f1661746ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:57.643468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b472f49-f641-41b0-8c90-18f1661746ae None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:57.648819 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbb582-d8b3-44f2-b215-472e0e35a9f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:57.650267 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbb582-d8b3-44f2-b215-472e0e35a9f9 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:57.656520 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 345/673] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:57.657611 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b472f49-f641-41b0-8c90-18f1661746ae None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:57.665156 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-39dbb582-d8b3-44f2-b215-472e0e35a9f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:35:57.666433 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 329/674] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:57.667664 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456eaf6f-e5f4-486c-bf8e-3abf19b0ca5f None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:57.667948 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456eaf6f-e5f4-486c-bf8e-3abf19b0ca5f None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:57.668225 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456eaf6f-e5f4-486c-bf8e-3abf19b0ca5f None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:57.669774 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 330/675] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:35:57.676519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456eaf6f-e5f4-486c-bf8e-3abf19b0ca5f None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:57.760055 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b472f49-f641-41b0-8c90-18f1661746ae None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:57.773482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456eaf6f-e5f4-486c-bf8e-3abf19b0ca5f None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:57.793755 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46f9d3-b925-4957-9ce3-d6605464bf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:57.794424 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46f9d3-b925-4957-9ce3-d6605464bf6b None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:57.794701 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46f9d3-b925-4957-9ce3-d6605464bf6b None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:57.794975 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46f9d3-b925-4957-9ce3-d6605464bf6b None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:57.795766 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46f9d3-b925-4957-9ce3-d6605464bf6b None admin] RBAC: Adding query filter params (name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:57.796073 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46f9d3-b925-4957-9ce3-d6605464bf6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:57.797552 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46f9d3-b925-4957-9ce3-d6605464bf6b None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:57.805410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 346/676] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:35:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:57.806203 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46f9d3-b925-4957-9ce3-d6605464bf6b None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:57.812606 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a240cf-1b3e-4ff5-9b4c-4199e2794d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:57.813581 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a240cf-1b3e-4ff5-9b4c-4199e2794d60 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:57.813860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a240cf-1b3e-4ff5-9b4c-4199e2794d60 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:57.814131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a240cf-1b3e-4ff5-9b4c-4199e2794d60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:57.821040 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a240cf-1b3e-4ff5-9b4c-4199e2794d60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:57.822489 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a240cf-1b3e-4ff5-9b4c-4199e2794d60 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:57.836611 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-c9a240cf-1b3e-4ff5-9b4c-4199e2794d60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:35:57.842296 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 331/677] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:57.842296 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b46ed0-92d7-4d16-9d43-98805c80f434 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:57.842296 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b46ed0-92d7-4d16-9d43-98805c80f434 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:57.842296 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b46ed0-92d7-4d16-9d43-98805c80f434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:57.857266 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-62b46ed0-92d7-4d16-9d43-98805c80f434 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:35:57.858848 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-62b46ed0-92d7-4d16-9d43-98805c80f434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:35:57.915391 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46f9d3-b925-4957-9ce3-d6605464bf6b None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:57.934246 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 332/678] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:35:57.934246 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b46ed0-92d7-4d16-9d43-98805c80f434 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:57.962205 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dd8b2-3da9-424e-bde1-ecd947971b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:57.963256 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dd8b2-3da9-424e-bde1-ecd947971b03 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:57.963774 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dd8b2-3da9-424e-bde1-ecd947971b03 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:57.964246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dd8b2-3da9-424e-bde1-ecd947971b03 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:57.965255 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474dd8b2-3da9-424e-bde1-ecd947971b03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:57.965789 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474dd8b2-3da9-424e-bde1-ecd947971b03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:57.968356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474dd8b2-3da9-424e-bde1-ecd947971b03 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:57.987165 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 347/679] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:35:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:57.987926 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dd8b2-3da9-424e-bde1-ecd947971b03 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:58.028312 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b46ed0-92d7-4d16-9d43-98805c80f434 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:58.062303 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1b068-8e15-4c1d-b5d6-1a00b583b28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:58.063097 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1b068-8e15-4c1d-b5d6-1a00b583b28f None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:58.063376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1b068-8e15-4c1d-b5d6-1a00b583b28f None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:58.063649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1b068-8e15-4c1d-b5d6-1a00b583b28f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:58.073397 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1b068-8e15-4c1d-b5d6-1a00b583b28f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:58.074834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1b068-8e15-4c1d-b5d6-1a00b583b28f None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:58.092082 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-a3c1b068-8e15-4c1d-b5d6-1a00b583b28f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:58.093911 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 333/680] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:58.094709 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1b068-8e15-4c1d-b5d6-1a00b583b28f None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:58.101653 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dd8b2-3da9-424e-bde1-ecd947971b03 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:58.142284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1a2e6-6d14-44bc-ac2e-a4c55d59c718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:58.142972 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1a2e6-6d14-44bc-ac2e-a4c55d59c718 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:58.143250 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1a2e6-6d14-44bc-ac2e-a4c55d59c718 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:58.143519 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1a2e6-6d14-44bc-ac2e-a4c55d59c718 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:58.144301 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1a2e6-6d14-44bc-ac2e-a4c55d59c718 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:58.144623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1a2e6-6d14-44bc-ac2e-a4c55d59c718 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:58.146072 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1a2e6-6d14-44bc-ac2e-a4c55d59c718 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:58.163422 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 348/681] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:35:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:58.163422 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1a2e6-6d14-44bc-ac2e-a4c55d59c718 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:58.197171 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1b068-8e15-4c1d-b5d6-1a00b583b28f None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:58.229994 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35166cdf-9e40-4ab2-a6f6-97b82ab8abb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:58.230788 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35166cdf-9e40-4ab2-a6f6-97b82ab8abb2 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:58.231063 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35166cdf-9e40-4ab2-a6f6-97b82ab8abb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:58.231333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35166cdf-9e40-4ab2-a6f6-97b82ab8abb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:58.243223 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35166cdf-9e40-4ab2-a6f6-97b82ab8abb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:58.244704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35166cdf-9e40-4ab2-a6f6-97b82ab8abb2 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:58.262693 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-35166cdf-9e40-4ab2-a6f6-97b82ab8abb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:58.269091 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 334/682] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:58.269234 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1a2e6-6d14-44bc-ac2e-a4c55d59c718 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:58.269313 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35166cdf-9e40-4ab2-a6f6-97b82ab8abb2 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:58.299315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba9ac6-a3ad-48c4-bbba-0e9fc11cd592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:58.299966 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba9ac6-a3ad-48c4-bbba-0e9fc11cd592 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:58.300242 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba9ac6-a3ad-48c4-bbba-0e9fc11cd592 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:58.300510 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba9ac6-a3ad-48c4-bbba-0e9fc11cd592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:58.301363 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba9ac6-a3ad-48c4-bbba-0e9fc11cd592 None admin] RBAC: Adding query filter params (role.id=44e1b9c3f51e473a8af9b883e80a74d2, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=f7f96ebcce204c729bf8e59d21dcc5d9) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:58.301670 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba9ac6-a3ad-48c4-bbba-0e9fc11cd592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:58.303127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba9ac6-a3ad-48c4-bbba-0e9fc11cd592 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:58.316624 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 349/683] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:35:58 2022] GET /identity/v3/role_assignments?user.id=f7f96ebcce204c729bf8e59d21dcc5d9&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=44e1b9c3f51e473a8af9b883e80a74d2 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:58.316624 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba9ac6-a3ad-48c4-bbba-0e9fc11cd592 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:58.378634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35166cdf-9e40-4ab2-a6f6-97b82ab8abb2 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:58.416849 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33f101-6047-4e6f-b917-71074643e543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:58.417604 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33f101-6047-4e6f-b917-71074643e543 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:58.417890 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33f101-6047-4e6f-b917-71074643e543 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:58.418162 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33f101-6047-4e6f-b917-71074643e543 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:58.418911 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33f101-6047-4e6f-b917-71074643e543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:58.419225 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33f101-6047-4e6f-b917-71074643e543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:58.421317 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33f101-6047-4e6f-b917-71074643e543 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:58.438795 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 335/684] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:58.439800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33f101-6047-4e6f-b917-71074643e543 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:58.451754 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba9ac6-a3ad-48c4-bbba-0e9fc11cd592 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:58.490109 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6d510-36a6-4bb6-99b5-b0d7e57e649f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:58.490789 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6d510-36a6-4bb6-99b5-b0d7e57e649f None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:58.491067 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6d510-36a6-4bb6-99b5-b0d7e57e649f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:58.491338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6d510-36a6-4bb6-99b5-b0d7e57e649f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:58.492250 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6d510-36a6-4bb6-99b5-b0d7e57e649f None admin] RBAC: Adding query filter params (role.id=44e1b9c3f51e473a8af9b883e80a74d2, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=1bfbd6a387e44037a58e521230783347) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:58.492565 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6d510-36a6-4bb6-99b5-b0d7e57e649f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:58.494144 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6d510-36a6-4bb6-99b5-b0d7e57e649f None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:58.501778 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 350/685] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:35:58 2022] GET /identity/v3/role_assignments?user.id=1bfbd6a387e44037a58e521230783347&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=44e1b9c3f51e473a8af9b883e80a74d2 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:58.502588 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6d510-36a6-4bb6-99b5-b0d7e57e649f None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:58.556459 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33f101-6047-4e6f-b917-71074643e543 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:58.597276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e4183-50e3-4d36-bad5-41d4bcc7d222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:58.597950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e4183-50e3-4d36-bad5-41d4bcc7d222 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:58.598226 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e4183-50e3-4d36-bad5-41d4bcc7d222 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:58.598497 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e4183-50e3-4d36-bad5-41d4bcc7d222 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:58.599228 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e4183-50e3-4d36-bad5-41d4bcc7d222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:58.599530 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e4183-50e3-4d36-bad5-41d4bcc7d222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:58.600954 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e4183-50e3-4d36-bad5-41d4bcc7d222 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:58.616081 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 336/686] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:58.617294 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6d510-36a6-4bb6-99b5-b0d7e57e649f None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:58.626260 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e4183-50e3-4d36-bad5-41d4bcc7d222 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:58.660171 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5361862-7f95-4d9b-be2e-9736213ea3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:58.661050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5361862-7f95-4d9b-be2e-9736213ea3bb None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:58.661331 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5361862-7f95-4d9b-be2e-9736213ea3bb None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:58.661606 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5361862-7f95-4d9b-be2e-9736213ea3bb None admin] PATH_INFO: `/v3/users/swift` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:58.670303 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5361862-7f95-4d9b-be2e-9736213ea3bb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:58.672709 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5361862-7f95-4d9b-be2e-9736213ea3bb None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:58.687692 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-a5361862-7f95-4d9b-be2e-9736213ea3bb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 14 21:35:58.692017 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 351/687] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:35:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:58.695301 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5361862-7f95-4d9b-be2e-9736213ea3bb None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:58.736394 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e4183-50e3-4d36-bad5-41d4bcc7d222 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:58.771656 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d2e46-3b54-468b-a87c-1e55d92d089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:58.772326 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d2e46-3b54-468b-a87c-1e55d92d089d None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:58.772620 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d2e46-3b54-468b-a87c-1e55d92d089d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:58.772896 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d2e46-3b54-468b-a87c-1e55d92d089d None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:58.773599 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d2e46-3b54-468b-a87c-1e55d92d089d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:58.775022 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d2e46-3b54-468b-a87c-1e55d92d089d None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:58.800567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5361862-7f95-4d9b-be2e-9736213ea3bb None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:58.834738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb75b24-82bc-45de-b905-c429051f6c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:58.835411 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb75b24-82bc-45de-b905-c429051f6c8f None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:58.835936 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb75b24-82bc-45de-b905-c429051f6c8f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:58.836204 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb75b24-82bc-45de-b905-c429051f6c8f None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:58.837135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb75b24-82bc-45de-b905-c429051f6c8f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:58.837507 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb75b24-82bc-45de-b905-c429051f6c8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:58.838884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb75b24-82bc-45de-b905-c429051f6c8f None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:58.858189 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 352/688] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Apr 14 21:35:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:58.863633 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb75b24-82bc-45de-b905-c429051f6c8f None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:58.868048 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 337/689] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:35:58 2022] POST /identity/v3/users => generated 254 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:35:58.984937 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb75b24-82bc-45de-b905-c429051f6c8f None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:59.039577 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1890b-b667-447c-9904-f52aae5babe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:59.040167 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1890b-b667-447c-9904-f52aae5babe9 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:59.040440 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1890b-b667-447c-9904-f52aae5babe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:59.040799 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1890b-b667-447c-9904-f52aae5babe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:59.132610 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1890b-b667-447c-9904-f52aae5babe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:59.134179 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1890b-b667-447c-9904-f52aae5babe9 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:59.232561 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 353/690] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:35:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:35:59.239341 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d2e46-3b54-468b-a87c-1e55d92d089d None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:59.340913 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d2e46-3b54-468b-a87c-1e55d92d089d None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:59.376033 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d510d-bb2a-4926-9acd-ada911b914fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:59.376859 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d510d-bb2a-4926-9acd-ada911b914fc None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:59.377135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d510d-bb2a-4926-9acd-ada911b914fc None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:59.377408 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d510d-bb2a-4926-9acd-ada911b914fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:59.388605 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d510d-bb2a-4926-9acd-ada911b914fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:59.392607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d510d-bb2a-4926-9acd-ada911b914fc None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:59.410735 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-088d510d-bb2a-4926-9acd-ada911b914fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:35:59.412314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 338/691] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:59.417733 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1890b-b667-447c-9904-f52aae5babe9 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:59.536208 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1890b-b667-447c-9904-f52aae5babe9 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:59.587468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502f79c-76ac-4feb-921f-1934526f8920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:59.588140 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502f79c-76ac-4feb-921f-1934526f8920 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:59.588421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502f79c-76ac-4feb-921f-1934526f8920 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:59.588717 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502f79c-76ac-4feb-921f-1934526f8920 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:59.589443 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502f79c-76ac-4feb-921f-1934526f8920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:35:59.589748 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502f79c-76ac-4feb-921f-1934526f8920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:59.591190 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502f79c-76ac-4feb-921f-1934526f8920 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:59.607273 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 354/692] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:35:59.609356 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d510d-bb2a-4926-9acd-ada911b914fc None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:35:59.788636 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d510d-bb2a-4926-9acd-ada911b914fc None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:35:59.839460 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24aec1-8f17-4b8b-9ce3-d91de334976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:35:59.840637 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24aec1-8f17-4b8b-9ce3-d91de334976d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:35:59.841120 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24aec1-8f17-4b8b-9ce3-d91de334976d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:35:59.841620 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24aec1-8f17-4b8b-9ce3-d91de334976d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:35:59.854355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24aec1-8f17-4b8b-9ce3-d91de334976d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:35:59.856138 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24aec1-8f17-4b8b-9ce3-d91de334976d None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:35:59.874794 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-7b24aec1-8f17-4b8b-9ce3-d91de334976d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:35:59.876628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 339/693] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:35:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:35:59.882263 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502f79c-76ac-4feb-921f-1934526f8920 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:00.059439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502f79c-76ac-4feb-921f-1934526f8920 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:00.107219 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01278fcc-2d4e-4caa-bb30-d171a3c73d7d None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:00.109471 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc8f05-50a7-4e4b-82eb-8c98288315f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:00.110337 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc8f05-50a7-4e4b-82eb-8c98288315f1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:00.110726 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01278fcc-2d4e-4caa-bb30-d171a3c73d7d None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:00.111177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc8f05-50a7-4e4b-82eb-8c98288315f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:00.111646 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01278fcc-2d4e-4caa-bb30-d171a3c73d7d None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:00.112108 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc8f05-50a7-4e4b-82eb-8c98288315f1 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:00.113702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 340/694] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:00.114707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc8f05-50a7-4e4b-82eb-8c98288315f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:00.115202 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc8f05-50a7-4e4b-82eb-8c98288315f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:00.116854 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc8f05-50a7-4e4b-82eb-8c98288315f1 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:00.121573 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163af9d-6ed1-4bac-8b1f-ad6f72ef8016 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:00.122146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163af9d-6ed1-4bac-8b1f-ad6f72ef8016 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:00.122610 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163af9d-6ed1-4bac-8b1f-ad6f72ef8016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:00.141937 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 355/695] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:35:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:00.142855 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d163af9d-6ed1-4bac-8b1f-ad6f72ef8016 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:00.144249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d163af9d-6ed1-4bac-8b1f-ad6f72ef8016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:00.147544 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc8f05-50a7-4e4b-82eb-8c98288315f1 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:00.253652 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 341/696] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:36:00.256958 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc8f05-50a7-4e4b-82eb-8c98288315f1 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:00.291105 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163af9d-6ed1-4bac-8b1f-ad6f72ef8016 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:00.291791 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45bca8-a8e8-42ec-a83b-f1a650deaafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:00.292643 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45bca8-a8e8-42ec-a83b-f1a650deaafd None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:00.293063 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45bca8-a8e8-42ec-a83b-f1a650deaafd None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:00.293474 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45bca8-a8e8-42ec-a83b-f1a650deaafd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:00.294490 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45bca8-a8e8-42ec-a83b-f1a650deaafd None admin] RBAC: Adding query filter params (role.id=44e1b9c3f51e473a8af9b883e80a74d2, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=360bf55488d046c4be98a903d113c0fc) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:00.294994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45bca8-a8e8-42ec-a83b-f1a650deaafd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:00.297357 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45bca8-a8e8-42ec-a83b-f1a650deaafd None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:00.308688 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 356/697] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:36:00 2022] GET /identity/v3/role_assignments?user.id=360bf55488d046c4be98a903d113c0fc&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=44e1b9c3f51e473a8af9b883e80a74d2 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:00.423387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163af9d-6ed1-4bac-8b1f-ad6f72ef8016 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:00.460939 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add969f4-f87c-467f-b7d6-c65e75478b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:00.461687 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add969f4-f87c-467f-b7d6-c65e75478b8d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:00.461968 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add969f4-f87c-467f-b7d6-c65e75478b8d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:00.462236 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add969f4-f87c-467f-b7d6-c65e75478b8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:00.474518 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add969f4-f87c-467f-b7d6-c65e75478b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:00.481610 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-add969f4-f87c-467f-b7d6-c65e75478b8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:36:00.483243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 342/698] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:36:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:00.488885 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45bca8-a8e8-42ec-a83b-f1a650deaafd None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:00.600384 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45bca8-a8e8-42ec-a83b-f1a650deaafd None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:00.635081 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0213787-a63e-4915-8bae-9bc523a7d319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:00.636041 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0213787-a63e-4915-8bae-9bc523a7d319 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:00.636467 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0213787-a63e-4915-8bae-9bc523a7d319 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:00.636902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0213787-a63e-4915-8bae-9bc523a7d319 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:00.637815 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0213787-a63e-4915-8bae-9bc523a7d319 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:00.638269 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0213787-a63e-4915-8bae-9bc523a7d319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:00.640614 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0213787-a63e-4915-8bae-9bc523a7d319 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:00.653555 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 357/699] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:36:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:00.658939 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add969f4-f87c-467f-b7d6-c65e75478b8d None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:00.809419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add969f4-f87c-467f-b7d6-c65e75478b8d None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:00.845009 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d3384-809d-412a-b81c-e79e42caa8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:00.845868 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d3384-809d-412a-b81c-e79e42caa8f8 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:00.846157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d3384-809d-412a-b81c-e79e42caa8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:00.846437 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d3384-809d-412a-b81c-e79e42caa8f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:00.857347 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d3384-809d-412a-b81c-e79e42caa8f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:00.858956 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d3384-809d-412a-b81c-e79e42caa8f8 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:00.876114 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-4c4d3384-809d-412a-b81c-e79e42caa8f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:00.877671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 343/700] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:00.883033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0213787-a63e-4915-8bae-9bc523a7d319 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:01.080344 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0213787-a63e-4915-8bae-9bc523a7d319 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:01.134210 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e7ec3-5c21-4755-8608-72c52cc7f1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:01.134885 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e7ec3-5c21-4755-8608-72c52cc7f1a1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:01.135169 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e7ec3-5c21-4755-8608-72c52cc7f1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:01.135450 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e7ec3-5c21-4755-8608-72c52cc7f1a1 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:01.136180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e7ec3-5c21-4755-8608-72c52cc7f1a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:01.136489 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e7ec3-5c21-4755-8608-72c52cc7f1a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:01.137888 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e7ec3-5c21-4755-8608-72c52cc7f1a1 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:01.155865 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 358/701] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:01.161834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d3384-809d-412a-b81c-e79e42caa8f8 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:01.288569 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d3384-809d-412a-b81c-e79e42caa8f8 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:01.329663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c0a1-4555-4eac-87f5-08287a3bdac5 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:01.329883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b8980-a4c6-4c1f-ba66-33c79648ec67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:01.330322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c0a1-4555-4eac-87f5-08287a3bdac5 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:01.330539 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b8980-a4c6-4c1f-ba66-33c79648ec67 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:01.330776 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b8980-a4c6-4c1f-ba66-33c79648ec67 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:01.331051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b8980-a4c6-4c1f-ba66-33c79648ec67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:01.331335 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c0a1-4555-4eac-87f5-08287a3bdac5 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:01.333120 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 359/702] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:01.342923 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b8980-a4c6-4c1f-ba66-33c79648ec67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:01.343306 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc75a58-20db-4cec-9007-03ab9823668e None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:01.343738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc75a58-20db-4cec-9007-03ab9823668e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:01.344188 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc75a58-20db-4cec-9007-03ab9823668e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:01.344377 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b8980-a4c6-4c1f-ba66-33c79648ec67 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:01.359894 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-479b8980-a4c6-4c1f-ba66-33c79648ec67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 14 21:36:01.361311 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 344/703] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Apr 14 21:36:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:01.363319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e48dbe-4031-4ef4-a4d7-2af4bbdec26c None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:01.363319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e48dbe-4031-4ef4-a4d7-2af4bbdec26c None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:01.363319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e48dbe-4031-4ef4-a4d7-2af4bbdec26c None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:01.364687 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 345/704] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:01.368479 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e48dbe-4031-4ef4-a4d7-2af4bbdec26c None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:01.381565 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-4bc75a58-20db-4cec-9007-03ab9823668e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:01.382763 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-4bc75a58-20db-4cec-9007-03ab9823668e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:01.454528 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 360/705] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:36:01.456069 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c32420-5e72-43ee-a629-0186feb3a39b None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:01.456507 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c32420-5e72-43ee-a629-0186feb3a39b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:01.456956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c32420-5e72-43ee-a629-0186feb3a39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:01.474034 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-b4c32420-5e72-43ee-a629-0186feb3a39b None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:01.475468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b4c32420-5e72-43ee-a629-0186feb3a39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:01.494261 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e48dbe-4031-4ef4-a4d7-2af4bbdec26c None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:01.535194 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec17ad-eab0-411a-9f65-4d4766819022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:01.536174 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec17ad-eab0-411a-9f65-4d4766819022 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:01.536717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec17ad-eab0-411a-9f65-4d4766819022 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:01.537136 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec17ad-eab0-411a-9f65-4d4766819022 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:01.538140 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec17ad-eab0-411a-9f65-4d4766819022 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:01.538603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec17ad-eab0-411a-9f65-4d4766819022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:01.540283 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec17ad-eab0-411a-9f65-4d4766819022 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:01.545968 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 361/706] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:36:01.546886 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c32420-5e72-43ee-a629-0186feb3a39b None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:01.562279 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 346/707] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Apr 14 21:36:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:01.567524 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec17ad-eab0-411a-9f65-4d4766819022 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:01.657361 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c32420-5e72-43ee-a629-0186feb3a39b None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:01.678525 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec17ad-eab0-411a-9f65-4d4766819022 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:01.692356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e2ed9-3788-4748-aae7-9e54735df340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:01.693182 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e2ed9-3788-4748-aae7-9e54735df340 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:01.693467 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e2ed9-3788-4748-aae7-9e54735df340 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:01.693740 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e2ed9-3788-4748-aae7-9e54735df340 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:01.694394 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e2ed9-3788-4748-aae7-9e54735df340 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:01.695855 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e2ed9-3788-4748-aae7-9e54735df340 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:01.709470 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-a07e2ed9-3788-4748-aae7-9e54735df340 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 14 21:36:01.716600 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 362/708] 10.222.0.52 () {56 vars in 1129 bytes} [Thu Apr 14 21:36:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:01.716600 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e2ed9-3788-4748-aae7-9e54735df340 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:01.723198 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513056a-1d87-4dfa-8909-59486ed2af44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:01.724258 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513056a-1d87-4dfa-8909-59486ed2af44 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:01.724767 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513056a-1d87-4dfa-8909-59486ed2af44 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:01.725239 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513056a-1d87-4dfa-8909-59486ed2af44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:01.796668 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513056a-1d87-4dfa-8909-59486ed2af44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:01.798516 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513056a-1d87-4dfa-8909-59486ed2af44 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:01.815518 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e2ed9-3788-4748-aae7-9e54735df340 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:01.851164 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d679d-e5a6-4d8d-bf1d-988fa4023d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:01.851974 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d679d-e5a6-4d8d-bf1d-988fa4023d6b None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:01.852255 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d679d-e5a6-4d8d-bf1d-988fa4023d6b None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:01.852526 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d679d-e5a6-4d8d-bf1d-988fa4023d6b None admin] PATH_INFO: `/v3/services/network` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:01.853237 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d679d-e5a6-4d8d-bf1d-988fa4023d6b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:01.854730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d679d-e5a6-4d8d-bf1d-988fa4023d6b None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:01.866394 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-642d679d-e5a6-4d8d-bf1d-988fa4023d6b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 14 21:36:01.872928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 363/709] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:01 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:01.874683 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d679d-e5a6-4d8d-bf1d-988fa4023d6b None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:01.910106 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 347/710] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:36:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:36:01.911511 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513056a-1d87-4dfa-8909-59486ed2af44 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:01.980782 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d679d-e5a6-4d8d-bf1d-988fa4023d6b None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:02.015761 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a205f3e-1b16-41c6-b84d-b638de04f608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:02.016434 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a205f3e-1b16-41c6-b84d-b638de04f608 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:02.016747 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a205f3e-1b16-41c6-b84d-b638de04f608 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:02.017016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a205f3e-1b16-41c6-b84d-b638de04f608 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:02.017731 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a205f3e-1b16-41c6-b84d-b638de04f608 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:02.018037 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a205f3e-1b16-41c6-b84d-b638de04f608 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:02.019406 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a205f3e-1b16-41c6-b84d-b638de04f608 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:02.023830 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 364/711] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Apr 14 21:36:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:02.024647 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a205f3e-1b16-41c6-b84d-b638de04f608 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:02.030879 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513056a-1d87-4dfa-8909-59486ed2af44 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:02.071989 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085ee24-847c-4715-bbef-9ce57446778d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:02.073200 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ee24-847c-4715-bbef-9ce57446778d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:02.073918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ee24-847c-4715-bbef-9ce57446778d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:02.074334 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ee24-847c-4715-bbef-9ce57446778d None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:02.075187 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085ee24-847c-4715-bbef-9ce57446778d None admin] RBAC: Adding query filter params (name=network) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:02.075640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085ee24-847c-4715-bbef-9ce57446778d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:02.077617 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085ee24-847c-4715-bbef-9ce57446778d None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:02.087198 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 348/712] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Apr 14 21:36:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:02.087198 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df314afc-a332-4692-8e06-517a3d30f287 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:02.087198 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df314afc-a332-4692-8e06-517a3d30f287 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:02.087198 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df314afc-a332-4692-8e06-517a3d30f287 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:02.087198 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 349/713] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:02.087198 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df314afc-a332-4692-8e06-517a3d30f287 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:02.132984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a205f3e-1b16-41c6-b84d-b638de04f608 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:02.166608 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fb588-a30f-4ab9-9f8e-d901ed2d17d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:02.167643 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fb588-a30f-4ab9-9f8e-d901ed2d17d7 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:02.167927 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fb588-a30f-4ab9-9f8e-d901ed2d17d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:02.168194 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fb588-a30f-4ab9-9f8e-d901ed2d17d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:02.180042 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fb588-a30f-4ab9-9f8e-d901ed2d17d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:02.181522 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fb588-a30f-4ab9-9f8e-d901ed2d17d7 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:02.197556 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-030fb588-a30f-4ab9-9f8e-d901ed2d17d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:02.200622 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 365/714] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:02.200622 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fb588-a30f-4ab9-9f8e-d901ed2d17d7 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:02.205118 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df314afc-a332-4692-8e06-517a3d30f287 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:02.242964 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554389ed-73d7-41d8-8d43-c7afb08fdab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:02.244132 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554389ed-73d7-41d8-8d43-c7afb08fdab5 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:02.244481 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554389ed-73d7-41d8-8d43-c7afb08fdab5 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:02.244782 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554389ed-73d7-41d8-8d43-c7afb08fdab5 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:02.245493 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554389ed-73d7-41d8-8d43-c7afb08fdab5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:02.245799 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554389ed-73d7-41d8-8d43-c7afb08fdab5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:02.247209 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554389ed-73d7-41d8-8d43-c7afb08fdab5 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:02.256967 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 350/715] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Apr 14 21:36:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:02.258809 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b878915-ec6c-498a-89ba-a8bb44805d8d None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:02.259098 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b878915-ec6c-498a-89ba-a8bb44805d8d None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:02.259373 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b878915-ec6c-498a-89ba-a8bb44805d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:02.277388 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-3b878915-ec6c-498a-89ba-a8bb44805d8d None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:02.278633 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-3b878915-ec6c-498a-89ba-a8bb44805d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:02.310023 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fb588-a30f-4ab9-9f8e-d901ed2d17d7 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:02.347689 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf4a12-be1e-436b-a69b-85a9a903cf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:02.349353 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4a12-be1e-436b-a69b-85a9a903cf9e None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:02.349868 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4a12-be1e-436b-a69b-85a9a903cf9e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:02.350366 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4a12-be1e-436b-a69b-85a9a903cf9e None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:02.351218 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf4a12-be1e-436b-a69b-85a9a903cf9e None admin] RBAC: Adding query filter params (type=network) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:02.351663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf4a12-be1e-436b-a69b-85a9a903cf9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:02.353236 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf4a12-be1e-436b-a69b-85a9a903cf9e None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:02.353605 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 351/716] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:36:02.355009 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b878915-ec6c-498a-89ba-a8bb44805d8d None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:02.361480 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 366/717] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Apr 14 21:36:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:02.397644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf4a12-be1e-436b-a69b-85a9a903cf9e None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:02.472964 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b878915-ec6c-498a-89ba-a8bb44805d8d None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:02.513563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67565db6-ce11-409e-9558-59f09e72f0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:02.516229 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67565db6-ce11-409e-9558-59f09e72f0eb None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:02.516900 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67565db6-ce11-409e-9558-59f09e72f0eb None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:02.517290 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67565db6-ce11-409e-9558-59f09e72f0eb None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:02.518155 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67565db6-ce11-409e-9558-59f09e72f0eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:02.518576 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67565db6-ce11-409e-9558-59f09e72f0eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:02.520301 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67565db6-ce11-409e-9558-59f09e72f0eb None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:02.539705 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 352/718] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:02.543379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67565db6-ce11-409e-9558-59f09e72f0eb None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:02.573226 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf4a12-be1e-436b-a69b-85a9a903cf9e None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:02.613421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b8104-bd94-492f-8ed0-eec3e5032e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:02.615428 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b8104-bd94-492f-8ed0-eec3e5032e09 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:02.615932 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b8104-bd94-492f-8ed0-eec3e5032e09 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:02.616408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b8104-bd94-492f-8ed0-eec3e5032e09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:02.630188 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b8104-bd94-492f-8ed0-eec3e5032e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:02.639617 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-d43b8104-bd94-492f-8ed0-eec3e5032e09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:36:02.642315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 367/719] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:36:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:02.647227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b8104-bd94-492f-8ed0-eec3e5032e09 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:02.692947 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67565db6-ce11-409e-9558-59f09e72f0eb None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:02.729993 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385a432-294e-4059-ba19-79118a2e8d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:02.730709 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385a432-294e-4059-ba19-79118a2e8d61 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:02.730987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385a432-294e-4059-ba19-79118a2e8d61 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:02.731255 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385a432-294e-4059-ba19-79118a2e8d61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:02.739811 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385a432-294e-4059-ba19-79118a2e8d61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:02.741286 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385a432-294e-4059-ba19-79118a2e8d61 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:02.768992 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-3385a432-294e-4059-ba19-79118a2e8d61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:36:02.770321 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 353/720] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:02.775630 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b8104-bd94-492f-8ed0-eec3e5032e09 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:02.776006 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385a432-294e-4059-ba19-79118a2e8d61 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:02.814746 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccfb81-96d0-4b37-a893-d1ade8ae368e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:02.815797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccfb81-96d0-4b37-a893-d1ade8ae368e None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:02.816374 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccfb81-96d0-4b37-a893-d1ade8ae368e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:02.816898 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccfb81-96d0-4b37-a893-d1ade8ae368e None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:02.818144 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccfb81-96d0-4b37-a893-d1ade8ae368e None admin] RBAC: Adding query filter params (name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:02.818667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccfb81-96d0-4b37-a893-d1ade8ae368e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:02.820798 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccfb81-96d0-4b37-a893-d1ade8ae368e None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:02.837133 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 368/721] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:36:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:02.841928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccfb81-96d0-4b37-a893-d1ade8ae368e None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:02.917525 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385a432-294e-4059-ba19-79118a2e8d61 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:02.957007 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bb95e-458b-4e6e-b96b-86e477cea3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:02.958324 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bb95e-458b-4e6e-b96b-86e477cea3b0 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:02.958804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bb95e-458b-4e6e-b96b-86e477cea3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:02.959438 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bb95e-458b-4e6e-b96b-86e477cea3b0 None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:02.960430 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bb95e-458b-4e6e-b96b-86e477cea3b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:02.961222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bb95e-458b-4e6e-b96b-86e477cea3b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:02.963790 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bb95e-458b-4e6e-b96b-86e477cea3b0 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:02.979793 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 354/722] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:36:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:02.990671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bb95e-458b-4e6e-b96b-86e477cea3b0 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:03.051055 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccfb81-96d0-4b37-a893-d1ade8ae368e None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:03.112735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc28e03-cdee-481f-b6f3-ad369d06d834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:03.113965 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc28e03-cdee-481f-b6f3-ad369d06d834 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:03.114445 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc28e03-cdee-481f-b6f3-ad369d06d834 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:03.114937 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc28e03-cdee-481f-b6f3-ad369d06d834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:03.127404 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc28e03-cdee-481f-b6f3-ad369d06d834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:03.129390 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc28e03-cdee-481f-b6f3-ad369d06d834 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:03.147936 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-7fc28e03-cdee-481f-b6f3-ad369d06d834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:03.150202 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 369/723] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:03.157480 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc28e03-cdee-481f-b6f3-ad369d06d834 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:03.168869 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bb95e-458b-4e6e-b96b-86e477cea3b0 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:03.204327 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637c250-8d2c-46c3-b74d-c0f7e8476bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:03.205017 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637c250-8d2c-46c3-b74d-c0f7e8476bd3 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:03.205299 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637c250-8d2c-46c3-b74d-c0f7e8476bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:03.205573 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637c250-8d2c-46c3-b74d-c0f7e8476bd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:03.206412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637c250-8d2c-46c3-b74d-c0f7e8476bd3 None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=e7f3ea629181433eb8c6d5dbc354c141) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:03.206726 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637c250-8d2c-46c3-b74d-c0f7e8476bd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:03.211579 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637c250-8d2c-46c3-b74d-c0f7e8476bd3 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:03.221948 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 355/724] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:36:02 2022] GET /identity/v3/role_assignments?user.id=e7f3ea629181433eb8c6d5dbc354c141&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:03.288782 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc28e03-cdee-481f-b6f3-ad369d06d834 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:03.333080 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c7009-9007-458d-9888-0282cd70be24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:03.334191 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c7009-9007-458d-9888-0282cd70be24 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:03.334698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c7009-9007-458d-9888-0282cd70be24 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:03.335176 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c7009-9007-458d-9888-0282cd70be24 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:03.336402 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c7009-9007-458d-9888-0282cd70be24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:03.336947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c7009-9007-458d-9888-0282cd70be24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:03.338613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c7009-9007-458d-9888-0282cd70be24 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:03.356877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 370/725] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:03.362241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637c250-8d2c-46c3-b74d-c0f7e8476bd3 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:03.377484 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621cff9-90db-4a0c-a7ef-fa34c4f6f121 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:03.378112 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621cff9-90db-4a0c-a7ef-fa34c4f6f121 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:03.379073 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621cff9-90db-4a0c-a7ef-fa34c4f6f121 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:03.381098 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 371/726] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:03.386327 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaace35-9409-4dd1-93f0-eb812e4f4660 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:03.387157 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaace35-9409-4dd1-93f0-eb812e4f4660 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:03.387664 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaace35-9409-4dd1-93f0-eb812e4f4660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:03.409171 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-1aaace35-9409-4dd1-93f0-eb812e4f4660 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:03.411338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-1aaace35-9409-4dd1-93f0-eb812e4f4660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:03.519005 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 372/727] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 14 21:36:03.530802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637c250-8d2c-46c3-b74d-c0f7e8476bd3 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:03.554516 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaace35-9409-4dd1-93f0-eb812e4f4660 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:03.567604 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a5de7-37a7-4e82-b329-e36930f54c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:03.568883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a5de7-37a7-4e82-b329-e36930f54c3e None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:03.569371 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a5de7-37a7-4e82-b329-e36930f54c3e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:03.569888 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a5de7-37a7-4e82-b329-e36930f54c3e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:03.586981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a5de7-37a7-4e82-b329-e36930f54c3e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:03.589510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a5de7-37a7-4e82-b329-e36930f54c3e None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:03.611479 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-0d6a5de7-37a7-4e82-b329-e36930f54c3e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 14 21:36:03.613053 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 356/728] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Apr 14 21:36:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:03.621587 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a5de7-37a7-4e82-b329-e36930f54c3e None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:03.733994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaace35-9409-4dd1-93f0-eb812e4f4660 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:03.778979 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea12bd-481f-417b-88c5-e181cd74a8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:03.780620 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea12bd-481f-417b-88c5-e181cd74a8f0 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:03.783291 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea12bd-481f-417b-88c5-e181cd74a8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:03.783579 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea12bd-481f-417b-88c5-e181cd74a8f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:03.805508 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea12bd-481f-417b-88c5-e181cd74a8f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:03.813575 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-d7ea12bd-481f-417b-88c5-e181cd74a8f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:36:03.814800 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 373/729] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:36:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:03.819932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a5de7-37a7-4e82-b329-e36930f54c3e None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:03.827887 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea12bd-481f-417b-88c5-e181cd74a8f0 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:03.883353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1fc0a-3f83-42fb-809e-b03d6008b347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:03.884444 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1fc0a-3f83-42fb-809e-b03d6008b347 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:03.884957 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1fc0a-3f83-42fb-809e-b03d6008b347 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:03.885435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1fc0a-3f83-42fb-809e-b03d6008b347 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:03.886505 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1fc0a-3f83-42fb-809e-b03d6008b347 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:03.887015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1fc0a-3f83-42fb-809e-b03d6008b347 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:03.888683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1fc0a-3f83-42fb-809e-b03d6008b347 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:03.908142 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 357/730] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Apr 14 21:36:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:03.915492 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1fc0a-3f83-42fb-809e-b03d6008b347 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:03.953152 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea12bd-481f-417b-88c5-e181cd74a8f0 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:04.031738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a5939-755b-4f4e-8264-904bed601336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:04.032461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a5939-755b-4f4e-8264-904bed601336 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:04.032816 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a5939-755b-4f4e-8264-904bed601336 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:04.033097 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a5939-755b-4f4e-8264-904bed601336 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:04.033846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a5939-755b-4f4e-8264-904bed601336 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:04.034150 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a5939-755b-4f4e-8264-904bed601336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:04.035529 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a5939-755b-4f4e-8264-904bed601336 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:04.044197 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 374/731] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:36:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:04.051250 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a5939-755b-4f4e-8264-904bed601336 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:04.125133 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1fc0a-3f83-42fb-809e-b03d6008b347 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:04.188076 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a5939-755b-4f4e-8264-904bed601336 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:04.197829 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e0b49-1261-4044-b58d-56035ca00f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:04.198492 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e0b49-1261-4044-b58d-56035ca00f24 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:04.198772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e0b49-1261-4044-b58d-56035ca00f24 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:04.199045 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e0b49-1261-4044-b58d-56035ca00f24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:04.224027 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64df1de-5b48-4db5-ab8d-584dadbffaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:04.224853 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64df1de-5b48-4db5-ab8d-584dadbffaae None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:04.225139 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64df1de-5b48-4db5-ab8d-584dadbffaae None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:04.225414 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64df1de-5b48-4db5-ab8d-584dadbffaae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:04.236152 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64df1de-5b48-4db5-ab8d-584dadbffaae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:04.237668 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64df1de-5b48-4db5-ab8d-584dadbffaae None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:04.254678 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-f64df1de-5b48-4db5-ab8d-584dadbffaae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:04.256248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 375/732] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:04.265195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64df1de-5b48-4db5-ab8d-584dadbffaae None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:04.297263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e0b49-1261-4044-b58d-56035ca00f24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:04.298916 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e0b49-1261-4044-b58d-56035ca00f24 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:04.399362 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 358/733] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:36:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:36:04.405222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e0b49-1261-4044-b58d-56035ca00f24 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:04.454751 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64df1de-5b48-4db5-ab8d-584dadbffaae None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:04.507561 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e0b49-1261-4044-b58d-56035ca00f24 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:04.525316 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df304532-4780-4585-bd2f-726277282dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:04.525990 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df304532-4780-4585-bd2f-726277282dbb None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:04.526271 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df304532-4780-4585-bd2f-726277282dbb None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:04.526542 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df304532-4780-4585-bd2f-726277282dbb None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:04.527271 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df304532-4780-4585-bd2f-726277282dbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:04.527573 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df304532-4780-4585-bd2f-726277282dbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:04.528972 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df304532-4780-4585-bd2f-726277282dbb None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:04.544314 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 376/734] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:04.550240 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d15aa9-a137-433f-908a-7eecaebe7ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:04.551053 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d15aa9-a137-433f-908a-7eecaebe7ad0 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:04.551328 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d15aa9-a137-433f-908a-7eecaebe7ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:04.551596 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d15aa9-a137-433f-908a-7eecaebe7ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:04.553839 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df304532-4780-4585-bd2f-726277282dbb None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:04.567448 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d15aa9-a137-433f-908a-7eecaebe7ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:04.568932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d15aa9-a137-433f-908a-7eecaebe7ad0 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:04.599092 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-c4d15aa9-a137-433f-908a-7eecaebe7ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:04.600398 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 359/735] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:04.606927 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d15aa9-a137-433f-908a-7eecaebe7ad0 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:04.750160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df304532-4780-4585-bd2f-726277282dbb None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:04.788604 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d15aa9-a137-433f-908a-7eecaebe7ad0 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:04.803421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1182e3-5cae-43a2-b042-0d6bcb76495f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:04.804730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1182e3-5cae-43a2-b042-0d6bcb76495f None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:04.805219 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1182e3-5cae-43a2-b042-0d6bcb76495f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:04.805697 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1182e3-5cae-43a2-b042-0d6bcb76495f None admin] PATH_INFO: `/v3/users/swift` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:04.813380 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1182e3-5cae-43a2-b042-0d6bcb76495f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:04.815111 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1182e3-5cae-43a2-b042-0d6bcb76495f None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:04.819953 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efb951-b54f-475b-ad52-7f78500fbe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:04.820648 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efb951-b54f-475b-ad52-7f78500fbe6e None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:04.820930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efb951-b54f-475b-ad52-7f78500fbe6e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:04.821202 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efb951-b54f-475b-ad52-7f78500fbe6e None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:04.821924 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efb951-b54f-475b-ad52-7f78500fbe6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:04.822226 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efb951-b54f-475b-ad52-7f78500fbe6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:04.823581 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efb951-b54f-475b-ad52-7f78500fbe6e None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:04.832121 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-db1182e3-5cae-43a2-b042-0d6bcb76495f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 14 21:36:04.833915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 377/736] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:36:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:04.840690 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 360/737] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:04.841478 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1182e3-5cae-43a2-b042-0d6bcb76495f None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:04.846222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efb951-b54f-475b-ad52-7f78500fbe6e None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:04.979212 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efb951-b54f-475b-ad52-7f78500fbe6e None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:04.991217 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1182e3-5cae-43a2-b042-0d6bcb76495f None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:05.017889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d006da-5c36-4683-9460-b1a93abbac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:05.019035 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d006da-5c36-4683-9460-b1a93abbac60 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:05.019534 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d006da-5c36-4683-9460-b1a93abbac60 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:05.020012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d006da-5c36-4683-9460-b1a93abbac60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:05.027177 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d006da-5c36-4683-9460-b1a93abbac60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:05.028918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d006da-5c36-4683-9460-b1a93abbac60 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:05.036101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b972c1d-ca4b-4eb6-b92b-75c7be9070c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:05.036836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b972c1d-ca4b-4eb6-b92b-75c7be9070c7 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:05.037098 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b972c1d-ca4b-4eb6-b92b-75c7be9070c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:05.037369 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b972c1d-ca4b-4eb6-b92b-75c7be9070c7 None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:05.038222 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b972c1d-ca4b-4eb6-b92b-75c7be9070c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:05.038533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b972c1d-ca4b-4eb6-b92b-75c7be9070c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:05.039991 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b972c1d-ca4b-4eb6-b92b-75c7be9070c7 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:05.045898 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-d8d006da-5c36-4683-9460-b1a93abbac60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:36:05.047884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 361/738] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:05.057655 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d006da-5c36-4683-9460-b1a93abbac60 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:05.078513 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 378/739] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Apr 14 21:36:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:05.084729 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b972c1d-ca4b-4eb6-b92b-75c7be9070c7 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:05.220662 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b972c1d-ca4b-4eb6-b92b-75c7be9070c7 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:05.227905 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d006da-5c36-4683-9460-b1a93abbac60 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:05.255622 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0505155-2d52-4cde-bd2f-8fc2ddf7f7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:05.256440 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0505155-2d52-4cde-bd2f-8fc2ddf7f7c0 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:05.256759 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0505155-2d52-4cde-bd2f-8fc2ddf7f7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:05.257366 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0505155-2d52-4cde-bd2f-8fc2ddf7f7c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:05.268104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc44399-bca6-4900-bd2f-12c2be9fecac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:05.268782 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc44399-bca6-4900-bd2f-12c2be9fecac None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:05.269060 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc44399-bca6-4900-bd2f-12c2be9fecac None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:05.269333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc44399-bca6-4900-bd2f-12c2be9fecac None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:05.270135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc44399-bca6-4900-bd2f-12c2be9fecac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:05.270439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc44399-bca6-4900-bd2f-12c2be9fecac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:05.271923 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc44399-bca6-4900-bd2f-12c2be9fecac None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:05.284452 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 362/740] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:36:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:05.285884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d005410-c3c1-4385-a5d7-74ef338560e5 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:05.286170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d005410-c3c1-4385-a5d7-74ef338560e5 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:05.286441 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d005410-c3c1-4385-a5d7-74ef338560e5 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:05.287946 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 363/741] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:05.289806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d005410-c3c1-4385-a5d7-74ef338560e5 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:05.344215 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0505155-2d52-4cde-bd2f-8fc2ddf7f7c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:05.345731 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0505155-2d52-4cde-bd2f-8fc2ddf7f7c0 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:05.422422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d005410-c3c1-4385-a5d7-74ef338560e5 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:05.450604 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 379/742] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 14 21:36:05.452038 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d72be5-1b2d-445e-8226-8bd6995c8667 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:05.452378 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d72be5-1b2d-445e-8226-8bd6995c8667 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:05.452622 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d72be5-1b2d-445e-8226-8bd6995c8667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:05.459686 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be973513-f407-4f26-a0bb-601d074bf5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:05.460347 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be973513-f407-4f26-a0bb-601d074bf5ab None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:05.460913 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be973513-f407-4f26-a0bb-601d074bf5ab None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:05.461190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be973513-f407-4f26-a0bb-601d074bf5ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:05.462031 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be973513-f407-4f26-a0bb-601d074bf5ab None admin] RBAC: Adding query filter params (role.id=44e1b9c3f51e473a8af9b883e80a74d2, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=1144e9036d0b4bafb30995ff1a8449ec) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:05.462342 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be973513-f407-4f26-a0bb-601d074bf5ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:05.464194 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be973513-f407-4f26-a0bb-601d074bf5ab None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:05.469811 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-56d72be5-1b2d-445e-8226-8bd6995c8667 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:05.473075 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 364/743] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:36:05 2022] GET /identity/v3/role_assignments?user.id=1144e9036d0b4bafb30995ff1a8449ec&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=44e1b9c3f51e473a8af9b883e80a74d2 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:05.473203 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-56d72be5-1b2d-445e-8226-8bd6995c8667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:05.473296 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563fbe4-fe84-4550-90ef-4a76496b7672 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:05.473296 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563fbe4-fe84-4550-90ef-4a76496b7672 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:05.473296 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563fbe4-fe84-4550-90ef-4a76496b7672 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:05.475469 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 365/744] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:05.476287 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563fbe4-fe84-4550-90ef-4a76496b7672 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:05.570904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 380/745] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:36:05.573002 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b378a-3a05-4383-b5ec-a69cfe495d74 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:05.573128 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b378a-3a05-4383-b5ec-a69cfe495d74 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:05.573404 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b378a-3a05-4383-b5ec-a69cfe495d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:05.610877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-c78b378a-3a05-4383-b5ec-a69cfe495d74 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:05.612529 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563fbe4-fe84-4550-90ef-4a76496b7672 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:05.612790 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c78b378a-3a05-4383-b5ec-a69cfe495d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:05.657037 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee1a7b-c549-49d5-a057-0fcb64e9c4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:05.657993 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee1a7b-c549-49d5-a057-0fcb64e9c4a8 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:05.658346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee1a7b-c549-49d5-a057-0fcb64e9c4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:05.658715 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee1a7b-c549-49d5-a057-0fcb64e9c4a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:05.677929 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee1a7b-c549-49d5-a057-0fcb64e9c4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:05.679567 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee1a7b-c549-49d5-a057-0fcb64e9c4a8 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:05.702617 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-03ee1a7b-c549-49d5-a057-0fcb64e9c4a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:05.703728 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 366/746] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:05.704499 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee1a7b-c549-49d5-a057-0fcb64e9c4a8 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:05.706023 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 381/747] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 14 21:36:05.714610 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b378a-3a05-4383-b5ec-a69cfe495d74 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:05.828598 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee1a7b-c549-49d5-a057-0fcb64e9c4a8 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:05.839581 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b378a-3a05-4383-b5ec-a69cfe495d74 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:05.869081 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31165265-90e0-4a69-b832-d416e94bdc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:05.870057 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31165265-90e0-4a69-b832-d416e94bdc76 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:05.870521 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31165265-90e0-4a69-b832-d416e94bdc76 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:05.871004 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31165265-90e0-4a69-b832-d416e94bdc76 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:05.871914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31165265-90e0-4a69-b832-d416e94bdc76 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:05.873561 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31165265-90e0-4a69-b832-d416e94bdc76 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:05.875046 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff06633-04c1-466d-8146-e08714a47433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:05.875840 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff06633-04c1-466d-8146-e08714a47433 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:05.876211 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff06633-04c1-466d-8146-e08714a47433 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:05.876617 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff06633-04c1-466d-8146-e08714a47433 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:05.877389 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff06633-04c1-466d-8146-e08714a47433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:05.877768 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff06633-04c1-466d-8146-e08714a47433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:05.879567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff06633-04c1-466d-8146-e08714a47433 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:05.893837 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 382/748] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:05.894647 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff06633-04c1-466d-8146-e08714a47433 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:05.981143 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 367/749] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Apr 14 21:36:05 2022] POST /identity/v3/services => generated 251 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:36:05.984516 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a17674-8730-492f-b888-bd9ad7858a8b None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:05.984516 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a17674-8730-492f-b888-bd9ad7858a8b None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:05.984516 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a17674-8730-492f-b888-bd9ad7858a8b None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:05.989558 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 368/750] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:05.989853 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a17674-8730-492f-b888-bd9ad7858a8b None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:06.017308 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff06633-04c1-466d-8146-e08714a47433 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:06.064153 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d69d8f-94f0-4b2c-8957-8cd836ba404c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:06.065016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d69d8f-94f0-4b2c-8957-8cd836ba404c None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:06.065369 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d69d8f-94f0-4b2c-8957-8cd836ba404c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:06.065788 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d69d8f-94f0-4b2c-8957-8cd836ba404c None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:06.066622 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d69d8f-94f0-4b2c-8957-8cd836ba404c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:06.068186 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d69d8f-94f0-4b2c-8957-8cd836ba404c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:06.117725 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a17674-8730-492f-b888-bd9ad7858a8b None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:06.149567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 383/751] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Apr 14 21:36:05 2022] POST /identity/v3/services => generated 240 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:36:06.151667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e325d-488b-4011-8ceb-51e319f30cfb None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:06.151958 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e325d-488b-4011-8ceb-51e319f30cfb None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:06.152235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e325d-488b-4011-8ceb-51e319f30cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:06.178212 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-ed6e325d-488b-4011-8ceb-51e319f30cfb None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:06.178872 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a77f8-0deb-43c0-823f-37c15bc462c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:06.179519 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ed6e325d-488b-4011-8ceb-51e319f30cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:06.180161 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a77f8-0deb-43c0-823f-37c15bc462c0 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:06.180674 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a77f8-0deb-43c0-823f-37c15bc462c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:06.181154 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a77f8-0deb-43c0-823f-37c15bc462c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:06.192217 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a77f8-0deb-43c0-823f-37c15bc462c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:06.194647 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a77f8-0deb-43c0-823f-37c15bc462c0 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:06.214774 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-704a77f8-0deb-43c0-823f-37c15bc462c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:36:06.217312 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 369/752] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:06.222963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a77f8-0deb-43c0-823f-37c15bc462c0 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:06.276999 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 384/753] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:06.297203 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e325d-488b-4011-8ceb-51e319f30cfb None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:06.360546 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a77f8-0deb-43c0-823f-37c15bc462c0 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:06.410620 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33cbed-ec2e-42d4-bc84-f4be714f3665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:06.412167 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33cbed-ec2e-42d4-bc84-f4be714f3665 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:06.412692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33cbed-ec2e-42d4-bc84-f4be714f3665 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:06.413295 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33cbed-ec2e-42d4-bc84-f4be714f3665 None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:06.414564 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33cbed-ec2e-42d4-bc84-f4be714f3665 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:06.415289 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33cbed-ec2e-42d4-bc84-f4be714f3665 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:06.417005 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e325d-488b-4011-8ceb-51e319f30cfb None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:06.417215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33cbed-ec2e-42d4-bc84-f4be714f3665 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:06.434130 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 370/754] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:36:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:06.439364 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33cbed-ec2e-42d4-bc84-f4be714f3665 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:06.459772 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519c090-4fb9-4e66-a8d2-0ae2fda408ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:06.461176 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519c090-4fb9-4e66-a8d2-0ae2fda408ea None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:06.462919 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519c090-4fb9-4e66-a8d2-0ae2fda408ea None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:06.463351 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519c090-4fb9-4e66-a8d2-0ae2fda408ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:06.475614 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519c090-4fb9-4e66-a8d2-0ae2fda408ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:06.483594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-9519c090-4fb9-4e66-a8d2-0ae2fda408ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:36:06.485372 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 385/755] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:36:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:06.492192 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519c090-4fb9-4e66-a8d2-0ae2fda408ea None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:06.554022 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33cbed-ec2e-42d4-bc84-f4be714f3665 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:06.591143 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c6076-7534-4fa2-8762-c7dbb7143742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:06.592007 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c6076-7534-4fa2-8762-c7dbb7143742 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:06.593137 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c6076-7534-4fa2-8762-c7dbb7143742 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:06.593967 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c6076-7534-4fa2-8762-c7dbb7143742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:06.594266 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c6076-7534-4fa2-8762-c7dbb7143742 None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=360bf55488d046c4be98a903d113c0fc) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:06.594991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c6076-7534-4fa2-8762-c7dbb7143742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:06.596448 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c6076-7534-4fa2-8762-c7dbb7143742 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:06.603436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 371/756] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:36:06 2022] GET /identity/v3/role_assignments?user.id=360bf55488d046c4be98a903d113c0fc&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:06.621590 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519c090-4fb9-4e66-a8d2-0ae2fda408ea None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:06.690808 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30976e19-2abe-4379-8230-8cb48b3e483c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:06.691422 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30976e19-2abe-4379-8230-8cb48b3e483c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:06.691701 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30976e19-2abe-4379-8230-8cb48b3e483c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:06.691966 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30976e19-2abe-4379-8230-8cb48b3e483c None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:06.692774 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30976e19-2abe-4379-8230-8cb48b3e483c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:06.693088 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30976e19-2abe-4379-8230-8cb48b3e483c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:06.694552 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30976e19-2abe-4379-8230-8cb48b3e483c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:06.718922 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 386/757] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:36:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:06.726467 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c6076-7534-4fa2-8762-c7dbb7143742 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:06.876919 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c6076-7534-4fa2-8762-c7dbb7143742 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:06.933981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6df359-cc77-416a-91cd-4130fb6259fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:06.934793 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6df359-cc77-416a-91cd-4130fb6259fe None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:06.935078 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6df359-cc77-416a-91cd-4130fb6259fe None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:06.935433 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6df359-cc77-416a-91cd-4130fb6259fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:06.963445 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6df359-cc77-416a-91cd-4130fb6259fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:06.963445 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6df359-cc77-416a-91cd-4130fb6259fe None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:06.994452 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-ff6df359-cc77-416a-91cd-4130fb6259fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:06.996076 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 372/758] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:07.003055 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30976e19-2abe-4379-8230-8cb48b3e483c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:07.208273 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30976e19-2abe-4379-8230-8cb48b3e483c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:07.263912 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336b20b-c8a2-453f-b2cd-b9978673aeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:07.264638 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336b20b-c8a2-453f-b2cd-b9978673aeda None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:07.264931 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336b20b-c8a2-453f-b2cd-b9978673aeda None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:07.265203 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336b20b-c8a2-453f-b2cd-b9978673aeda None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:07.266092 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336b20b-c8a2-453f-b2cd-b9978673aeda None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:07.266632 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336b20b-c8a2-453f-b2cd-b9978673aeda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:07.268526 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336b20b-c8a2-453f-b2cd-b9978673aeda None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:07.288055 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 387/759] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:07.293931 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6df359-cc77-416a-91cd-4130fb6259fe None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:07.460146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6df359-cc77-416a-91cd-4130fb6259fe None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:07.504550 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f32bcb-27c2-4396-bcfd-d2f5226f3c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:07.505392 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f32bcb-27c2-4396-bcfd-d2f5226f3c03 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:07.505675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f32bcb-27c2-4396-bcfd-d2f5226f3c03 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:07.505948 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f32bcb-27c2-4396-bcfd-d2f5226f3c03 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:07.522033 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f32bcb-27c2-4396-bcfd-d2f5226f3c03 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:07.523432 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f32bcb-27c2-4396-bcfd-d2f5226f3c03 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:07.543080 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-c7f32bcb-27c2-4396-bcfd-d2f5226f3c03 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 14 21:36:07.544640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 373/760] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Apr 14 21:36:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:07.550877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336b20b-c8a2-453f-b2cd-b9978673aeda None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:07.715641 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336b20b-c8a2-453f-b2cd-b9978673aeda None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:07.765289 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e42df9-2b66-4825-a22d-c17dbcd16ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:07.765975 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e42df9-2b66-4825-a22d-c17dbcd16ba4 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:07.766254 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e42df9-2b66-4825-a22d-c17dbcd16ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:07.766524 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e42df9-2b66-4825-a22d-c17dbcd16ba4 None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:07.767369 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e42df9-2b66-4825-a22d-c17dbcd16ba4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:07.767677 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e42df9-2b66-4825-a22d-c17dbcd16ba4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:07.769145 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e42df9-2b66-4825-a22d-c17dbcd16ba4 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:07.789507 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 388/761] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Apr 14 21:36:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:07.795055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f32bcb-27c2-4396-bcfd-d2f5226f3c03 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:07.941806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f32bcb-27c2-4396-bcfd-d2f5226f3c03 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:08.000154 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb1298-1798-4bee-ac0c-a17934089b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:08.001030 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb1298-1798-4bee-ac0c-a17934089b98 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:08.001314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb1298-1798-4bee-ac0c-a17934089b98 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:08.001590 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb1298-1798-4bee-ac0c-a17934089b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:08.013655 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb1298-1798-4bee-ac0c-a17934089b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:08.015976 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb1298-1798-4bee-ac0c-a17934089b98 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:08.037849 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-2fdb1298-1798-4bee-ac0c-a17934089b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:08.039395 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 374/762] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:08.044958 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e42df9-2b66-4825-a22d-c17dbcd16ba4 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:08.217780 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e42df9-2b66-4825-a22d-c17dbcd16ba4 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:08.262297 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4013ca5-969d-45b7-8f38-0752e5f6c8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:08.263006 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4013ca5-969d-45b7-8f38-0752e5f6c8ed None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:08.263287 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4013ca5-969d-45b7-8f38-0752e5f6c8ed None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:08.263560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4013ca5-969d-45b7-8f38-0752e5f6c8ed None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:08.264619 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4013ca5-969d-45b7-8f38-0752e5f6c8ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:08.264942 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4013ca5-969d-45b7-8f38-0752e5f6c8ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:08.266321 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4013ca5-969d-45b7-8f38-0752e5f6c8ed None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:08.283812 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 389/763] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:08.289206 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb1298-1798-4bee-ac0c-a17934089b98 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:08.405094 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb1298-1798-4bee-ac0c-a17934089b98 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:08.443516 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c943d2c-1c57-47e7-afd0-5fe1f9c0fa3c None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:08.443825 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c943d2c-1c57-47e7-afd0-5fe1f9c0fa3c None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:08.444095 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c943d2c-1c57-47e7-afd0-5fe1f9c0fa3c None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:08.445689 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 390/764] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:36:08.452551 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5742c-cf06-4616-9a91-e890707eda6b None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:08.452808 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5742c-cf06-4616-9a91-e890707eda6b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:08.453056 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5742c-cf06-4616-9a91-e890707eda6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:08.458376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59dbd7-e788-439a-b91c-1071cc90fcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:08.459176 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59dbd7-e788-439a-b91c-1071cc90fcbc None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:08.459452 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59dbd7-e788-439a-b91c-1071cc90fcbc None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:08.459724 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59dbd7-e788-439a-b91c-1071cc90fcbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:08.476635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-f9e5742c-cf06-4616-9a91-e890707eda6b None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:08.477839 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f9e5742c-cf06-4616-9a91-e890707eda6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:08.480815 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59dbd7-e788-439a-b91c-1071cc90fcbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:08.482281 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59dbd7-e788-439a-b91c-1071cc90fcbc None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:08.505220 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-ec59dbd7-e788-439a-b91c-1071cc90fcbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:36:08.509024 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 375/765] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:08.513359 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59dbd7-e788-439a-b91c-1071cc90fcbc None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:08.603542 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 391/766] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:08.629310 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5742c-cf06-4616-9a91-e890707eda6b None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:08.689484 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59dbd7-e788-439a-b91c-1071cc90fcbc None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:08.739165 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cecf5-0b0c-4d90-b2f4-df833fb1d1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:08.740140 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cecf5-0b0c-4d90-b2f4-df833fb1d1e2 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:08.740428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cecf5-0b0c-4d90-b2f4-df833fb1d1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:08.740733 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cecf5-0b0c-4d90-b2f4-df833fb1d1e2 None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:08.741540 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cecf5-0b0c-4d90-b2f4-df833fb1d1e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:08.741847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cecf5-0b0c-4d90-b2f4-df833fb1d1e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:08.743038 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5742c-cf06-4616-9a91-e890707eda6b None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:08.743321 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cecf5-0b0c-4d90-b2f4-df833fb1d1e2 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:08.757119 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 376/767] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:36:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:08.763387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cecf5-0b0c-4d90-b2f4-df833fb1d1e2 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:08.810932 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df3fdb-5ea6-4ecd-a980-2163a222efb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:08.813877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df3fdb-5ea6-4ecd-a980-2163a222efb7 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:08.814435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df3fdb-5ea6-4ecd-a980-2163a222efb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:08.815103 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df3fdb-5ea6-4ecd-a980-2163a222efb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:08.842867 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df3fdb-5ea6-4ecd-a980-2163a222efb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:08.866316 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-14df3fdb-5ea6-4ecd-a980-2163a222efb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:36:08.872789 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 392/768] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:36:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:08.885748 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df3fdb-5ea6-4ecd-a980-2163a222efb7 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:08.906086 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cecf5-0b0c-4d90-b2f4-df833fb1d1e2 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:08.942083 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b77e5-c862-4ce8-aa3e-f531d41b9939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:08.943328 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b77e5-c862-4ce8-aa3e-f531d41b9939 None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:08.943840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b77e5-c862-4ce8-aa3e-f531d41b9939 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:08.944378 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b77e5-c862-4ce8-aa3e-f531d41b9939 None admin] PATH_INFO: `/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/e7f3ea629181433eb8c6d5dbc354c141/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:08.946745 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b77e5-c862-4ce8-aa3e-f531d41b9939 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3c1bb37aa1c407782b2f5501ae1f10a, user_id=e7f3ea629181433eb8c6d5dbc354c141, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:08.948652 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b77e5-c862-4ce8-aa3e-f531d41b9939 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:09.039476 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 377/769] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:36:08 2022] PUT /identity/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/e7f3ea629181433eb8c6d5dbc354c141/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:36:09.050034 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df3fdb-5ea6-4ecd-a980-2163a222efb7 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:09.088662 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2d46b-1a20-499d-8819-1ee95c2f48d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:09.089343 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d46b-1a20-499d-8819-1ee95c2f48d4 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:09.089675 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d46b-1a20-499d-8819-1ee95c2f48d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:09.089953 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d46b-1a20-499d-8819-1ee95c2f48d4 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:09.090634 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2d46b-1a20-499d-8819-1ee95c2f48d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:09.090937 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2d46b-1a20-499d-8819-1ee95c2f48d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:09.092959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2d46b-1a20-499d-8819-1ee95c2f48d4 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:09.102736 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 393/770] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:36:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:09.110069 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b77e5-c862-4ce8-aa3e-f531d41b9939 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:09.219373 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b77e5-c862-4ce8-aa3e-f531d41b9939 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:09.256240 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61bd7a-96cd-4161-8111-2d51c85da81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:09.257084 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61bd7a-96cd-4161-8111-2d51c85da81b None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:09.257359 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61bd7a-96cd-4161-8111-2d51c85da81b None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:09.257628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61bd7a-96cd-4161-8111-2d51c85da81b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:09.269374 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61bd7a-96cd-4161-8111-2d51c85da81b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:09.270844 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61bd7a-96cd-4161-8111-2d51c85da81b None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:09.289266 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-df61bd7a-96cd-4161-8111-2d51c85da81b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:09.290918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 378/771] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:09.297258 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2d46b-1a20-499d-8819-1ee95c2f48d4 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:09.361898 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff07f5-f959-4c19-960c-b8ad8fd9a1bb None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:09.362232 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff07f5-f959-4c19-960c-b8ad8fd9a1bb None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:09.362450 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff07f5-f959-4c19-960c-b8ad8fd9a1bb None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:09.364058 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 379/772] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:36:09.369242 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf97dc-e4a4-4995-af1e-a577f6163e1e None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:09.369832 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf97dc-e4a4-4995-af1e-a577f6163e1e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:09.370304 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf97dc-e4a4-4995-af1e-a577f6163e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:09.390159 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d4bf97dc-e4a4-4995-af1e-a577f6163e1e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:09.391773 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d4bf97dc-e4a4-4995-af1e-a577f6163e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:09.411656 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2d46b-1a20-499d-8819-1ee95c2f48d4 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:09.453579 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0df54-ba7d-488c-b104-f3727d3bc801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:09.454249 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0df54-ba7d-488c-b104-f3727d3bc801 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:09.454533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0df54-ba7d-488c-b104-f3727d3bc801 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:09.454808 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0df54-ba7d-488c-b104-f3727d3bc801 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:09.455539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0df54-ba7d-488c-b104-f3727d3bc801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:09.455847 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0df54-ba7d-488c-b104-f3727d3bc801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:09.457275 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0df54-ba7d-488c-b104-f3727d3bc801 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:09.470874 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 394/773] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:09.476267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0df54-ba7d-488c-b104-f3727d3bc801 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:09.477457 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 380/774] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:09.502211 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf97dc-e4a4-4995-af1e-a577f6163e1e None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:09.578989 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0df54-ba7d-488c-b104-f3727d3bc801 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:09.606160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf97dc-e4a4-4995-af1e-a577f6163e1e None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:09.614405 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643173b-1732-48ad-b8b7-91377e976761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:09.615224 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643173b-1732-48ad-b8b7-91377e976761 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:09.615506 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643173b-1732-48ad-b8b7-91377e976761 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:09.615812 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643173b-1732-48ad-b8b7-91377e976761 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:09.624527 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643173b-1732-48ad-b8b7-91377e976761 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:09.626133 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643173b-1732-48ad-b8b7-91377e976761 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:09.641144 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-d643173b-1732-48ad-b8b7-91377e976761 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 14 21:36:09.642662 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 395/775] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Apr 14 21:36:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:09.643905 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db10444-db19-46ec-a14b-ee5cfc034513 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:09.644209 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db10444-db19-46ec-a14b-ee5cfc034513 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:09.644463 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db10444-db19-46ec-a14b-ee5cfc034513 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:09.645913 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237801fd-458d-4bbb-899c-095300eadd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:09.646963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237801fd-458d-4bbb-899c-095300eadd95 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:09.647434 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237801fd-458d-4bbb-899c-095300eadd95 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:09.647896 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237801fd-458d-4bbb-899c-095300eadd95 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:09.648790 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237801fd-458d-4bbb-899c-095300eadd95 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:09.650367 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237801fd-458d-4bbb-899c-095300eadd95 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:09.650775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 396/776] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:09.655435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db10444-db19-46ec-a14b-ee5cfc034513 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:09.669674 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-237801fd-458d-4bbb-899c-095300eadd95 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 14 21:36:09.676760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 381/777] 10.222.0.52 () {56 vars in 1129 bytes} [Thu Apr 14 21:36:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:09.678360 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a100ad-560e-4645-bb40-580e7cbc970a None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:09.678843 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a100ad-560e-4645-bb40-580e7cbc970a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:09.679332 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a100ad-560e-4645-bb40-580e7cbc970a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:09.696295 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-09a100ad-560e-4645-bb40-580e7cbc970a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:09.699062 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-09a100ad-560e-4645-bb40-580e7cbc970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:09.759486 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db10444-db19-46ec-a14b-ee5cfc034513 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:09.776820 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 382/778] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:09.777985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a100ad-560e-4645-bb40-580e7cbc970a None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:09.793900 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec21fbc-111d-4466-8688-13842d15697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:09.794574 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec21fbc-111d-4466-8688-13842d15697d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:09.794961 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec21fbc-111d-4466-8688-13842d15697d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:09.795177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec21fbc-111d-4466-8688-13842d15697d None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:09.796023 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec21fbc-111d-4466-8688-13842d15697d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:09.796667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec21fbc-111d-4466-8688-13842d15697d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:09.798120 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec21fbc-111d-4466-8688-13842d15697d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:09.815636 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 397/779] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Apr 14 21:36:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:09.817201 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f190e8-b6b7-43ca-bd61-b8c1f8c4060c None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:09.817702 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f190e8-b6b7-43ca-bd61-b8c1f8c4060c None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:09.818168 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f190e8-b6b7-43ca-bd61-b8c1f8c4060c None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:09.819832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 398/780] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:09.820848 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f190e8-b6b7-43ca-bd61-b8c1f8c4060c None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:09.880863 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a100ad-560e-4645-bb40-580e7cbc970a None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:09.914569 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a533199-2e5b-47de-9f2c-f7c172deb3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:09.915232 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a533199-2e5b-47de-9f2c-f7c172deb3a4 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:09.915514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a533199-2e5b-47de-9f2c-f7c172deb3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:09.915789 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a533199-2e5b-47de-9f2c-f7c172deb3a4 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:09.916496 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a533199-2e5b-47de-9f2c-f7c172deb3a4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:09.916840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a533199-2e5b-47de-9f2c-f7c172deb3a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:09.918236 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a533199-2e5b-47de-9f2c-f7c172deb3a4 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:09.927123 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 383/781] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Apr 14 21:36:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:09.927123 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a533199-2e5b-47de-9f2c-f7c172deb3a4 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:09.934666 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f190e8-b6b7-43ca-bd61-b8c1f8c4060c None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:09.970533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f5e23-f68b-4682-b116-5050acd2cc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:09.971642 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f5e23-f68b-4682-b116-5050acd2cc94 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:09.972103 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f5e23-f68b-4682-b116-5050acd2cc94 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:09.972618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f5e23-f68b-4682-b116-5050acd2cc94 None admin] PATH_INFO: `/v3/services/network` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:09.974199 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f5e23-f68b-4682-b116-5050acd2cc94 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:09.976417 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f5e23-f68b-4682-b116-5050acd2cc94 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:09.987982 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-af0f5e23-f68b-4682-b116-5050acd2cc94 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 14 21:36:09.993917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 399/782] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:09 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:09.993917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dcb62-bda5-49b5-b25d-a882112be692 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:09.993917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dcb62-bda5-49b5-b25d-a882112be692 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:09.993917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dcb62-bda5-49b5-b25d-a882112be692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:10.007853 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-ef2dcb62-bda5-49b5-b25d-a882112be692 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:10.009064 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ef2dcb62-bda5-49b5-b25d-a882112be692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:10.036341 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a533199-2e5b-47de-9f2c-f7c172deb3a4 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:10.071554 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adadf5-1bc2-463a-8460-8a7afbec5a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:10.072331 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adadf5-1bc2-463a-8460-8a7afbec5a54 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:10.072636 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adadf5-1bc2-463a-8460-8a7afbec5a54 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:10.072914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adadf5-1bc2-463a-8460-8a7afbec5a54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:10.080666 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 400/783] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:10.080666 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dcb62-bda5-49b5-b25d-a882112be692 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:10.092884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adadf5-1bc2-463a-8460-8a7afbec5a54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:10.094566 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adadf5-1bc2-463a-8460-8a7afbec5a54 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:10.114842 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-93adadf5-1bc2-463a-8460-8a7afbec5a54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:10.116510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 384/784] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:10.117225 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adadf5-1bc2-463a-8460-8a7afbec5a54 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:10.173481 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dcb62-bda5-49b5-b25d-a882112be692 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:10.208914 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8b3b8-4846-4cbf-a2cb-5b817b7a4d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:10.209590 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8b3b8-4846-4cbf-a2cb-5b817b7a4d15 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:10.209869 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8b3b8-4846-4cbf-a2cb-5b817b7a4d15 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:10.210163 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8b3b8-4846-4cbf-a2cb-5b817b7a4d15 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:10.211106 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8b3b8-4846-4cbf-a2cb-5b817b7a4d15 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:10.211411 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8b3b8-4846-4cbf-a2cb-5b817b7a4d15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:10.212837 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8b3b8-4846-4cbf-a2cb-5b817b7a4d15 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:10.222462 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 401/785] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Apr 14 21:36:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:10.222629 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adadf5-1bc2-463a-8460-8a7afbec5a54 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:10.222749 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8b3b8-4846-4cbf-a2cb-5b817b7a4d15 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:10.254702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2895aee-2f80-442b-b82a-36a3b28c5df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:10.255387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2895aee-2f80-442b-b82a-36a3b28c5df4 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:10.255665 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2895aee-2f80-442b-b82a-36a3b28c5df4 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:10.255940 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2895aee-2f80-442b-b82a-36a3b28c5df4 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:10.256657 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2895aee-2f80-442b-b82a-36a3b28c5df4 None admin] RBAC: Adding query filter params (name=network) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:10.256962 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2895aee-2f80-442b-b82a-36a3b28c5df4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:10.258312 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2895aee-2f80-442b-b82a-36a3b28c5df4 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:10.267276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 385/786] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Apr 14 21:36:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:10.267276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2895aee-2f80-442b-b82a-36a3b28c5df4 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:10.326565 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8b3b8-4846-4cbf-a2cb-5b817b7a4d15 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:10.360145 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2895aee-2f80-442b-b82a-36a3b28c5df4 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:10.361980 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ceea8-e3fa-4466-8dc9-6baa56865ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:10.362885 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ceea8-e3fa-4466-8dc9-6baa56865ba1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:10.363162 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ceea8-e3fa-4466-8dc9-6baa56865ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:10.363430 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ceea8-e3fa-4466-8dc9-6baa56865ba1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:10.373920 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ceea8-e3fa-4466-8dc9-6baa56865ba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:10.380828 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-666ceea8-e3fa-4466-8dc9-6baa56865ba1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:36:10.386698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 402/787] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:36:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:10.386698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ceea8-e3fa-4466-8dc9-6baa56865ba1 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:10.399253 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb6222-309b-4cbe-b728-bb6a53e1a72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:10.399913 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb6222-309b-4cbe-b728-bb6a53e1a72e None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:10.400192 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb6222-309b-4cbe-b728-bb6a53e1a72e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:10.400457 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb6222-309b-4cbe-b728-bb6a53e1a72e None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:10.401215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb6222-309b-4cbe-b728-bb6a53e1a72e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:10.401509 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb6222-309b-4cbe-b728-bb6a53e1a72e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:10.402871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb6222-309b-4cbe-b728-bb6a53e1a72e None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:10.415188 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 386/788] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:10.415983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb6222-309b-4cbe-b728-bb6a53e1a72e None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:10.489123 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ceea8-e3fa-4466-8dc9-6baa56865ba1 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:10.518847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb6222-309b-4cbe-b728-bb6a53e1a72e None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:10.524063 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20741b3d-4336-4683-9a52-26321a28de8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:10.524940 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20741b3d-4336-4683-9a52-26321a28de8d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:10.525384 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20741b3d-4336-4683-9a52-26321a28de8d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:10.525816 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20741b3d-4336-4683-9a52-26321a28de8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:10.526609 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20741b3d-4336-4683-9a52-26321a28de8d None admin] RBAC: Adding query filter params (interface=public, service_id=0dc48c78ade84d9297d6096678655101, region_id=RegionOne) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:10.526924 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20741b3d-4336-4683-9a52-26321a28de8d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:10.528293 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20741b3d-4336-4683-9a52-26321a28de8d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:10.540445 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 403/789] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Apr 14 21:36:10 2022] GET /identity/v3/endpoints?service_id=0dc48c78ade84d9297d6096678655101&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:10.540445 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20741b3d-4336-4683-9a52-26321a28de8d None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:10.552128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858ae9d-a78b-470f-94ad-aaffda523228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:10.553073 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858ae9d-a78b-470f-94ad-aaffda523228 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:10.553560 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858ae9d-a78b-470f-94ad-aaffda523228 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:10.553834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858ae9d-a78b-470f-94ad-aaffda523228 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:10.554537 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858ae9d-a78b-470f-94ad-aaffda523228 None admin] RBAC: Adding query filter params (type=network) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:10.554838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858ae9d-a78b-470f-94ad-aaffda523228 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:10.556187 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858ae9d-a78b-470f-94ad-aaffda523228 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:10.562187 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 387/790] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Apr 14 21:36:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:10.562987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858ae9d-a78b-470f-94ad-aaffda523228 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:10.644881 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20741b3d-4336-4683-9a52-26321a28de8d None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:10.662191 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858ae9d-a78b-470f-94ad-aaffda523228 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:10.677543 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e2fc4-d8f9-4130-9b60-b025d4c464ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:10.678208 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e2fc4-d8f9-4130-9b60-b025d4c464ba None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:10.678483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e2fc4-d8f9-4130-9b60-b025d4c464ba None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:10.678754 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e2fc4-d8f9-4130-9b60-b025d4c464ba None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:10.679490 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e2fc4-d8f9-4130-9b60-b025d4c464ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:10.679793 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e2fc4-d8f9-4130-9b60-b025d4c464ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:10.681190 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e2fc4-d8f9-4130-9b60-b025d4c464ba None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:10.695623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 404/791] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:36:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:10.695623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e2fc4-d8f9-4130-9b60-b025d4c464ba None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:10.699979 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa675ee1-08ca-4e43-b5d6-62d7e94383af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:10.700802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa675ee1-08ca-4e43-b5d6-62d7e94383af None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:10.701218 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa675ee1-08ca-4e43-b5d6-62d7e94383af None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:10.701497 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa675ee1-08ca-4e43-b5d6-62d7e94383af None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:10.708492 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa675ee1-08ca-4e43-b5d6-62d7e94383af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:10.709976 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa675ee1-08ca-4e43-b5d6-62d7e94383af None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:10.724207 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-aa675ee1-08ca-4e43-b5d6-62d7e94383af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:36:10.729815 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 388/792] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:10.729815 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa675ee1-08ca-4e43-b5d6-62d7e94383af None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:10.790035 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e2fc4-d8f9-4130-9b60-b025d4c464ba None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:10.825960 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de1400-a3bb-4a13-a775-e25b871d5971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:10.827021 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de1400-a3bb-4a13-a775-e25b871d5971 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:10.827310 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de1400-a3bb-4a13-a775-e25b871d5971 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:10.827583 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de1400-a3bb-4a13-a775-e25b871d5971 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:10.828267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de1400-a3bb-4a13-a775-e25b871d5971 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:10.828538 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa675ee1-08ca-4e43-b5d6-62d7e94383af None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:10.829685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de1400-a3bb-4a13-a775-e25b871d5971 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:10.844845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 405/793] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Apr 14 21:36:10 2022] GET /identity/v3/services => generated 772 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:10.844845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de1400-a3bb-4a13-a775-e25b871d5971 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:10.876968 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1b651-1d34-4713-a18b-7668a9ed4245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:10.877652 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1b651-1d34-4713-a18b-7668a9ed4245 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:10.877928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1b651-1d34-4713-a18b-7668a9ed4245 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:10.878199 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1b651-1d34-4713-a18b-7668a9ed4245 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:10.879005 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1b651-1d34-4713-a18b-7668a9ed4245 None admin] RBAC: Adding query filter params (interface=public, service_id=215f200495464e0e8001b20a1cd585cd, region_id=RegionOne) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:10.879311 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1b651-1d34-4713-a18b-7668a9ed4245 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:10.880739 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1b651-1d34-4713-a18b-7668a9ed4245 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:10.890403 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 389/794] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Apr 14 21:36:10 2022] GET /identity/v3/endpoints?service_id=215f200495464e0e8001b20a1cd585cd&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:10.891293 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1b651-1d34-4713-a18b-7668a9ed4245 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:10.949924 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de1400-a3bb-4a13-a775-e25b871d5971 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:11.001985 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48883e8e-a2ca-4bc0-a3df-f4ad4850d4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:11.003703 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883e8e-a2ca-4bc0-a3df-f4ad4850d4fa None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:11.004179 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883e8e-a2ca-4bc0-a3df-f4ad4850d4fa None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:11.004868 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883e8e-a2ca-4bc0-a3df-f4ad4850d4fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:11.011598 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1b651-1d34-4713-a18b-7668a9ed4245 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:11.019902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48883e8e-a2ca-4bc0-a3df-f4ad4850d4fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:11.022199 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48883e8e-a2ca-4bc0-a3df-f4ad4850d4fa None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:11.043713 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-48883e8e-a2ca-4bc0-a3df-f4ad4850d4fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:11.045820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 406/795] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:11.046737 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48883e8e-a2ca-4bc0-a3df-f4ad4850d4fa None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:11.055520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ba543-2376-4cae-920d-4d8d2adb5a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:11.056326 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ba543-2376-4cae-920d-4d8d2adb5a09 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:11.056631 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ba543-2376-4cae-920d-4d8d2adb5a09 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:11.056928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ba543-2376-4cae-920d-4d8d2adb5a09 None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:11.057726 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ba543-2376-4cae-920d-4d8d2adb5a09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:11.058037 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ba543-2376-4cae-920d-4d8d2adb5a09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:11.059467 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ba543-2376-4cae-920d-4d8d2adb5a09 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:11.073945 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 390/796] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:36:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:11.075110 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ba543-2376-4cae-920d-4d8d2adb5a09 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:11.173785 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48883e8e-a2ca-4bc0-a3df-f4ad4850d4fa None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:11.178850 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ba543-2376-4cae-920d-4d8d2adb5a09 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:11.217333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec19f87-6b4c-4d9d-858c-3b319310703d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:11.217921 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec19f87-6b4c-4d9d-858c-3b319310703d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:11.218195 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec19f87-6b4c-4d9d-858c-3b319310703d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:11.218470 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec19f87-6b4c-4d9d-858c-3b319310703d None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:11.219182 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec19f87-6b4c-4d9d-858c-3b319310703d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:11.219489 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec19f87-6b4c-4d9d-858c-3b319310703d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:11.220281 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d2d6b-ebde-42d8-ac4d-2dba84de240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:11.220865 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec19f87-6b4c-4d9d-858c-3b319310703d None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:11.221437 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d2d6b-ebde-42d8-ac4d-2dba84de240a None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:11.221915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d2d6b-ebde-42d8-ac4d-2dba84de240a None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:11.222603 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d2d6b-ebde-42d8-ac4d-2dba84de240a None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:11.224093 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d2d6b-ebde-42d8-ac4d-2dba84de240a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:11.225720 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d2d6b-ebde-42d8-ac4d-2dba84de240a None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:11.238038 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 391/797] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:11.238663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 407/798] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Apr 14 21:36:11 2022] GET /identity/v3/services => generated 772 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:11.239046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec19f87-6b4c-4d9d-858c-3b319310703d None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:11.240246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d2d6b-ebde-42d8-ac4d-2dba84de240a None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:11.434324 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec19f87-6b4c-4d9d-858c-3b319310703d None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:11.449860 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d2d6b-ebde-42d8-ac4d-2dba84de240a None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:11.492250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a152f8-5be1-4863-979c-b2f2a1365f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:11.493311 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a152f8-5be1-4863-979c-b2f2a1365f38 None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:11.493597 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a152f8-5be1-4863-979c-b2f2a1365f38 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:11.493923 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a152f8-5be1-4863-979c-b2f2a1365f38 None admin] PATH_INFO: `/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/1144e9036d0b4bafb30995ff1a8449ec/roles/44e1b9c3f51e473a8af9b883e80a74d2` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:11.500902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca13a4-f929-4431-aa4a-9f1fbea793b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:11.501970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca13a4-f929-4431-aa4a-9f1fbea793b0 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:11.502490 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca13a4-f929-4431-aa4a-9f1fbea793b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:11.502965 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca13a4-f929-4431-aa4a-9f1fbea793b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:11.510764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a152f8-5be1-4863-979c-b2f2a1365f38 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3c1bb37aa1c407782b2f5501ae1f10a, user_id=1144e9036d0b4bafb30995ff1a8449ec, role_id=44e1b9c3f51e473a8af9b883e80a74d2)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:11.511500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca13a4-f929-4431-aa4a-9f1fbea793b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:11.512215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a152f8-5be1-4863-979c-b2f2a1365f38 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:11.513454 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca13a4-f929-4431-aa4a-9f1fbea793b0 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:11.528233 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-47ca13a4-f929-4431-aa4a-9f1fbea793b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 14 21:36:11.529768 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 408/799] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:36:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:11.535867 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca13a4-f929-4431-aa4a-9f1fbea793b0 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:11.591224 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 392/800] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:36:11 2022] PUT /identity/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/1144e9036d0b4bafb30995ff1a8449ec/roles/44e1b9c3f51e473a8af9b883e80a74d2 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:36:11.648865 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca13a4-f929-4431-aa4a-9f1fbea793b0 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:11.692315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f6ce3-9033-4a71-98d1-29758418e27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:11.693025 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f6ce3-9033-4a71-98d1-29758418e27c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:11.693300 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f6ce3-9033-4a71-98d1-29758418e27c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:11.693572 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f6ce3-9033-4a71-98d1-29758418e27c None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:11.694419 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f6ce3-9033-4a71-98d1-29758418e27c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:11.694722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f6ce3-9033-4a71-98d1-29758418e27c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:11.696149 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f6ce3-9033-4a71-98d1-29758418e27c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:11.722269 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 409/801] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Apr 14 21:36:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:11.727715 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a152f8-5be1-4863-979c-b2f2a1365f38 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:11.739405 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b32ba9-37ed-4363-b615-f45505355dad None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:11.739739 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b32ba9-37ed-4363-b615-f45505355dad None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:11.739956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b32ba9-37ed-4363-b615-f45505355dad None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:11.746670 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 410/802] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:11.748683 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b20bb5-4f69-40fc-a4d6-4b5b8e32b8e6 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:11.749044 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b20bb5-4f69-40fc-a4d6-4b5b8e32b8e6 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:11.749320 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b20bb5-4f69-40fc-a4d6-4b5b8e32b8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:11.790248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-36b20bb5-4f69-40fc-a4d6-4b5b8e32b8e6 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:11.791475 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-36b20bb5-4f69-40fc-a4d6-4b5b8e32b8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:11.898376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a152f8-5be1-4863-979c-b2f2a1365f38 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:11.909717 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 411/803] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:11.937161 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b20bb5-4f69-40fc-a4d6-4b5b8e32b8e6 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:11.938717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2c8c0-9ed5-400c-bed2-06334a90a61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:11.939524 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2c8c0-9ed5-400c-bed2-06334a90a61e None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:11.939801 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2c8c0-9ed5-400c-bed2-06334a90a61e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:11.940069 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2c8c0-9ed5-400c-bed2-06334a90a61e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:11.952345 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2c8c0-9ed5-400c-bed2-06334a90a61e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:11.955797 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2c8c0-9ed5-400c-bed2-06334a90a61e None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:11.980613 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-31b2c8c0-9ed5-400c-bed2-06334a90a61e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:11.980613 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 393/804] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:11.988612 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2c8c0-9ed5-400c-bed2-06334a90a61e None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:12.040925 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b20bb5-4f69-40fc-a4d6-4b5b8e32b8e6 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:12.075466 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbd45d-047c-4c18-a657-05de9b5cc165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:12.076935 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbd45d-047c-4c18-a657-05de9b5cc165 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:12.077497 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbd45d-047c-4c18-a657-05de9b5cc165 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:12.077969 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbd45d-047c-4c18-a657-05de9b5cc165 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:12.090017 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbd45d-047c-4c18-a657-05de9b5cc165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:12.099198 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-30bbd45d-047c-4c18-a657-05de9b5cc165 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:36:12.104972 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 412/805] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:36:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:12.106865 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbd45d-047c-4c18-a657-05de9b5cc165 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:12.136631 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2c8c0-9ed5-400c-bed2-06334a90a61e None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:12.177627 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2eebf-3fe4-4fbf-9251-9bd68486e356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:12.178297 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2eebf-3fe4-4fbf-9251-9bd68486e356 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:12.178571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2eebf-3fe4-4fbf-9251-9bd68486e356 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:12.178840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2eebf-3fe4-4fbf-9251-9bd68486e356 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:12.179565 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2eebf-3fe4-4fbf-9251-9bd68486e356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:12.179865 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2eebf-3fe4-4fbf-9251-9bd68486e356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:12.181281 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2eebf-3fe4-4fbf-9251-9bd68486e356 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:12.199720 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 394/806] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:12.208755 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2eebf-3fe4-4fbf-9251-9bd68486e356 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:12.302867 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbd45d-047c-4c18-a657-05de9b5cc165 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:12.350406 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2eebf-3fe4-4fbf-9251-9bd68486e356 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:12.386936 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daedd6-f97b-4447-b2e4-156854d945fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:12.388085 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daedd6-f97b-4447-b2e4-156854d945fd None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:12.389183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daedd6-f97b-4447-b2e4-156854d945fd None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:12.389844 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daedd6-f97b-4447-b2e4-156854d945fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:12.390664 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff4011-b2bd-43f2-9712-f108ca0b742c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:12.391334 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff4011-b2bd-43f2-9712-f108ca0b742c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:12.391613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff4011-b2bd-43f2-9712-f108ca0b742c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:12.391881 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff4011-b2bd-43f2-9712-f108ca0b742c None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:12.392649 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff4011-b2bd-43f2-9712-f108ca0b742c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:12.392965 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff4011-b2bd-43f2-9712-f108ca0b742c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:12.394330 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff4011-b2bd-43f2-9712-f108ca0b742c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:12.398797 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daedd6-f97b-4447-b2e4-156854d945fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:12.400560 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daedd6-f97b-4447-b2e4-156854d945fd None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:12.411946 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 413/807] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:36:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:12.416447 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-01daedd6-f97b-4447-b2e4-156854d945fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:36:12.416984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff4011-b2bd-43f2-9712-f108ca0b742c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:12.418378 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 395/808] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:12.425879 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daedd6-f97b-4447-b2e4-156854d945fd None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:12.563235 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daedd6-f97b-4447-b2e4-156854d945fd None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:12.604116 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff4011-b2bd-43f2-9712-f108ca0b742c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:12.637861 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602101b-6a5a-4bc1-accb-10555a9367a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:12.639118 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602101b-6a5a-4bc1-accb-10555a9367a1 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:12.639985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602101b-6a5a-4bc1-accb-10555a9367a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:12.640262 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602101b-6a5a-4bc1-accb-10555a9367a1 None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:12.641100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602101b-6a5a-4bc1-accb-10555a9367a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:12.641408 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602101b-6a5a-4bc1-accb-10555a9367a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:12.642836 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602101b-6a5a-4bc1-accb-10555a9367a1 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:12.647926 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f1362-de20-4c12-8e3d-ea725fc0e4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:12.648749 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f1362-de20-4c12-8e3d-ea725fc0e4e1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:12.649029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f1362-de20-4c12-8e3d-ea725fc0e4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:12.649533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f1362-de20-4c12-8e3d-ea725fc0e4e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:12.660804 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f1362-de20-4c12-8e3d-ea725fc0e4e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:12.662309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f1362-de20-4c12-8e3d-ea725fc0e4e1 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:12.670000 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 396/809] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:36:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:12.677085 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602101b-6a5a-4bc1-accb-10555a9367a1 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:12.683784 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-890f1362-de20-4c12-8e3d-ea725fc0e4e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:12.686090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 414/810] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:12.691531 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f1362-de20-4c12-8e3d-ea725fc0e4e1 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:12.793549 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f1362-de20-4c12-8e3d-ea725fc0e4e1 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:12.827953 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27011cf-8661-4c7b-8392-2b603c38ef56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:12.828538 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27011cf-8661-4c7b-8392-2b603c38ef56 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:12.828843 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27011cf-8661-4c7b-8392-2b603c38ef56 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:12.829115 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27011cf-8661-4c7b-8392-2b603c38ef56 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:12.829836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27011cf-8661-4c7b-8392-2b603c38ef56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:12.830138 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27011cf-8661-4c7b-8392-2b603c38ef56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:12.840607 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27011cf-8661-4c7b-8392-2b603c38ef56 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:12.845154 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 415/811] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:12.850396 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27011cf-8661-4c7b-8392-2b603c38ef56 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:12.886771 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602101b-6a5a-4bc1-accb-10555a9367a1 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:12.949484 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27011cf-8661-4c7b-8392-2b603c38ef56 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:12.968608 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e379dd-58db-4b56-b518-b28e4766d6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:12.972001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e379dd-58db-4b56-b518-b28e4766d6c4 None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:12.972001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e379dd-58db-4b56-b518-b28e4766d6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:12.972001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e379dd-58db-4b56-b518-b28e4766d6c4 None admin] PATH_INFO: `/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/360bf55488d046c4be98a903d113c0fc/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:12.972429 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e379dd-58db-4b56-b518-b28e4766d6c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3c1bb37aa1c407782b2f5501ae1f10a, user_id=360bf55488d046c4be98a903d113c0fc, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:12.974065 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e379dd-58db-4b56-b518-b28e4766d6c4 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:12.990117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cb543-ea39-4315-902e-c2bab2ee31e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:12.991089 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cb543-ea39-4315-902e-c2bab2ee31e3 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:12.991506 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cb543-ea39-4315-902e-c2bab2ee31e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:12.991915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cb543-ea39-4315-902e-c2bab2ee31e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:12.999989 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cb543-ea39-4315-902e-c2bab2ee31e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:13.001763 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cb543-ea39-4315-902e-c2bab2ee31e3 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:13.016168 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-aa9cb543-ea39-4315-902e-c2bab2ee31e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 14 21:36:13.018031 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 416/812] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Apr 14 21:36:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:13.024083 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cb543-ea39-4315-902e-c2bab2ee31e3 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:13.074600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 397/813] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:36:12 2022] PUT /identity/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/360bf55488d046c4be98a903d113c0fc/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:36:13.135652 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cb543-ea39-4315-902e-c2bab2ee31e3 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:13.172347 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c05c9-9a84-46eb-a01f-f19182a9c089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:13.173048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c05c9-9a84-46eb-a01f-f19182a9c089 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:13.173324 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c05c9-9a84-46eb-a01f-f19182a9c089 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:13.173590 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c05c9-9a84-46eb-a01f-f19182a9c089 None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:13.174483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c05c9-9a84-46eb-a01f-f19182a9c089 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:13.174790 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c05c9-9a84-46eb-a01f-f19182a9c089 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:13.176242 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c05c9-9a84-46eb-a01f-f19182a9c089 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:13.196183 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 417/814] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Apr 14 21:36:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:13.202031 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e379dd-58db-4b56-b518-b28e4766d6c4 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:13.324482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e379dd-58db-4b56-b518-b28e4766d6c4 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:13.372189 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ecc5a-9909-46f3-8873-c96863f6f898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:13.372924 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ecc5a-9909-46f3-8873-c96863f6f898 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:13.373776 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ecc5a-9909-46f3-8873-c96863f6f898 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:13.374048 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ecc5a-9909-46f3-8873-c96863f6f898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:13.428928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9effa18-439c-4224-bffb-36e543fc01f5 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:13.429201 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9effa18-439c-4224-bffb-36e543fc01f5 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:13.429405 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9effa18-439c-4224-bffb-36e543fc01f5 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:13.431988 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 418/815] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:13.436320 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e11bf8-b17f-4d6f-938c-206047fcbe2d None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:13.436623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e11bf8-b17f-4d6f-938c-206047fcbe2d None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:13.436906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e11bf8-b17f-4d6f-938c-206047fcbe2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:13.453889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-86e11bf8-b17f-4d6f-938c-206047fcbe2d None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:13.455106 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-86e11bf8-b17f-4d6f-938c-206047fcbe2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:13.479174 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ecc5a-9909-46f3-8873-c96863f6f898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:13.481939 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ecc5a-9909-46f3-8873-c96863f6f898 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:13.564041 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 419/816] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:13.589439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e11bf8-b17f-4d6f-938c-206047fcbe2d None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:13.605767 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 398/817] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:36:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 14 21:36:13.613700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ecc5a-9909-46f3-8873-c96863f6f898 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:13.756593 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e11bf8-b17f-4d6f-938c-206047fcbe2d None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:13.799983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ecc5a-9909-46f3-8873-c96863f6f898 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:13.823065 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54227a-0190-4e9a-8a9c-5b624f7f572d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:13.823884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54227a-0190-4e9a-8a9c-5b624f7f572d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:13.824159 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54227a-0190-4e9a-8a9c-5b624f7f572d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:13.824424 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54227a-0190-4e9a-8a9c-5b624f7f572d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:13.825104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54227a-0190-4e9a-8a9c-5b624f7f572d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:13.826990 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54227a-0190-4e9a-8a9c-5b624f7f572d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:13.844910 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-bf54227a-0190-4e9a-8a9c-5b624f7f572d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 14 21:36:13.846138 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 420/818] 10.222.0.52 () {56 vars in 1129 bytes} [Thu Apr 14 21:36:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:13.854065 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54227a-0190-4e9a-8a9c-5b624f7f572d None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:13.862388 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08210453-f613-455d-95de-e8fee660fe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:13.863227 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08210453-f613-455d-95de-e8fee660fe53 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:13.863505 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08210453-f613-455d-95de-e8fee660fe53 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:13.863771 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08210453-f613-455d-95de-e8fee660fe53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:13.881120 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08210453-f613-455d-95de-e8fee660fe53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:13.882558 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08210453-f613-455d-95de-e8fee660fe53 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:13.909964 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-08210453-f613-455d-95de-e8fee660fe53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:13.914551 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 399/819] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:13.925116 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08210453-f613-455d-95de-e8fee660fe53 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:14.037050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54227a-0190-4e9a-8a9c-5b624f7f572d None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:14.096415 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a211c7f-43c1-4dc4-b821-56a0e0158d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:14.097121 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a211c7f-43c1-4dc4-b821-56a0e0158d45 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:14.097488 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a211c7f-43c1-4dc4-b821-56a0e0158d45 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:14.097762 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a211c7f-43c1-4dc4-b821-56a0e0158d45 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:14.098485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a211c7f-43c1-4dc4-b821-56a0e0158d45 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:14.098787 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a211c7f-43c1-4dc4-b821-56a0e0158d45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:14.100191 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a211c7f-43c1-4dc4-b821-56a0e0158d45 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:14.104880 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08210453-f613-455d-95de-e8fee660fe53 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:14.111291 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 421/820] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Apr 14 21:36:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:14.117212 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a211c7f-43c1-4dc4-b821-56a0e0158d45 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:14.179750 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c806ff-aaed-4474-968d-89c983b3661a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:14.180467 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c806ff-aaed-4474-968d-89c983b3661a None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:14.180815 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c806ff-aaed-4474-968d-89c983b3661a None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:14.181094 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c806ff-aaed-4474-968d-89c983b3661a None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:14.181823 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c806ff-aaed-4474-968d-89c983b3661a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:14.182125 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c806ff-aaed-4474-968d-89c983b3661a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:14.183498 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c806ff-aaed-4474-968d-89c983b3661a None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:14.204257 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 400/821] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:14.205648 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9186356-0df9-4ab0-b620-256771f52bb9 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:14.205931 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9186356-0df9-4ab0-b620-256771f52bb9 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:14.206204 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9186356-0df9-4ab0-b620-256771f52bb9 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:14.214842 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 401/822] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:14.215832 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9186356-0df9-4ab0-b620-256771f52bb9 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:14.246884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a211c7f-43c1-4dc4-b821-56a0e0158d45 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:14.283106 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0b629-dbbf-4cd1-8584-ed90f22fb591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:14.283778 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0b629-dbbf-4cd1-8584-ed90f22fb591 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:14.284054 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0b629-dbbf-4cd1-8584-ed90f22fb591 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:14.284321 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0b629-dbbf-4cd1-8584-ed90f22fb591 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:14.285239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0b629-dbbf-4cd1-8584-ed90f22fb591 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:14.285925 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0b629-dbbf-4cd1-8584-ed90f22fb591 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:14.287835 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0b629-dbbf-4cd1-8584-ed90f22fb591 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:14.294320 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 422/823] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Apr 14 21:36:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:14.296425 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0280ea6-b749-4aa5-9663-31621a041c8c None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:14.296736 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0280ea6-b749-4aa5-9663-31621a041c8c None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:14.297517 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0280ea6-b749-4aa5-9663-31621a041c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:14.319202 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-e0280ea6-b749-4aa5-9663-31621a041c8c None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:14.320507 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e0280ea6-b749-4aa5-9663-31621a041c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:14.339010 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9186356-0df9-4ab0-b620-256771f52bb9 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:14.383194 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed3e85-00eb-4750-815f-18b7555d99f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:14.384331 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3e85-00eb-4750-815f-18b7555d99f8 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:14.384928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3e85-00eb-4750-815f-18b7555d99f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:14.385205 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3e85-00eb-4750-815f-18b7555d99f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:14.392042 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 423/824] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:14.393007 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0280ea6-b749-4aa5-9663-31621a041c8c None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:14.403106 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed3e85-00eb-4750-815f-18b7555d99f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:14.406001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed3e85-00eb-4750-815f-18b7555d99f8 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:14.429147 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-b1ed3e85-00eb-4750-815f-18b7555d99f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:36:14.431188 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 402/825] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:14.432244 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed3e85-00eb-4750-815f-18b7555d99f8 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:14.529054 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0280ea6-b749-4aa5-9663-31621a041c8c None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:14.545267 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed3e85-00eb-4750-815f-18b7555d99f8 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:14.562860 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55c4f5-44ed-4a2b-84fc-8850667bcff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:14.563522 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55c4f5-44ed-4a2b-84fc-8850667bcff5 None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:14.563808 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55c4f5-44ed-4a2b-84fc-8850667bcff5 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:14.564080 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55c4f5-44ed-4a2b-84fc-8850667bcff5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:14.564852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55c4f5-44ed-4a2b-84fc-8850667bcff5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:14.566238 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55c4f5-44ed-4a2b-84fc-8850667bcff5 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:14.581555 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385d728-8e46-41c0-a98c-313e76a69343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:14.582342 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385d728-8e46-41c0-a98c-313e76a69343 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:14.582621 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385d728-8e46-41c0-a98c-313e76a69343 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:14.582904 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385d728-8e46-41c0-a98c-313e76a69343 None admin] PATH_INFO: `/v3/services/network` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:14.583530 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385d728-8e46-41c0-a98c-313e76a69343 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:14.584928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385d728-8e46-41c0-a98c-313e76a69343 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:14.595743 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-b385d728-8e46-41c0-a98c-313e76a69343 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 14 21:36:14.596929 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 403/826] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:14 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:14.597681 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385d728-8e46-41c0-a98c-313e76a69343 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:14.679645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 424/827] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Apr 14 21:36:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:36:14.681033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7059b0a-2f1d-4ce5-9672-f1e817971434 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:14.681321 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7059b0a-2f1d-4ce5-9672-f1e817971434 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:14.681595 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7059b0a-2f1d-4ce5-9672-f1e817971434 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:14.682992 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 425/828] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:14.686719 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7059b0a-2f1d-4ce5-9672-f1e817971434 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:14.710879 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385d728-8e46-41c0-a98c-313e76a69343 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:14.758753 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d918339-16ee-4d7b-bb4b-d8d0408f1db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:14.759855 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d918339-16ee-4d7b-bb4b-d8d0408f1db4 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:14.760422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d918339-16ee-4d7b-bb4b-d8d0408f1db4 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:14.760914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d918339-16ee-4d7b-bb4b-d8d0408f1db4 None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:14.761930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d918339-16ee-4d7b-bb4b-d8d0408f1db4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:14.762463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d918339-16ee-4d7b-bb4b-d8d0408f1db4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:14.765092 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d918339-16ee-4d7b-bb4b-d8d0408f1db4 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:14.778801 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 404/829] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:36:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:14.781455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fcce6-e7be-4565-bece-70feee6e7721 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:14.781973 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fcce6-e7be-4565-bece-70feee6e7721 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:14.782463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fcce6-e7be-4565-bece-70feee6e7721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:14.801468 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-270fcce6-e7be-4565-bece-70feee6e7721 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:14.803512 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-270fcce6-e7be-4565-bece-70feee6e7721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:14.823945 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7059b0a-2f1d-4ce5-9672-f1e817971434 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:14.863624 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d602fe2-7040-4454-b749-b9b729c54672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:14.864789 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d602fe2-7040-4454-b749-b9b729c54672 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:14.865319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d602fe2-7040-4454-b749-b9b729c54672 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:14.865806 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d602fe2-7040-4454-b749-b9b729c54672 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:14.866802 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d602fe2-7040-4454-b749-b9b729c54672 None admin] RBAC: Adding query filter params (name=network) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:14.867354 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d602fe2-7040-4454-b749-b9b729c54672 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:14.869035 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d602fe2-7040-4454-b749-b9b729c54672 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:14.879348 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 426/830] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Apr 14 21:36:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:14.880536 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d602fe2-7040-4454-b749-b9b729c54672 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:14.891799 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 405/831] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:14.894511 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fcce6-e7be-4565-bece-70feee6e7721 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:15.004953 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d602fe2-7040-4454-b749-b9b729c54672 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:15.012492 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fcce6-e7be-4565-bece-70feee6e7721 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:15.046054 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea8a90-d4dc-4ba6-9e66-5fff03d23167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:15.046716 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea8a90-d4dc-4ba6-9e66-5fff03d23167 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:15.046992 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea8a90-d4dc-4ba6-9e66-5fff03d23167 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:15.047262 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea8a90-d4dc-4ba6-9e66-5fff03d23167 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:15.048089 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea8a90-d4dc-4ba6-9e66-5fff03d23167 None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=e7f3ea629181433eb8c6d5dbc354c141) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:15.048392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea8a90-d4dc-4ba6-9e66-5fff03d23167 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:15.049861 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea8a90-d4dc-4ba6-9e66-5fff03d23167 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:15.057839 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 427/832] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:36:14 2022] GET /identity/v3/role_assignments?user.id=e7f3ea629181433eb8c6d5dbc354c141&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:15.063747 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea8a90-d4dc-4ba6-9e66-5fff03d23167 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:15.063907 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d86960-b02d-494a-9705-2dc6a37404ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:15.063907 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d86960-b02d-494a-9705-2dc6a37404ca None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:15.063907 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d86960-b02d-494a-9705-2dc6a37404ca None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:15.063907 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d86960-b02d-494a-9705-2dc6a37404ca None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:15.064202 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d86960-b02d-494a-9705-2dc6a37404ca None admin] RBAC: Adding query filter params (type=network) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:15.064202 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d86960-b02d-494a-9705-2dc6a37404ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:15.073494 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d86960-b02d-494a-9705-2dc6a37404ca None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:15.082961 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 406/833] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Apr 14 21:36:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:15.090332 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d86960-b02d-494a-9705-2dc6a37404ca None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:15.245947 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d86960-b02d-494a-9705-2dc6a37404ca None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:15.290227 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa7e53-397b-4033-b43b-e7275d500f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:15.291823 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa7e53-397b-4033-b43b-e7275d500f65 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:15.291823 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa7e53-397b-4033-b43b-e7275d500f65 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:15.291823 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa7e53-397b-4033-b43b-e7275d500f65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:15.292177 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa7e53-397b-4033-b43b-e7275d500f65 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:15.293629 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa7e53-397b-4033-b43b-e7275d500f65 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:15.315010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea8a90-d4dc-4ba6-9e66-5fff03d23167 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:15.350970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4a861-dd78-4fbc-b641-c75b37aef983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:15.351762 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4a861-dd78-4fbc-b641-c75b37aef983 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:15.352039 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4a861-dd78-4fbc-b641-c75b37aef983 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:15.352309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4a861-dd78-4fbc-b641-c75b37aef983 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:15.363977 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4a861-dd78-4fbc-b641-c75b37aef983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:15.371303 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-f9e4a861-dd78-4fbc-b641-c75b37aef983 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:36:15.373105 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 428/834] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:36:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:15.381189 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4a861-dd78-4fbc-b641-c75b37aef983 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:15.401869 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 407/835] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Apr 14 21:36:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:36:15.515440 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4a861-dd78-4fbc-b641-c75b37aef983 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:15.575717 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3b9c1-f74f-4d6b-82a2-570143338fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:15.577007 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3b9c1-f74f-4d6b-82a2-570143338fe4 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:15.577295 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3b9c1-f74f-4d6b-82a2-570143338fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:15.577567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3b9c1-f74f-4d6b-82a2-570143338fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:15.578339 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3b9c1-f74f-4d6b-82a2-570143338fe4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:15.578650 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3b9c1-f74f-4d6b-82a2-570143338fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:15.580115 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3b9c1-f74f-4d6b-82a2-570143338fe4 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:15.593987 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 429/836] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:36:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:15.599768 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa7e53-397b-4033-b43b-e7275d500f65 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:15.736233 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa7e53-397b-4033-b43b-e7275d500f65 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:15.772921 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d4a5c-9ac3-414d-9146-ce50f9a5ec62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:15.773760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d4a5c-9ac3-414d-9146-ce50f9a5ec62 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:15.774039 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d4a5c-9ac3-414d-9146-ce50f9a5ec62 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:15.774309 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d4a5c-9ac3-414d-9146-ce50f9a5ec62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:15.786556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d4a5c-9ac3-414d-9146-ce50f9a5ec62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:15.788004 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d4a5c-9ac3-414d-9146-ce50f9a5ec62 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:15.808752 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-c51d4a5c-9ac3-414d-9146-ce50f9a5ec62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:15.811281 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 408/837] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:15.816250 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3b9c1-f74f-4d6b-82a2-570143338fe4 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:15.871869 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef53b8d-517f-4628-88b0-f99dfe0dcac8 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:15.872191 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef53b8d-517f-4628-88b0-f99dfe0dcac8 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:15.872426 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef53b8d-517f-4628-88b0-f99dfe0dcac8 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:15.875653 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 409/838] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:36:15.879939 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3297f8c-5810-4908-89bf-e237148cf90e None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:15.880224 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3297f8c-5810-4908-89bf-e237148cf90e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:15.880500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3297f8c-5810-4908-89bf-e237148cf90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:15.900276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-b3297f8c-5810-4908-89bf-e237148cf90e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:15.902496 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b3297f8c-5810-4908-89bf-e237148cf90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:15.949204 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3b9c1-f74f-4d6b-82a2-570143338fe4 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:15.996471 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 410/839] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:16.002948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05628a8-96e7-4afc-bd91-97e0575da4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:16.003859 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05628a8-96e7-4afc-bd91-97e0575da4d2 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:16.004320 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05628a8-96e7-4afc-bd91-97e0575da4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:16.004797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05628a8-96e7-4afc-bd91-97e0575da4d2 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:16.005702 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05628a8-96e7-4afc-bd91-97e0575da4d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:16.006215 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05628a8-96e7-4afc-bd91-97e0575da4d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:16.007828 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05628a8-96e7-4afc-bd91-97e0575da4d2 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:16.018426 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3297f8c-5810-4908-89bf-e237148cf90e None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:16.025491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 430/840] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:16.034022 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05628a8-96e7-4afc-bd91-97e0575da4d2 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:16.140040 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05628a8-96e7-4afc-bd91-97e0575da4d2 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:16.144510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3297f8c-5810-4908-89bf-e237148cf90e None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:16.178684 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b38a8b-a7fc-4964-b83a-680bbb87166f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:16.180201 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b38a8b-a7fc-4964-b83a-680bbb87166f None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:16.180918 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b38a8b-a7fc-4964-b83a-680bbb87166f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:16.181461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b38a8b-a7fc-4964-b83a-680bbb87166f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:16.184905 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4605487-90ad-4391-ab6c-b98e88f75807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:16.187020 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4605487-90ad-4391-ab6c-b98e88f75807 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:16.187516 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4605487-90ad-4391-ab6c-b98e88f75807 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:16.187979 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4605487-90ad-4391-ab6c-b98e88f75807 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:16.190590 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b38a8b-a7fc-4964-b83a-680bbb87166f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:16.192380 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b38a8b-a7fc-4964-b83a-680bbb87166f None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:16.198918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4605487-90ad-4391-ab6c-b98e88f75807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:16.206800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-f4605487-90ad-4391-ab6c-b98e88f75807 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:36:16.207976 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-e7b38a8b-a7fc-4964-b83a-680bbb87166f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 14 21:36:16.209653 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 431/841] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Apr 14 21:36:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:16.209772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 411/842] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:36:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:16.214973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b38a8b-a7fc-4964-b83a-680bbb87166f None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:16.217038 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4605487-90ad-4391-ab6c-b98e88f75807 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:16.315367 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b38a8b-a7fc-4964-b83a-680bbb87166f None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:16.346736 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4605487-90ad-4391-ab6c-b98e88f75807 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:16.352343 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc35e4-9a65-45b1-9afe-d77d7b86b76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:16.353436 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc35e4-9a65-45b1-9afe-d77d7b86b76f None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:16.353931 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc35e4-9a65-45b1-9afe-d77d7b86b76f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:16.354390 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc35e4-9a65-45b1-9afe-d77d7b86b76f None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:16.355338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc35e4-9a65-45b1-9afe-d77d7b86b76f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:16.355834 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc35e4-9a65-45b1-9afe-d77d7b86b76f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:16.358012 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc35e4-9a65-45b1-9afe-d77d7b86b76f None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:16.371360 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 432/843] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:36:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:16.373258 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc35e4-9a65-45b1-9afe-d77d7b86b76f None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:16.386235 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a705a-8287-40e2-b70d-48549432cc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:16.387197 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a705a-8287-40e2-b70d-48549432cc05 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:16.387485 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a705a-8287-40e2-b70d-48549432cc05 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:16.387764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a705a-8287-40e2-b70d-48549432cc05 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:16.388951 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a705a-8287-40e2-b70d-48549432cc05 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:16.389408 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a705a-8287-40e2-b70d-48549432cc05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:16.391568 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a705a-8287-40e2-b70d-48549432cc05 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:16.416685 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 412/844] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Apr 14 21:36:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:16.421237 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a705a-8287-40e2-b70d-48549432cc05 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:16.484791 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc35e4-9a65-45b1-9afe-d77d7b86b76f None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:16.531091 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a2880-1987-41cd-8dcf-7125c7b01289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:16.532290 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a2880-1987-41cd-8dcf-7125c7b01289 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:16.533044 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a2880-1987-41cd-8dcf-7125c7b01289 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:16.533601 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a2880-1987-41cd-8dcf-7125c7b01289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:16.535851 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a705a-8287-40e2-b70d-48549432cc05 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:16.546421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a2880-1987-41cd-8dcf-7125c7b01289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:16.548474 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a2880-1987-41cd-8dcf-7125c7b01289 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:16.569595 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-fd6a2880-1987-41cd-8dcf-7125c7b01289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:16.571038 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e42fe5-15e7-4390-b1b5-2a01683538b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:16.571176 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 433/845] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:16.572075 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e42fe5-15e7-4390-b1b5-2a01683538b4 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:16.572380 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e42fe5-15e7-4390-b1b5-2a01683538b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:16.576841 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e42fe5-15e7-4390-b1b5-2a01683538b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:16.576963 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a2880-1987-41cd-8dcf-7125c7b01289 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:16.643974 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e42fe5-15e7-4390-b1b5-2a01683538b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:16.645713 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e42fe5-15e7-4390-b1b5-2a01683538b4 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:16.677137 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a2880-1987-41cd-8dcf-7125c7b01289 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:16.710055 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636f154-527e-4722-984c-b77427e3fa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:16.710963 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636f154-527e-4722-984c-b77427e3fa6e None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:16.711238 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636f154-527e-4722-984c-b77427e3fa6e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:16.711510 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636f154-527e-4722-984c-b77427e3fa6e None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:16.712226 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636f154-527e-4722-984c-b77427e3fa6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:16.712534 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636f154-527e-4722-984c-b77427e3fa6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:16.715307 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636f154-527e-4722-984c-b77427e3fa6e None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:16.733556 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 434/846] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:16.734463 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636f154-527e-4722-984c-b77427e3fa6e None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:16.756060 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 413/847] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:36:16 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 14 21:36:16.757353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e42fe5-15e7-4390-b1b5-2a01683538b4 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:16.833764 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636f154-527e-4722-984c-b77427e3fa6e None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:16.862769 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e42fe5-15e7-4390-b1b5-2a01683538b4 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:16.867736 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb4b85-e3f3-428e-8040-f49f863c4415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:16.868534 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb4b85-e3f3-428e-8040-f49f863c4415 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:16.868843 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb4b85-e3f3-428e-8040-f49f863c4415 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:16.869113 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb4b85-e3f3-428e-8040-f49f863c4415 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:16.877899 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb4b85-e3f3-428e-8040-f49f863c4415 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:16.879427 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb4b85-e3f3-428e-8040-f49f863c4415 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:16.894763 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-08fb4b85-e3f3-428e-8040-f49f863c4415 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 14 21:36:16.900904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 435/848] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:36:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:16.902734 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb4b85-e3f3-428e-8040-f49f863c4415 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:16.904434 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e510eee-b74f-474c-91d6-59c439c06ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:16.905637 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e510eee-b74f-474c-91d6-59c439c06ad3 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:16.906064 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e510eee-b74f-474c-91d6-59c439c06ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:16.906480 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e510eee-b74f-474c-91d6-59c439c06ad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:16.918292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e510eee-b74f-474c-91d6-59c439c06ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:16.920592 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e510eee-b74f-474c-91d6-59c439c06ad3 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:16.939419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-7e510eee-b74f-474c-91d6-59c439c06ad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:16.945723 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 414/849] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:16.946827 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e510eee-b74f-474c-91d6-59c439c06ad3 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:17.009566 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb4b85-e3f3-428e-8040-f49f863c4415 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:17.044489 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f08c73-20eb-4b21-b6af-20301510da3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:17.045189 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f08c73-20eb-4b21-b6af-20301510da3b None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:17.045467 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f08c73-20eb-4b21-b6af-20301510da3b None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:17.045741 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f08c73-20eb-4b21-b6af-20301510da3b None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:17.046572 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f08c73-20eb-4b21-b6af-20301510da3b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:17.046878 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f08c73-20eb-4b21-b6af-20301510da3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:17.048311 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f08c73-20eb-4b21-b6af-20301510da3b None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:17.064034 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e510eee-b74f-474c-91d6-59c439c06ad3 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:17.070520 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 436/850] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Apr 14 21:36:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:17.071402 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f08c73-20eb-4b21-b6af-20301510da3b None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:17.101605 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24164ef2-2468-4d3b-8937-4763cd243ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:17.102554 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164ef2-2468-4d3b-8937-4763cd243ece None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:17.102979 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164ef2-2468-4d3b-8937-4763cd243ece None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:17.103394 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164ef2-2468-4d3b-8937-4763cd243ece None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:17.104284 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24164ef2-2468-4d3b-8937-4763cd243ece None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:17.104792 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24164ef2-2468-4d3b-8937-4763cd243ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:17.106333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24164ef2-2468-4d3b-8937-4763cd243ece None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:17.118499 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 415/851] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:17.124158 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24164ef2-2468-4d3b-8937-4763cd243ece None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:17.189011 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f08c73-20eb-4b21-b6af-20301510da3b None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:17.232392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e6b8e-9f29-4fa1-a2d9-e89ab4e40c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:17.233083 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e6b8e-9f29-4fa1-a2d9-e89ab4e40c50 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:17.233695 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e6b8e-9f29-4fa1-a2d9-e89ab4e40c50 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:17.233992 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e6b8e-9f29-4fa1-a2d9-e89ab4e40c50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:17.242670 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24164ef2-2468-4d3b-8937-4763cd243ece None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:17.277752 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abc171-b742-47cb-898b-3e73b801b3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:17.278725 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abc171-b742-47cb-898b-3e73b801b3ba None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:17.279707 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abc171-b742-47cb-898b-3e73b801b3ba None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:17.280055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abc171-b742-47cb-898b-3e73b801b3ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:17.287110 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abc171-b742-47cb-898b-3e73b801b3ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:17.288598 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abc171-b742-47cb-898b-3e73b801b3ba None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:17.302831 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-26abc171-b742-47cb-898b-3e73b801b3ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:36:17.308807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 416/852] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:17.308807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c034ce-fb55-4863-a4d4-a0eb0c49aa8a None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:17.308807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c034ce-fb55-4863-a4d4-a0eb0c49aa8a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:17.308807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c034ce-fb55-4863-a4d4-a0eb0c49aa8a None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:17.308807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 417/853] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:17.312250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c034ce-fb55-4863-a4d4-a0eb0c49aa8a None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:17.316271 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e6b8e-9f29-4fa1-a2d9-e89ab4e40c50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:17.317820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e6b8e-9f29-4fa1-a2d9-e89ab4e40c50 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:17.417957 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 437/854] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:36:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 14 21:36:17.419256 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813d276-8633-40c8-96df-bd2ce3dbd334 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:17.419684 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813d276-8633-40c8-96df-bd2ce3dbd334 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:17.420044 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813d276-8633-40c8-96df-bd2ce3dbd334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:17.421450 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c034ce-fb55-4863-a4d4-a0eb0c49aa8a None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:17.437809 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-4813d276-8633-40c8-96df-bd2ce3dbd334 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:17.439466 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-4813d276-8633-40c8-96df-bd2ce3dbd334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:17.464918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b16328-da2d-4172-8ad6-e06cb1a89b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:17.465697 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b16328-da2d-4172-8ad6-e06cb1a89b93 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:17.465999 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b16328-da2d-4172-8ad6-e06cb1a89b93 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:17.466806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b16328-da2d-4172-8ad6-e06cb1a89b93 None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:17.467642 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b16328-da2d-4172-8ad6-e06cb1a89b93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:17.467987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b16328-da2d-4172-8ad6-e06cb1a89b93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:17.469598 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b16328-da2d-4172-8ad6-e06cb1a89b93 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:17.481442 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 418/855] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:17.482327 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b16328-da2d-4172-8ad6-e06cb1a89b93 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:17.521214 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 438/856] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:17.522166 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813d276-8633-40c8-96df-bd2ce3dbd334 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:17.586285 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b16328-da2d-4172-8ad6-e06cb1a89b93 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:17.625273 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f9fd1-9cb1-4e4a-8265-2f46201e806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:17.626149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f9fd1-9cb1-4e4a-8265-2f46201e806f None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:17.626423 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f9fd1-9cb1-4e4a-8265-2f46201e806f None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:17.626713 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f9fd1-9cb1-4e4a-8265-2f46201e806f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:17.636649 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813d276-8633-40c8-96df-bd2ce3dbd334 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:17.640146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f9fd1-9cb1-4e4a-8265-2f46201e806f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:17.641880 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f9fd1-9cb1-4e4a-8265-2f46201e806f None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:17.663328 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-7d6f9fd1-9cb1-4e4a-8265-2f46201e806f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:17.669170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 419/857] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:17.669170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f9fd1-9cb1-4e4a-8265-2f46201e806f None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:17.675819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e49867-ba69-46db-a974-4dbd4240d14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:17.676486 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e49867-ba69-46db-a974-4dbd4240d14c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:17.676797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e49867-ba69-46db-a974-4dbd4240d14c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:17.677068 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e49867-ba69-46db-a974-4dbd4240d14c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:17.677894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e49867-ba69-46db-a974-4dbd4240d14c None admin] RBAC: Adding query filter params (role.id=44e1b9c3f51e473a8af9b883e80a74d2, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=1144e9036d0b4bafb30995ff1a8449ec) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:17.678199 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e49867-ba69-46db-a974-4dbd4240d14c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:17.679625 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e49867-ba69-46db-a974-4dbd4240d14c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:17.697029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 439/858] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:36:17 2022] GET /identity/v3/role_assignments?user.id=1144e9036d0b4bafb30995ff1a8449ec&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=44e1b9c3f51e473a8af9b883e80a74d2 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:17.697029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e49867-ba69-46db-a974-4dbd4240d14c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:17.800333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f9fd1-9cb1-4e4a-8265-2f46201e806f None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:17.806970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e49867-ba69-46db-a974-4dbd4240d14c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:17.835081 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b43c7a-8cf2-42c8-9979-ace65a75b184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:17.836152 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b43c7a-8cf2-42c8-9979-ace65a75b184 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:17.836433 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b43c7a-8cf2-42c8-9979-ace65a75b184 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:17.836743 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b43c7a-8cf2-42c8-9979-ace65a75b184 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:17.837411 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b43c7a-8cf2-42c8-9979-ace65a75b184 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:17.838808 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b43c7a-8cf2-42c8-9979-ace65a75b184 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:17.845416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed5fc1-eb2b-46de-98dc-91625c601203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:17.846203 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed5fc1-eb2b-46de-98dc-91625c601203 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:17.846558 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed5fc1-eb2b-46de-98dc-91625c601203 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:17.846908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed5fc1-eb2b-46de-98dc-91625c601203 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:17.847716 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed5fc1-eb2b-46de-98dc-91625c601203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:17.848094 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed5fc1-eb2b-46de-98dc-91625c601203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:17.849639 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed5fc1-eb2b-46de-98dc-91625c601203 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:17.851053 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-36b43c7a-8cf2-42c8-9979-ace65a75b184 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 14 21:36:17.852675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 420/859] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:36:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:17.853625 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5d674-ce83-40f8-b22c-debc5cb06e59 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:17.853904 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5d674-ce83-40f8-b22c-debc5cb06e59 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:17.854177 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5d674-ce83-40f8-b22c-debc5cb06e59 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:17.855593 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 421/860] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:17.861417 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b11be5-aa87-4905-9156-cc1a295c0def None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:17.861750 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b11be5-aa87-4905-9156-cc1a295c0def None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:17.862023 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b11be5-aa87-4905-9156-cc1a295c0def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:17.874219 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 440/861] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:17.874219 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed5fc1-eb2b-46de-98dc-91625c601203 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:17.879376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-41b11be5-aa87-4905-9156-cc1a295c0def None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:17.880566 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-41b11be5-aa87-4905-9156-cc1a295c0def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:17.961794 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 422/862] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:17.962760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b11be5-aa87-4905-9156-cc1a295c0def None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:17.996529 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed5fc1-eb2b-46de-98dc-91625c601203 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:18.031144 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4189cc-b05e-468d-ad19-357f17be6c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:18.031901 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4189cc-b05e-468d-ad19-357f17be6c06 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:18.032186 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4189cc-b05e-468d-ad19-357f17be6c06 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:18.032476 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4189cc-b05e-468d-ad19-357f17be6c06 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:18.033230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4189cc-b05e-468d-ad19-357f17be6c06 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:18.033538 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4189cc-b05e-468d-ad19-357f17be6c06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:18.034904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4189cc-b05e-468d-ad19-357f17be6c06 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:18.039513 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 441/863] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:36:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:18.040303 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4189cc-b05e-468d-ad19-357f17be6c06 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:18.072626 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b11be5-aa87-4905-9156-cc1a295c0def None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:18.106751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163efb2-56ed-4f60-b9fe-637275a04329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:18.107636 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163efb2-56ed-4f60-b9fe-637275a04329 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:18.107915 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163efb2-56ed-4f60-b9fe-637275a04329 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:18.108189 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163efb2-56ed-4f60-b9fe-637275a04329 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:18.114919 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163efb2-56ed-4f60-b9fe-637275a04329 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:18.116347 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163efb2-56ed-4f60-b9fe-637275a04329 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:18.129885 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-2163efb2-56ed-4f60-b9fe-637275a04329 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:36:18.135676 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 423/864] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:18.135676 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163efb2-56ed-4f60-b9fe-637275a04329 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:18.142917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4189cc-b05e-468d-ad19-357f17be6c06 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:18.176479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26608174-def7-4529-baa6-9f04f8c9cb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:18.177318 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26608174-def7-4529-baa6-9f04f8c9cb34 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:18.177599 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26608174-def7-4529-baa6-9f04f8c9cb34 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:18.177873 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26608174-def7-4529-baa6-9f04f8c9cb34 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:18.178530 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26608174-def7-4529-baa6-9f04f8c9cb34 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:18.179919 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26608174-def7-4529-baa6-9f04f8c9cb34 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:18.193164 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-26608174-def7-4529-baa6-9f04f8c9cb34 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 14 21:36:18.194363 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 442/865] 10.222.0.52 () {56 vars in 1132 bytes} [Thu Apr 14 21:36:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:18.195209 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26608174-def7-4529-baa6-9f04f8c9cb34 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:18.237353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163efb2-56ed-4f60-b9fe-637275a04329 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:18.272292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a38bb9-2fd2-44ba-ac1b-f256344c4627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:18.274845 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a38bb9-2fd2-44ba-ac1b-f256344c4627 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:18.275129 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a38bb9-2fd2-44ba-ac1b-f256344c4627 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:18.275403 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a38bb9-2fd2-44ba-ac1b-f256344c4627 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:18.276115 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a38bb9-2fd2-44ba-ac1b-f256344c4627 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:18.276422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a38bb9-2fd2-44ba-ac1b-f256344c4627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:18.277817 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a38bb9-2fd2-44ba-ac1b-f256344c4627 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:18.282873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 424/866] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:36:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:18.283660 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a38bb9-2fd2-44ba-ac1b-f256344c4627 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:18.311039 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26608174-def7-4529-baa6-9f04f8c9cb34 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:18.349730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52aa221-0fdd-496b-a798-d03873a59a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:18.350690 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52aa221-0fdd-496b-a798-d03873a59a11 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:18.351118 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52aa221-0fdd-496b-a798-d03873a59a11 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:18.351552 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52aa221-0fdd-496b-a798-d03873a59a11 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:18.352522 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52aa221-0fdd-496b-a798-d03873a59a11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:18.353037 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52aa221-0fdd-496b-a798-d03873a59a11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:18.354708 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52aa221-0fdd-496b-a798-d03873a59a11 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:18.368317 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 443/867] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:36:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:18.374207 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52aa221-0fdd-496b-a798-d03873a59a11 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:18.402581 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a38bb9-2fd2-44ba-ac1b-f256344c4627 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:18.441805 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d95c02-50cc-4cc6-a5e0-735ed6930c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:18.442742 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d95c02-50cc-4cc6-a5e0-735ed6930c5b None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:18.443026 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d95c02-50cc-4cc6-a5e0-735ed6930c5b None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:18.443302 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d95c02-50cc-4cc6-a5e0-735ed6930c5b None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:18.444038 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d95c02-50cc-4cc6-a5e0-735ed6930c5b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:18.444346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d95c02-50cc-4cc6-a5e0-735ed6930c5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:18.446107 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d95c02-50cc-4cc6-a5e0-735ed6930c5b None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:18.453867 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 425/868] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Apr 14 21:36:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:18.459580 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d95c02-50cc-4cc6-a5e0-735ed6930c5b None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:18.486740 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52aa221-0fdd-496b-a798-d03873a59a11 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:18.536346 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf213eb-7609-4499-af02-54916f9ab21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:18.538068 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf213eb-7609-4499-af02-54916f9ab21a None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:18.538538 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf213eb-7609-4499-af02-54916f9ab21a None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:18.539070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf213eb-7609-4499-af02-54916f9ab21a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:18.540086 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf213eb-7609-4499-af02-54916f9ab21a None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=360bf55488d046c4be98a903d113c0fc) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:18.540550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf213eb-7609-4499-af02-54916f9ab21a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:18.542227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf213eb-7609-4499-af02-54916f9ab21a None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:18.560682 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 444/869] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:36:18 2022] GET /identity/v3/role_assignments?user.id=360bf55488d046c4be98a903d113c0fc&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:18.578474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d95c02-50cc-4cc6-a5e0-735ed6930c5b None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:18.616193 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee68185-278e-4e5c-a1d5-990e59aa689d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:18.617227 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee68185-278e-4e5c-a1d5-990e59aa689d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:18.617648 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee68185-278e-4e5c-a1d5-990e59aa689d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:18.618079 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee68185-278e-4e5c-a1d5-990e59aa689d None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:18.618967 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee68185-278e-4e5c-a1d5-990e59aa689d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:18.619437 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee68185-278e-4e5c-a1d5-990e59aa689d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:18.621030 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee68185-278e-4e5c-a1d5-990e59aa689d None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:18.627314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 426/870] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Apr 14 21:36:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:20.110245 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7004a-16c7-4679-9efa-a9e34bcf8fe3 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:20.110789 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7004a-16c7-4679-9efa-a9e34bcf8fe3 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:20.110789 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7004a-16c7-4679-9efa-a9e34bcf8fe3 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:20.112416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 445/871] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:20.117635 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbccfe9-278d-4dc0-831e-9a66dd7197b5 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:20.118040 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbccfe9-278d-4dc0-831e-9a66dd7197b5 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:20.118357 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbccfe9-278d-4dc0-831e-9a66dd7197b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:20.137843 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-afbccfe9-278d-4dc0-831e-9a66dd7197b5 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:20.139895 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-afbccfe9-278d-4dc0-831e-9a66dd7197b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:20.212734 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 427/872] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:20.234416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7004a-16c7-4679-9efa-a9e34bcf8fe3 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:20.343895 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7004a-16c7-4679-9efa-a9e34bcf8fe3 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:20.379607 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e2583-2ac5-49a8-a491-3dc43c96cde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:20.380426 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e2583-2ac5-49a8-a491-3dc43c96cde1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:20.380731 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e2583-2ac5-49a8-a491-3dc43c96cde1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:20.381002 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e2583-2ac5-49a8-a491-3dc43c96cde1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:20.392375 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e2583-2ac5-49a8-a491-3dc43c96cde1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:20.399906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-cb9e2583-2ac5-49a8-a491-3dc43c96cde1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 14 21:36:20.401469 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 446/873] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Apr 14 21:36:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:20.407528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbccfe9-278d-4dc0-831e-9a66dd7197b5 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:20.516080 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbccfe9-278d-4dc0-831e-9a66dd7197b5 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:20.555070 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc484f-ac67-4396-bd9e-f0b2dbdf05c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:20.555739 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc484f-ac67-4396-bd9e-f0b2dbdf05c6 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:20.556014 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc484f-ac67-4396-bd9e-f0b2dbdf05c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:20.556281 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc484f-ac67-4396-bd9e-f0b2dbdf05c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:20.557063 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc484f-ac67-4396-bd9e-f0b2dbdf05c6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:20.557363 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc484f-ac67-4396-bd9e-f0b2dbdf05c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:20.558730 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc484f-ac67-4396-bd9e-f0b2dbdf05c6 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:20.571384 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 428/874] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Apr 14 21:36:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:20.573969 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e2583-2ac5-49a8-a491-3dc43c96cde1 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:20.687494 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e2583-2ac5-49a8-a491-3dc43c96cde1 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:20.711647 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1c734-abd7-40a2-89d5-0ffbbd23f828 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:20.711947 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1c734-abd7-40a2-89d5-0ffbbd23f828 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:20.712369 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1c734-abd7-40a2-89d5-0ffbbd23f828 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:20.713835 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 429/875] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:20.722068 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34f66d-6fe5-4371-a81a-b965c213de0b None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:20.722510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34f66d-6fe5-4371-a81a-b965c213de0b None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:20.722874 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34f66d-6fe5-4371-a81a-b965c213de0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:20.726114 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e822a3-a70b-46ba-9e3e-29ac1ceba2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:20.727060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e822a3-a70b-46ba-9e3e-29ac1ceba2b0 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:20.727493 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e822a3-a70b-46ba-9e3e-29ac1ceba2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:20.727967 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e822a3-a70b-46ba-9e3e-29ac1ceba2b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:20.739582 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e822a3-a70b-46ba-9e3e-29ac1ceba2b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:20.741217 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-4e34f66d-6fe5-4371-a81a-b965c213de0b None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:20.741469 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e822a3-a70b-46ba-9e3e-29ac1ceba2b0 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:20.742611 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-4e34f66d-6fe5-4371-a81a-b965c213de0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:20.759235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-37e822a3-a70b-46ba-9e3e-29ac1ceba2b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:20.760977 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 447/876] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:20.767105 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e822a3-a70b-46ba-9e3e-29ac1ceba2b0 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:20.826164 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 430/877] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:20.851809 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34f66d-6fe5-4371-a81a-b965c213de0b None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:20.881445 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e822a3-a70b-46ba-9e3e-29ac1ceba2b0 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:20.915339 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b6ecf-ec69-425e-bc66-3ef1e2d20434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:20.916236 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b6ecf-ec69-425e-bc66-3ef1e2d20434 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:20.916682 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b6ecf-ec69-425e-bc66-3ef1e2d20434 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:20.920094 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b6ecf-ec69-425e-bc66-3ef1e2d20434 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:20.920094 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b6ecf-ec69-425e-bc66-3ef1e2d20434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:20.920094 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b6ecf-ec69-425e-bc66-3ef1e2d20434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:20.920435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b6ecf-ec69-425e-bc66-3ef1e2d20434 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:20.933622 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 448/878] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:20.941379 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b6ecf-ec69-425e-bc66-3ef1e2d20434 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:20.958986 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34f66d-6fe5-4371-a81a-b965c213de0b None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:21.004162 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9d1ba-ac07-4347-8aba-8f66912ab7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:21.004852 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9d1ba-ac07-4347-8aba-8f66912ab7f5 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:21.005135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9d1ba-ac07-4347-8aba-8f66912ab7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:21.005407 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9d1ba-ac07-4347-8aba-8f66912ab7f5 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:21.006179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9d1ba-ac07-4347-8aba-8f66912ab7f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:21.007612 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9d1ba-ac07-4347-8aba-8f66912ab7f5 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:21.042536 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b6ecf-ec69-425e-bc66-3ef1e2d20434 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:21.078378 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12f2b2-99b5-40e8-a0ad-59a7fa2ff919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:21.080599 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12f2b2-99b5-40e8-a0ad-59a7fa2ff919 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:21.080599 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12f2b2-99b5-40e8-a0ad-59a7fa2ff919 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:21.080599 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12f2b2-99b5-40e8-a0ad-59a7fa2ff919 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:21.086962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12f2b2-99b5-40e8-a0ad-59a7fa2ff919 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:21.088410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12f2b2-99b5-40e8-a0ad-59a7fa2ff919 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:21.103098 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-ba12f2b2-99b5-40e8-a0ad-59a7fa2ff919 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 14 21:36:21.109446 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 449/879] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Apr 14 21:36:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:21.109446 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d379f-4d8e-48c6-b1d5-52f482817fdc None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:21.109446 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d379f-4d8e-48c6-b1d5-52f482817fdc None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:21.109446 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d379f-4d8e-48c6-b1d5-52f482817fdc None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:21.109446 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 450/880] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:21.109446 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ab3a6-6e2c-49a7-a0b5-a93e55480d64 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:21.109446 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ab3a6-6e2c-49a7-a0b5-a93e55480d64 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:21.109891 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ab3a6-6e2c-49a7-a0b5-a93e55480d64 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:21.110654 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 451/881] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:21.111341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ab3a6-6e2c-49a7-a0b5-a93e55480d64 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:21.132879 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 431/882] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Apr 14 21:36:20 2022] POST /identity/v3/services => generated 251 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:36:21.134687 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776a94d-b522-415e-971c-bdc67ab37cfa None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:21.134976 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776a94d-b522-415e-971c-bdc67ab37cfa None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:21.135256 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776a94d-b522-415e-971c-bdc67ab37cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:21.153247 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-6776a94d-b522-415e-971c-bdc67ab37cfa None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:21.155281 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-6776a94d-b522-415e-971c-bdc67ab37cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:21.228642 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ab3a6-6e2c-49a7-a0b5-a93e55480d64 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:21.231797 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 432/883] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:21 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:21.233757 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8f573-be9a-44ee-bc5c-3da678edd2d0 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:21.234041 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8f573-be9a-44ee-bc5c-3da678edd2d0 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:21.234310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8f573-be9a-44ee-bc5c-3da678edd2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:21.255249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-62b8f573-be9a-44ee-bc5c-3da678edd2d0 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:21.256455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-62b8f573-be9a-44ee-bc5c-3da678edd2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:21.277901 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e41d63-e528-4957-b022-58fb1a2032d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:21.278859 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e41d63-e528-4957-b022-58fb1a2032d2 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:21.279735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e41d63-e528-4957-b022-58fb1a2032d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:21.280010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e41d63-e528-4957-b022-58fb1a2032d2 None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:21.280907 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e41d63-e528-4957-b022-58fb1a2032d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:21.281242 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e41d63-e528-4957-b022-58fb1a2032d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:21.282715 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e41d63-e528-4957-b022-58fb1a2032d2 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:21.307156 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 452/884] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Apr 14 21:36:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:21.307156 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e41d63-e528-4957-b022-58fb1a2032d2 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:21.339304 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 433/885] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:21 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:21.340475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8f573-be9a-44ee-bc5c-3da678edd2d0 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:21.415712 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e41d63-e528-4957-b022-58fb1a2032d2 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:21.441266 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8f573-be9a-44ee-bc5c-3da678edd2d0 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:21.449709 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbd66e-30e6-4733-bd41-686c2cec4603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:21.450812 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbd66e-30e6-4733-bd41-686c2cec4603 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:21.451095 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbd66e-30e6-4733-bd41-686c2cec4603 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:21.451473 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbd66e-30e6-4733-bd41-686c2cec4603 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:21.452141 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbd66e-30e6-4733-bd41-686c2cec4603 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:21.453539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbd66e-30e6-4733-bd41-686c2cec4603 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:21.464920 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-2abbd66e-30e6-4733-bd41-686c2cec4603 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 14 21:36:21.466173 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 453/886] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Apr 14 21:36:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:21.467074 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbd66e-30e6-4733-bd41-686c2cec4603 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:21.485090 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d0ab0-070c-4e8f-b290-08e2406c04a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:21.486463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d0ab0-070c-4e8f-b290-08e2406c04a0 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:21.486953 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d0ab0-070c-4e8f-b290-08e2406c04a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:21.487420 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d0ab0-070c-4e8f-b290-08e2406c04a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:21.554232 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d0ab0-070c-4e8f-b290-08e2406c04a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:21.555684 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d0ab0-070c-4e8f-b290-08e2406c04a0 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:21.566451 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbd66e-30e6-4733-bd41-686c2cec4603 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:21.599019 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf46860-8c7c-4554-a198-1557a60b961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:21.599680 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf46860-8c7c-4554-a198-1557a60b961f None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:21.599959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf46860-8c7c-4554-a198-1557a60b961f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:21.600233 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf46860-8c7c-4554-a198-1557a60b961f None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:21.600979 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf46860-8c7c-4554-a198-1557a60b961f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:21.602341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf46860-8c7c-4554-a198-1557a60b961f None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:21.651063 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 434/887] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:36:21 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 14 21:36:21.652244 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d0ab0-070c-4e8f-b290-08e2406c04a0 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:21.670557 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 454/888] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Apr 14 21:36:21 2022] POST /identity/v3/services => generated 269 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:36:21.671541 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf46860-8c7c-4554-a198-1557a60b961f None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:21.784038 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d0ab0-070c-4e8f-b290-08e2406c04a0 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:21.795207 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf46860-8c7c-4554-a198-1557a60b961f None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:21.833832 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b121c90-826f-488f-ab9d-e16fc6e0d9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:21.834549 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b121c90-826f-488f-ab9d-e16fc6e0d9d1 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:21.834844 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b121c90-826f-488f-ab9d-e16fc6e0d9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:21.835376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b121c90-826f-488f-ab9d-e16fc6e0d9d1 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:21.836101 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b121c90-826f-488f-ab9d-e16fc6e0d9d1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:21.836405 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b121c90-826f-488f-ab9d-e16fc6e0d9d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:21.837235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26868d85-a551-4d95-accc-cee2b8da9fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:21.837905 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b121c90-826f-488f-ab9d-e16fc6e0d9d1 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:21.838454 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26868d85-a551-4d95-accc-cee2b8da9fe0 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:21.838916 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26868d85-a551-4d95-accc-cee2b8da9fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:21.839381 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26868d85-a551-4d95-accc-cee2b8da9fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:21.848771 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 435/889] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Apr 14 21:36:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:21.852336 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b121c90-826f-488f-ab9d-e16fc6e0d9d1 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:21.854746 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26868d85-a551-4d95-accc-cee2b8da9fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:21.856232 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26868d85-a551-4d95-accc-cee2b8da9fe0 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:21.876803 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-26868d85-a551-4d95-accc-cee2b8da9fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:21.884038 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 455/890] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:21.884300 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26868d85-a551-4d95-accc-cee2b8da9fe0 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:21.984452 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b121c90-826f-488f-ab9d-e16fc6e0d9d1 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:22.015262 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26868d85-a551-4d95-accc-cee2b8da9fe0 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:22.026711 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bf37a-aebb-454d-a498-64adc7ecc90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:22.027385 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bf37a-aebb-454d-a498-64adc7ecc90e None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:22.027668 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bf37a-aebb-454d-a498-64adc7ecc90e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:22.028093 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bf37a-aebb-454d-a498-64adc7ecc90e None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:22.029757 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bf37a-aebb-454d-a498-64adc7ecc90e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:22.030104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bf37a-aebb-454d-a498-64adc7ecc90e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:22.031781 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bf37a-aebb-454d-a498-64adc7ecc90e None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:22.038276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 436/891] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Apr 14 21:36:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:22.055358 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a538e-3221-44a1-80a3-213889b33671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:22.056045 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a538e-3221-44a1-80a3-213889b33671 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:22.056323 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a538e-3221-44a1-80a3-213889b33671 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:22.056614 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a538e-3221-44a1-80a3-213889b33671 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:22.057362 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a538e-3221-44a1-80a3-213889b33671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:22.057665 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a538e-3221-44a1-80a3-213889b33671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:22.059081 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a538e-3221-44a1-80a3-213889b33671 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:22.073298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 456/892] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:22.079462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bf37a-aebb-454d-a498-64adc7ecc90e None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:22.195865 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bf37a-aebb-454d-a498-64adc7ecc90e None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:22.233318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3f64a-eb9e-4439-a12c-b873f0c2f474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:22.234121 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3f64a-eb9e-4439-a12c-b873f0c2f474 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:22.234399 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3f64a-eb9e-4439-a12c-b873f0c2f474 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:22.234671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3f64a-eb9e-4439-a12c-b873f0c2f474 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:22.242128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3f64a-eb9e-4439-a12c-b873f0c2f474 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:22.243878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3f64a-eb9e-4439-a12c-b873f0c2f474 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:22.258726 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-93b3f64a-eb9e-4439-a12c-b873f0c2f474 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:36:22.260247 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 437/893] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:22.265994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a538e-3221-44a1-80a3-213889b33671 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:22.378298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a538e-3221-44a1-80a3-213889b33671 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:22.412320 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a6cd4-f72d-4ef5-84da-e94ff0b8b448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:22.413339 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a6cd4-f72d-4ef5-84da-e94ff0b8b448 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:22.413790 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a6cd4-f72d-4ef5-84da-e94ff0b8b448 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:22.414252 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a6cd4-f72d-4ef5-84da-e94ff0b8b448 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:22.415210 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a6cd4-f72d-4ef5-84da-e94ff0b8b448 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:22.415686 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a6cd4-f72d-4ef5-84da-e94ff0b8b448 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:22.417435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a6cd4-f72d-4ef5-84da-e94ff0b8b448 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:22.430625 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 457/894] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:36:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:22.437145 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3f64a-eb9e-4439-a12c-b873f0c2f474 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:22.537533 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3f64a-eb9e-4439-a12c-b873f0c2f474 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:22.571868 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80528645-6660-45e0-9730-600cf6c43c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:22.572519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80528645-6660-45e0-9730-600cf6c43c8c None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:22.572835 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80528645-6660-45e0-9730-600cf6c43c8c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:22.573114 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80528645-6660-45e0-9730-600cf6c43c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:22.573946 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80528645-6660-45e0-9730-600cf6c43c8c None admin] RBAC: Adding query filter params (role.id=928ab085e3e84586b2862ae16aca8595, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=1144e9036d0b4bafb30995ff1a8449ec) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:22.574258 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80528645-6660-45e0-9730-600cf6c43c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:22.575732 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80528645-6660-45e0-9730-600cf6c43c8c None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:22.581794 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 438/895] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:36:22 2022] GET /identity/v3/role_assignments?user.id=1144e9036d0b4bafb30995ff1a8449ec&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=928ab085e3e84586b2862ae16aca8595 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:23.531079 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cf8fd-90a9-453d-92a9-78400ffaacd0 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:23.531683 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cf8fd-90a9-453d-92a9-78400ffaacd0 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:23.531683 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cf8fd-90a9-453d-92a9-78400ffaacd0 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:23.533221 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 458/896] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:23.538818 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214f8d7-b60a-4cd4-8176-116762b11583 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:23.539633 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214f8d7-b60a-4cd4-8176-116762b11583 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:23.540108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214f8d7-b60a-4cd4-8176-116762b11583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:23.557763 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-0214f8d7-b60a-4cd4-8176-116762b11583 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:23.559289 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-0214f8d7-b60a-4cd4-8176-116762b11583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:23.636729 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 439/897] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:23.655477 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cf8fd-90a9-453d-92a9-78400ffaacd0 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:23.767770 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cf8fd-90a9-453d-92a9-78400ffaacd0 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:23.802824 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1ec50-58f6-40b7-a1f0-d7f0fbc1ce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:23.803947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1ec50-58f6-40b7-a1f0-d7f0fbc1ce94 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:23.804426 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1ec50-58f6-40b7-a1f0-d7f0fbc1ce94 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:23.804986 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1ec50-58f6-40b7-a1f0-d7f0fbc1ce94 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:23.805837 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1ec50-58f6-40b7-a1f0-d7f0fbc1ce94 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:23.807441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1ec50-58f6-40b7-a1f0-d7f0fbc1ce94 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:23.819514 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-30a1ec50-58f6-40b7-a1f0-d7f0fbc1ce94 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 14 21:36:23.824682 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 459/898] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:36:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:23.828250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214f8d7-b60a-4cd4-8176-116762b11583 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:23.932926 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214f8d7-b60a-4cd4-8176-116762b11583 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:23.968773 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c8658-7290-4883-9caf-9c09760183f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:23.975172 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c8658-7290-4883-9caf-9c09760183f8 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:23.975686 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c8658-7290-4883-9caf-9c09760183f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:23.976160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c8658-7290-4883-9caf-9c09760183f8 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:23.977128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c8658-7290-4883-9caf-9c09760183f8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:23.977654 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c8658-7290-4883-9caf-9c09760183f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:23.979221 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c8658-7290-4883-9caf-9c09760183f8 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:23.994907 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 440/899] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:36:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:23.996496 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1ec50-58f6-40b7-a1f0-d7f0fbc1ce94 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:24.104626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1ec50-58f6-40b7-a1f0-d7f0fbc1ce94 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:24.116955 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85096dae-12fd-4d16-a550-a26261828fc5 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:24.117240 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85096dae-12fd-4d16-a550-a26261828fc5 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:24.117505 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85096dae-12fd-4d16-a550-a26261828fc5 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:24.119168 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 441/900] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:36:24.125079 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ee6a0-3a06-4e0a-8fe1-98256406c80a None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:24.125366 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ee6a0-3a06-4e0a-8fe1-98256406c80a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:24.125648 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ee6a0-3a06-4e0a-8fe1-98256406c80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:24.143055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-5a7ee6a0-3a06-4e0a-8fe1-98256406c80a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:24.144282 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5a7ee6a0-3a06-4e0a-8fe1-98256406c80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:24.146597 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3d4a1-0aba-45c8-b4db-d7684608ff2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:24.147519 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3d4a1-0aba-45c8-b4db-d7684608ff2a None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:24.148003 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3d4a1-0aba-45c8-b4db-d7684608ff2a None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:24.148493 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3d4a1-0aba-45c8-b4db-d7684608ff2a None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:24.149435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3d4a1-0aba-45c8-b4db-d7684608ff2a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:24.149951 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3d4a1-0aba-45c8-b4db-d7684608ff2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:24.151566 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3d4a1-0aba-45c8-b4db-d7684608ff2a None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:24.161865 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 460/901] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:36:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:24.163603 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3d4a1-0aba-45c8-b4db-d7684608ff2a None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:24.220693 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 442/902] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:24.240143 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ee6a0-3a06-4e0a-8fe1-98256406c80a None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:24.267775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3d4a1-0aba-45c8-b4db-d7684608ff2a None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:24.303094 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d0784-a822-446b-8918-fd0281a0bcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:24.304127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d0784-a822-446b-8918-fd0281a0bcdb None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:24.304646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d0784-a822-446b-8918-fd0281a0bcdb None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:24.305118 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d0784-a822-446b-8918-fd0281a0bcdb None admin] PATH_INFO: `/v3/endpoints` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:24.306122 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d0784-a822-446b-8918-fd0281a0bcdb None admin] RBAC: Adding query filter params (interface=public, service_id=40dacd2ee9b74514825ab6891e26c63a, region_id=RegionOne) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:24.306637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d0784-a822-446b-8918-fd0281a0bcdb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:24.308201 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d0784-a822-446b-8918-fd0281a0bcdb None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:24.318392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 461/903] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Apr 14 21:36:24 2022] GET /identity/v3/endpoints?service_id=40dacd2ee9b74514825ab6891e26c63a&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:24.319890 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d0784-a822-446b-8918-fd0281a0bcdb None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:24.345400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ee6a0-3a06-4e0a-8fe1-98256406c80a None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:24.380134 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee093c7b-7e3c-45d2-94f7-b8c7a869950e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:24.380954 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee093c7b-7e3c-45d2-94f7-b8c7a869950e None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:24.381262 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee093c7b-7e3c-45d2-94f7-b8c7a869950e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:24.381502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee093c7b-7e3c-45d2-94f7-b8c7a869950e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:24.382163 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee093c7b-7e3c-45d2-94f7-b8c7a869950e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:24.383592 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee093c7b-7e3c-45d2-94f7-b8c7a869950e None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:24.396273 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-ee093c7b-7e3c-45d2-94f7-b8c7a869950e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 14 21:36:24.398787 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 443/904] 10.222.0.52 () {56 vars in 1132 bytes} [Thu Apr 14 21:36:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:24.400323 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828915c6-18d0-4079-b23f-f3c055cbb62f None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:24.400935 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828915c6-18d0-4079-b23f-f3c055cbb62f None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:24.401400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828915c6-18d0-4079-b23f-f3c055cbb62f None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:24.402951 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 444/905] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:24.404634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828915c6-18d0-4079-b23f-f3c055cbb62f None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:24.425064 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d0784-a822-446b-8918-fd0281a0bcdb None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:24.459640 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcbfd4-44a1-4d4c-8843-03383b122cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:24.460559 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcbfd4-44a1-4d4c-8843-03383b122cfc None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:24.460897 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcbfd4-44a1-4d4c-8843-03383b122cfc None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:24.461137 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcbfd4-44a1-4d4c-8843-03383b122cfc None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:24.461830 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcbfd4-44a1-4d4c-8843-03383b122cfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:24.463203 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcbfd4-44a1-4d4c-8843-03383b122cfc None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:24.475894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 462/906] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Apr 14 21:36:24 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:36:24.475894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8a7d1-57c3-4b8d-90ce-3b81e5e0cad4 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:24.475894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8a7d1-57c3-4b8d-90ce-3b81e5e0cad4 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:24.475894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8a7d1-57c3-4b8d-90ce-3b81e5e0cad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:24.489891 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-bea8a7d1-57c3-4b8d-90ce-3b81e5e0cad4 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:24.491131 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-bea8a7d1-57c3-4b8d-90ce-3b81e5e0cad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:24.522175 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828915c6-18d0-4079-b23f-f3c055cbb62f None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:24.562532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb548d4-c257-4ed6-8d4d-5f7ed3c99b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:24.563363 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb548d4-c257-4ed6-8d4d-5f7ed3c99b0e None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:24.563594 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb548d4-c257-4ed6-8d4d-5f7ed3c99b0e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:24.563874 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb548d4-c257-4ed6-8d4d-5f7ed3c99b0e None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:24.564645 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb548d4-c257-4ed6-8d4d-5f7ed3c99b0e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:24.564962 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb548d4-c257-4ed6-8d4d-5f7ed3c99b0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:24.566412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb548d4-c257-4ed6-8d4d-5f7ed3c99b0e None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:24.576813 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 445/907] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Apr 14 21:36:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:24.577811 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb548d4-c257-4ed6-8d4d-5f7ed3c99b0e None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:24.581635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 463/908] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:24.610597 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8a7d1-57c3-4b8d-90ce-3b81e5e0cad4 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:24.694227 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb548d4-c257-4ed6-8d4d-5f7ed3c99b0e None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:24.738618 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246d912-6bdb-46c3-aaf6-e4ae735e3118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:24.740067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246d912-6bdb-46c3-aaf6-e4ae735e3118 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:24.740067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246d912-6bdb-46c3-aaf6-e4ae735e3118 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:24.740067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246d912-6bdb-46c3-aaf6-e4ae735e3118 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:24.740684 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246d912-6bdb-46c3-aaf6-e4ae735e3118 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:24.741030 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246d912-6bdb-46c3-aaf6-e4ae735e3118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:24.742416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246d912-6bdb-46c3-aaf6-e4ae735e3118 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:24.747874 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 446/909] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Apr 14 21:36:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:24.748546 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8a7d1-57c3-4b8d-90ce-3b81e5e0cad4 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:24.754274 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246d912-6bdb-46c3-aaf6-e4ae735e3118 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:24.790078 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a35f0d-c983-4cc1-bc60-1875d6ffe5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:24.791075 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35f0d-c983-4cc1-bc60-1875d6ffe5bd None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:24.791563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35f0d-c983-4cc1-bc60-1875d6ffe5bd None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:24.792047 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35f0d-c983-4cc1-bc60-1875d6ffe5bd None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:24.793227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a35f0d-c983-4cc1-bc60-1875d6ffe5bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:24.795429 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a35f0d-c983-4cc1-bc60-1875d6ffe5bd None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:24.864873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246d912-6bdb-46c3-aaf6-e4ae735e3118 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:24.881366 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 464/910] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Apr 14 21:36:24 2022] POST /identity/v3/services => generated 241 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:36:24.909455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09cec4-350f-4daa-b5f5-ed7cc6d3ef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:24.910144 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09cec4-350f-4daa-b5f5-ed7cc6d3ef3a None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:24.910427 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09cec4-350f-4daa-b5f5-ed7cc6d3ef3a None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:24.910700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09cec4-350f-4daa-b5f5-ed7cc6d3ef3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:24.911518 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09cec4-350f-4daa-b5f5-ed7cc6d3ef3a None admin] RBAC: Adding query filter params (interface=public, service_id=73fed71f3a7548ccb245b2b4b4c6bcc6, region_id=RegionOne) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:24.911831 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09cec4-350f-4daa-b5f5-ed7cc6d3ef3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:24.913352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09cec4-350f-4daa-b5f5-ed7cc6d3ef3a None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:24.920709 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 447/911] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Apr 14 21:36:24 2022] GET /identity/v3/endpoints?service_id=73fed71f3a7548ccb245b2b4b4c6bcc6&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:24.926521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a35f0d-c983-4cc1-bc60-1875d6ffe5bd None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:24.946880 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68037cef-634f-437a-94f2-6c5239cae75a None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:24.947064 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68037cef-634f-437a-94f2-6c5239cae75a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:24.947314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68037cef-634f-437a-94f2-6c5239cae75a None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:24.949139 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 448/912] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:36:24.955153 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf40deb-bc55-4b24-882d-5225bc0b3638 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:24.955471 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf40deb-bc55-4b24-882d-5225bc0b3638 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:24.955747 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf40deb-bc55-4b24-882d-5225bc0b3638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:24.975605 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-fbf40deb-bc55-4b24-882d-5225bc0b3638 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:24.976878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-fbf40deb-bc55-4b24-882d-5225bc0b3638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:25.050974 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a35f0d-c983-4cc1-bc60-1875d6ffe5bd None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:25.071765 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 449/913] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:25.087690 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eafed0-360d-4889-a935-3d7c1e549c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:25.088777 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eafed0-360d-4889-a935-3d7c1e549c2c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:25.089218 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eafed0-360d-4889-a935-3d7c1e549c2c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:25.089495 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eafed0-360d-4889-a935-3d7c1e549c2c None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:25.090187 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eafed0-360d-4889-a935-3d7c1e549c2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:25.091677 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eafed0-360d-4889-a935-3d7c1e549c2c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:25.096158 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf40deb-bc55-4b24-882d-5225bc0b3638 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:25.098783 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 465/914] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Apr 14 21:36:24 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:36:25.211421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf40deb-bc55-4b24-882d-5225bc0b3638 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:25.249518 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb797f-2450-4450-a8e0-15cd163c056c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:25.250356 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb797f-2450-4450-a8e0-15cd163c056c None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:25.250633 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb797f-2450-4450-a8e0-15cd163c056c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:25.250904 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb797f-2450-4450-a8e0-15cd163c056c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:25.262154 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb797f-2450-4450-a8e0-15cd163c056c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:25.270284 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-e1eb797f-2450-4450-a8e0-15cd163c056c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 14 21:36:25.271894 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 450/915] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Apr 14 21:36:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:25.278001 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eafed0-360d-4889-a935-3d7c1e549c2c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:25.382994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eafed0-360d-4889-a935-3d7c1e549c2c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:25.416747 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8f436-4f2f-4461-a068-4e339d56a284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:25.417408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f436-4f2f-4461-a068-4e339d56a284 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:25.417684 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f436-4f2f-4461-a068-4e339d56a284 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:25.417956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f436-4f2f-4461-a068-4e339d56a284 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:25.418694 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8f436-4f2f-4461-a068-4e339d56a284 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:25.419054 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8f436-4f2f-4461-a068-4e339d56a284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:25.420868 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8f436-4f2f-4461-a068-4e339d56a284 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:25.429125 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 466/916] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Apr 14 21:36:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:25.436831 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb797f-2450-4450-a8e0-15cd163c056c None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:25.538463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb797f-2450-4450-a8e0-15cd163c056c None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:25.572706 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ff69e-905d-4284-8238-201f597dbe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:25.573495 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ff69e-905d-4284-8238-201f597dbe76 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:25.573783 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ff69e-905d-4284-8238-201f597dbe76 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:25.574056 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ff69e-905d-4284-8238-201f597dbe76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:25.585772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ff69e-905d-4284-8238-201f597dbe76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:25.587216 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ff69e-905d-4284-8238-201f597dbe76 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:25.603653 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-866ff69e-905d-4284-8238-201f597dbe76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:25.605202 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 451/917] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:25.611375 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8f436-4f2f-4461-a068-4e339d56a284 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:25.715004 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8f436-4f2f-4461-a068-4e339d56a284 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:25.748996 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09097006-2411-4c05-ad20-d3f221cc154d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:25.749656 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09097006-2411-4c05-ad20-d3f221cc154d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:25.749934 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09097006-2411-4c05-ad20-d3f221cc154d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:25.750201 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09097006-2411-4c05-ad20-d3f221cc154d None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:25.750910 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09097006-2411-4c05-ad20-d3f221cc154d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:25.751208 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09097006-2411-4c05-ad20-d3f221cc154d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:25.752567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09097006-2411-4c05-ad20-d3f221cc154d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:25.764624 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 467/918] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:25.770242 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ff69e-905d-4284-8238-201f597dbe76 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:25.880186 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ff69e-905d-4284-8238-201f597dbe76 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:25.914045 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5ae60-4fe9-4c4f-9873-16e187bc3eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:25.914992 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5ae60-4fe9-4c4f-9873-16e187bc3eb4 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:25.915269 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5ae60-4fe9-4c4f-9873-16e187bc3eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:25.915537 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5ae60-4fe9-4c4f-9873-16e187bc3eb4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:25.924480 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5ae60-4fe9-4c4f-9873-16e187bc3eb4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:25.926015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5ae60-4fe9-4c4f-9873-16e187bc3eb4 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:25.941727 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-67a5ae60-4fe9-4c4f-9873-16e187bc3eb4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 14 21:36:25.947875 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 452/919] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Apr 14 21:36:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:25.949429 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09097006-2411-4c05-ad20-d3f221cc154d None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:26.053376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09097006-2411-4c05-ad20-d3f221cc154d None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:26.087670 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ddbc3-1f95-4708-8bfd-90666fea24db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:26.088333 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ddbc3-1f95-4708-8bfd-90666fea24db None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:26.088628 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ddbc3-1f95-4708-8bfd-90666fea24db None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:26.088902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ddbc3-1f95-4708-8bfd-90666fea24db None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:26.089731 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ddbc3-1f95-4708-8bfd-90666fea24db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:26.090034 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ddbc3-1f95-4708-8bfd-90666fea24db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:26.092001 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ddbc3-1f95-4708-8bfd-90666fea24db None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:26.110559 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 468/920] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Apr 14 21:36:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:26.116025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5ae60-4fe9-4c4f-9873-16e187bc3eb4 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:26.222800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5ae60-4fe9-4c4f-9873-16e187bc3eb4 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:26.257647 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f139498-62db-405c-ba79-4555ab7c37f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:26.258441 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f139498-62db-405c-ba79-4555ab7c37f6 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:26.258716 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f139498-62db-405c-ba79-4555ab7c37f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:26.258981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f139498-62db-405c-ba79-4555ab7c37f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:26.270679 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f139498-62db-405c-ba79-4555ab7c37f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:26.272172 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f139498-62db-405c-ba79-4555ab7c37f6 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:26.289199 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-7f139498-62db-405c-ba79-4555ab7c37f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:26.290716 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 453/921] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:26.297807 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ddbc3-1f95-4708-8bfd-90666fea24db None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:26.403342 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ddbc3-1f95-4708-8bfd-90666fea24db None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:26.438360 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe362cd-353a-4741-998f-c765862aa76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:26.439504 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe362cd-353a-4741-998f-c765862aa76e None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:26.440005 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe362cd-353a-4741-998f-c765862aa76e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:26.440494 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe362cd-353a-4741-998f-c765862aa76e None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:26.441646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe362cd-353a-4741-998f-c765862aa76e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:26.442204 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe362cd-353a-4741-998f-c765862aa76e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:26.443636 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe362cd-353a-4741-998f-c765862aa76e None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:26.457317 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 469/922] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:26.465661 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f139498-62db-405c-ba79-4555ab7c37f6 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:26.569039 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f139498-62db-405c-ba79-4555ab7c37f6 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:26.608475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c82ffb-c287-42e4-9335-e376dd8ec08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:26.609342 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c82ffb-c287-42e4-9335-e376dd8ec08a None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:26.609567 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c82ffb-c287-42e4-9335-e376dd8ec08a None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:26.609838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c82ffb-c287-42e4-9335-e376dd8ec08a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:26.616983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c82ffb-c287-42e4-9335-e376dd8ec08a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:26.618412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c82ffb-c287-42e4-9335-e376dd8ec08a None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:26.632728 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-37c82ffb-c287-42e4-9335-e376dd8ec08a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:36:26.634257 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 454/923] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:26.641702 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe362cd-353a-4741-998f-c765862aa76e None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:26.745736 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe362cd-353a-4741-998f-c765862aa76e None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:26.781659 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fdcc2-0881-4951-a041-128f321a83c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:26.782354 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fdcc2-0881-4951-a041-128f321a83c4 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:26.782639 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fdcc2-0881-4951-a041-128f321a83c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:26.782972 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fdcc2-0881-4951-a041-128f321a83c4 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:26.783773 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fdcc2-0881-4951-a041-128f321a83c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:26.784083 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fdcc2-0881-4951-a041-128f321a83c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:26.785554 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fdcc2-0881-4951-a041-128f321a83c4 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:26.803561 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 470/924] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:36:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:26.804992 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c82ffb-c287-42e4-9335-e376dd8ec08a None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:26.906646 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c82ffb-c287-42e4-9335-e376dd8ec08a None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:26.940903 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6a3b5-772c-400e-a4af-d492f80c6200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:26.941791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6a3b5-772c-400e-a4af-d492f80c6200 None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:26.942289 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6a3b5-772c-400e-a4af-d492f80c6200 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:26.942400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6a3b5-772c-400e-a4af-d492f80c6200 None admin] PATH_INFO: `/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/1144e9036d0b4bafb30995ff1a8449ec/roles/928ab085e3e84586b2862ae16aca8595` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:26.944660 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6a3b5-772c-400e-a4af-d492f80c6200 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3c1bb37aa1c407782b2f5501ae1f10a, user_id=1144e9036d0b4bafb30995ff1a8449ec, role_id=928ab085e3e84586b2862ae16aca8595)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:26.946081 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6a3b5-772c-400e-a4af-d492f80c6200 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:26.968093 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898373de-485b-4501-9dca-73cf64039698 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:26.968408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898373de-485b-4501-9dca-73cf64039698 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:26.968691 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898373de-485b-4501-9dca-73cf64039698 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:26.972699 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 471/925] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:26.978043 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64813392-0b57-4703-9efc-9af3ef9cc534 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:26.981089 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64813392-0b57-4703-9efc-9af3ef9cc534 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:26.981089 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64813392-0b57-4703-9efc-9af3ef9cc534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:26.998853 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-64813392-0b57-4703-9efc-9af3ef9cc534 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:27.000081 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-64813392-0b57-4703-9efc-9af3ef9cc534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:27.061858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 455/926] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:36:26 2022] PUT /identity/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/1144e9036d0b4bafb30995ff1a8449ec/roles/928ab085e3e84586b2862ae16aca8595 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:36:27.078924 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 472/927] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:27.105062 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6a3b5-772c-400e-a4af-d492f80c6200 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:27.227600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6a3b5-772c-400e-a4af-d492f80c6200 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:27.267157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e294dd1-1cf1-4d32-b111-f759972839a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:27.268384 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e294dd1-1cf1-4d32-b111-f759972839a1 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:27.268908 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e294dd1-1cf1-4d32-b111-f759972839a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:27.269386 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e294dd1-1cf1-4d32-b111-f759972839a1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:27.270256 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e294dd1-1cf1-4d32-b111-f759972839a1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:27.271902 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e294dd1-1cf1-4d32-b111-f759972839a1 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:27.285095 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-2e294dd1-1cf1-4d32-b111-f759972839a1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 14 21:36:27.291700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 456/928] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:36:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:27.293342 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64813392-0b57-4703-9efc-9af3ef9cc534 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:27.400171 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64813392-0b57-4703-9efc-9af3ef9cc534 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:27.436127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee5bbc-ef54-467c-b5fb-1503a8bf5d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:27.437268 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee5bbc-ef54-467c-b5fb-1503a8bf5d14 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:27.437758 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee5bbc-ef54-467c-b5fb-1503a8bf5d14 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:27.438383 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee5bbc-ef54-467c-b5fb-1503a8bf5d14 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:27.439339 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee5bbc-ef54-467c-b5fb-1503a8bf5d14 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:27.439806 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee5bbc-ef54-467c-b5fb-1503a8bf5d14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:27.440331 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5592e-bf45-4d4a-ada6-3ccf452604b2 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:27.440763 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5592e-bf45-4d4a-ada6-3ccf452604b2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:27.441127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5592e-bf45-4d4a-ada6-3ccf452604b2 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:27.441851 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee5bbc-ef54-467c-b5fb-1503a8bf5d14 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:27.442928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 457/929] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:27.452603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14233a6b-1261-46ed-b932-3c24f6332229 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:27.452603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14233a6b-1261-46ed-b932-3c24f6332229 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:27.452603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14233a6b-1261-46ed-b932-3c24f6332229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:27.452942 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 473/930] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:36:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:27.454845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee5bbc-ef54-467c-b5fb-1503a8bf5d14 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:27.470146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-14233a6b-1261-46ed-b932-3c24f6332229 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:27.471435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-14233a6b-1261-46ed-b932-3c24f6332229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:27.539791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 458/931] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:27.548943 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a711e-d87e-479e-a33f-d4c3d9162a9e None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:27.549236 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a711e-d87e-479e-a33f-d4c3d9162a9e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:27.549521 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a711e-d87e-479e-a33f-d4c3d9162a9e None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:27.554608 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 459/932] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:36:27.555739 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57cede-33a5-4c3b-8e65-6df0cb10a91d None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:27.556025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57cede-33a5-4c3b-8e65-6df0cb10a91d None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:27.556300 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57cede-33a5-4c3b-8e65-6df0cb10a91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:27.573363 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-1d57cede-33a5-4c3b-8e65-6df0cb10a91d None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:27.574561 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1d57cede-33a5-4c3b-8e65-6df0cb10a91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:27.577051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee5bbc-ef54-467c-b5fb-1503a8bf5d14 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:27.609930 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5a273-40c8-4c96-852b-6b83e3052584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:27.610609 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5a273-40c8-4c96-852b-6b83e3052584 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:27.610891 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5a273-40c8-4c96-852b-6b83e3052584 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:27.611164 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5a273-40c8-4c96-852b-6b83e3052584 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:27.611866 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5a273-40c8-4c96-852b-6b83e3052584 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:27.612169 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5a273-40c8-4c96-852b-6b83e3052584 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:27.613581 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5a273-40c8-4c96-852b-6b83e3052584 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:27.618411 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 474/933] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Apr 14 21:36:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:27.619092 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5a273-40c8-4c96-852b-6b83e3052584 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:27.652647 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 460/934] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:27.652647 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57cede-33a5-4c3b-8e65-6df0cb10a91d None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:27.718336 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5a273-40c8-4c96-852b-6b83e3052584 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:27.751275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57cede-33a5-4c3b-8e65-6df0cb10a91d None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:27.752801 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c74b2-375a-4586-aca1-2ea3370bdf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:27.753600 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c74b2-375a-4586-aca1-2ea3370bdf19 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:27.753958 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c74b2-375a-4586-aca1-2ea3370bdf19 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:27.754235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c74b2-375a-4586-aca1-2ea3370bdf19 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:27.754879 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c74b2-375a-4586-aca1-2ea3370bdf19 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:27.756222 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c74b2-375a-4586-aca1-2ea3370bdf19 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:27.769290 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-fe2c74b2-375a-4586-aca1-2ea3370bdf19 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 14 21:36:27.772640 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 475/935] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Apr 14 21:36:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:27.772640 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c74b2-375a-4586-aca1-2ea3370bdf19 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:27.790240 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53781662-ab16-49e1-b0c8-ae35973321a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:27.790834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53781662-ab16-49e1-b0c8-ae35973321a9 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:27.791113 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53781662-ab16-49e1-b0c8-ae35973321a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:27.791385 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53781662-ab16-49e1-b0c8-ae35973321a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:27.792118 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53781662-ab16-49e1-b0c8-ae35973321a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:27.793506 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53781662-ab16-49e1-b0c8-ae35973321a9 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:27.864299 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 461/936] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Apr 14 21:36:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:36:27.868413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c74b2-375a-4586-aca1-2ea3370bdf19 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:27.869567 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53781662-ab16-49e1-b0c8-ae35973321a9 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:27.926663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3f416-26c4-4dfd-9f7b-0a69d83e982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:27.928686 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3f416-26c4-4dfd-9f7b-0a69d83e982e None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:27.929207 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3f416-26c4-4dfd-9f7b-0a69d83e982e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:27.929649 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3f416-26c4-4dfd-9f7b-0a69d83e982e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:27.939513 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3f416-26c4-4dfd-9f7b-0a69d83e982e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:27.939513 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3f416-26c4-4dfd-9f7b-0a69d83e982e None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:27.947619 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-79a3f416-26c4-4dfd-9f7b-0a69d83e982e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 14 21:36:27.954689 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 476/937] 10.222.0.52 () {56 vars in 1132 bytes} [Thu Apr 14 21:36:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:27.956313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3f416-26c4-4dfd-9f7b-0a69d83e982e None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:28.002052 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53781662-ab16-49e1-b0c8-ae35973321a9 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:28.039697 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd43f2-1d2f-423c-9cdb-3a0924aef7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:28.040439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd43f2-1d2f-423c-9cdb-3a0924aef7b1 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:28.040696 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd43f2-1d2f-423c-9cdb-3a0924aef7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:28.040970 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd43f2-1d2f-423c-9cdb-3a0924aef7b1 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:28.041688 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd43f2-1d2f-423c-9cdb-3a0924aef7b1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:28.041994 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd43f2-1d2f-423c-9cdb-3a0924aef7b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:28.043383 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd43f2-1d2f-423c-9cdb-3a0924aef7b1 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:28.054599 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 462/938] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Apr 14 21:36:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:28.055964 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd43f2-1d2f-423c-9cdb-3a0924aef7b1 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:28.084127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3f416-26c4-4dfd-9f7b-0a69d83e982e None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:28.129112 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360f007-69bd-43f9-84c7-497a6183d745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:28.130474 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360f007-69bd-43f9-84c7-497a6183d745 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:28.131121 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360f007-69bd-43f9-84c7-497a6183d745 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:28.131950 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360f007-69bd-43f9-84c7-497a6183d745 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:28.133189 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360f007-69bd-43f9-84c7-497a6183d745 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:28.133867 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360f007-69bd-43f9-84c7-497a6183d745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:28.136110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360f007-69bd-43f9-84c7-497a6183d745 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:28.143774 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 477/939] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Apr 14 21:36:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:28.150638 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360f007-69bd-43f9-84c7-497a6183d745 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:28.177644 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd43f2-1d2f-423c-9cdb-3a0924aef7b1 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:28.212455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed7ef4-444e-4df9-9d13-ec3b1c78e43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:28.212901 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed7ef4-444e-4df9-9d13-ec3b1c78e43f None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:28.213180 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed7ef4-444e-4df9-9d13-ec3b1c78e43f None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:28.213445 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed7ef4-444e-4df9-9d13-ec3b1c78e43f None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:28.214319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed7ef4-444e-4df9-9d13-ec3b1c78e43f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:28.214503 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed7ef4-444e-4df9-9d13-ec3b1c78e43f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:28.216446 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed7ef4-444e-4df9-9d13-ec3b1c78e43f None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:28.221948 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 463/940] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Apr 14 21:36:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:28.228387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed7ef4-444e-4df9-9d13-ec3b1c78e43f None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:28.274676 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360f007-69bd-43f9-84c7-497a6183d745 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:28.310871 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08a31a-21cb-43c9-9498-5ca7900948d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:28.311600 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08a31a-21cb-43c9-9498-5ca7900948d4 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:28.312016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08a31a-21cb-43c9-9498-5ca7900948d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:28.312348 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08a31a-21cb-43c9-9498-5ca7900948d4 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:28.313229 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08a31a-21cb-43c9-9498-5ca7900948d4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:28.313691 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08a31a-21cb-43c9-9498-5ca7900948d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:28.315211 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08a31a-21cb-43c9-9498-5ca7900948d4 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:28.325546 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 478/941] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Apr 14 21:36:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:28.326521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08a31a-21cb-43c9-9498-5ca7900948d4 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:28.362121 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed7ef4-444e-4df9-9d13-ec3b1c78e43f None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:28.405654 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a4b96-7869-4aea-b608-a6672571db70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:28.406926 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a4b96-7869-4aea-b608-a6672571db70 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:28.407396 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a4b96-7869-4aea-b608-a6672571db70 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:28.407970 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a4b96-7869-4aea-b608-a6672571db70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:28.409312 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a4b96-7869-4aea-b608-a6672571db70 None admin] RBAC: Adding query filter params (interface=public, service_id=662aa023234b47f2a64cc48830c2b828, region_id=RegionOne) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:28.409794 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a4b96-7869-4aea-b608-a6672571db70 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:28.411743 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a4b96-7869-4aea-b608-a6672571db70 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:28.423621 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 464/942] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Apr 14 21:36:28 2022] GET /identity/v3/endpoints?service_id=662aa023234b47f2a64cc48830c2b828&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:28.424675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a4b96-7869-4aea-b608-a6672571db70 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:28.434086 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08a31a-21cb-43c9-9498-5ca7900948d4 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:28.476378 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33073eb-493d-47ad-89c5-397e9e8c158c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:28.477828 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33073eb-493d-47ad-89c5-397e9e8c158c None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:28.478611 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33073eb-493d-47ad-89c5-397e9e8c158c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:28.479119 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33073eb-493d-47ad-89c5-397e9e8c158c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:28.480556 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33073eb-493d-47ad-89c5-397e9e8c158c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:28.483255 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33073eb-493d-47ad-89c5-397e9e8c158c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:28.523283 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a4b96-7869-4aea-b608-a6672571db70 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:28.555585 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828032de-32db-4349-8d70-9205557a2069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:28.556243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828032de-32db-4349-8d70-9205557a2069 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:28.556517 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828032de-32db-4349-8d70-9205557a2069 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:28.556822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828032de-32db-4349-8d70-9205557a2069 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:28.557489 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828032de-32db-4349-8d70-9205557a2069 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:28.558908 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828032de-32db-4349-8d70-9205557a2069 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:28.572681 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 465/943] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Apr 14 21:36:28 2022] GET /identity/v3/services => generated 1497 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:36:28.583643 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 479/944] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Apr 14 21:36:28 2022] POST /identity/v3/endpoints => generated 347 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:36:29.486611 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705601db-809b-4031-84ad-090185b02809 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:29.487521 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705601db-809b-4031-84ad-090185b02809 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:29.487954 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705601db-809b-4031-84ad-090185b02809 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:29.489764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 466/945] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:29.495290 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e60bf-af61-441f-b7a5-3f3430215515 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:29.496129 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e60bf-af61-441f-b7a5-3f3430215515 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:29.496640 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e60bf-af61-441f-b7a5-3f3430215515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:29.514613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-ce3e60bf-af61-441f-b7a5-3f3430215515 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:29.516165 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ce3e60bf-af61-441f-b7a5-3f3430215515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:29.590178 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 480/946] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:29.615414 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705601db-809b-4031-84ad-090185b02809 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:29.721319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705601db-809b-4031-84ad-090185b02809 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:29.757148 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ba3a6-52f4-4e29-88eb-917d69d116e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:29.757884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba3a6-52f4-4e29-88eb-917d69d116e5 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:29.758164 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba3a6-52f4-4e29-88eb-917d69d116e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:29.758436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba3a6-52f4-4e29-88eb-917d69d116e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:29.770606 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ba3a6-52f4-4e29-88eb-917d69d116e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:29.778377 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-b75ba3a6-52f4-4e29-88eb-917d69d116e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 14 21:36:29.780013 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 467/947] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Apr 14 21:36:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:29.786215 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e60bf-af61-441f-b7a5-3f3430215515 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:29.890565 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e60bf-af61-441f-b7a5-3f3430215515 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:29.929421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c882f8e-28c7-49b1-8aec-9570ddcce18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:29.930530 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c882f8e-28c7-49b1-8aec-9570ddcce18c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:29.931045 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c882f8e-28c7-49b1-8aec-9570ddcce18c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:29.931540 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c882f8e-28c7-49b1-8aec-9570ddcce18c None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:29.932489 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c882f8e-28c7-49b1-8aec-9570ddcce18c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:29.933025 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c882f8e-28c7-49b1-8aec-9570ddcce18c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:29.935220 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c882f8e-28c7-49b1-8aec-9570ddcce18c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:29.948529 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 481/948] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Apr 14 21:36:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:29.950175 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ba3a6-52f4-4e29-88eb-917d69d116e5 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:30.052192 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ba3a6-52f4-4e29-88eb-917d69d116e5 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:30.086619 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1691f-8f5c-441a-a9ad-81aa856d55db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:30.087419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1691f-8f5c-441a-a9ad-81aa856d55db None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:30.087746 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1691f-8f5c-441a-a9ad-81aa856d55db None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:30.088026 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1691f-8f5c-441a-a9ad-81aa856d55db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:30.098199 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1691f-8f5c-441a-a9ad-81aa856d55db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:30.099649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1691f-8f5c-441a-a9ad-81aa856d55db None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:30.117231 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-92d1691f-8f5c-441a-a9ad-81aa856d55db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:30.118750 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 468/949] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:30.125022 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c882f8e-28c7-49b1-8aec-9570ddcce18c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:30.226609 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c882f8e-28c7-49b1-8aec-9570ddcce18c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:30.261794 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c52f3e-f675-46dc-a25c-0a17c4b69f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:30.263071 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c52f3e-f675-46dc-a25c-0a17c4b69f48 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:30.263583 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c52f3e-f675-46dc-a25c-0a17c4b69f48 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:30.264059 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c52f3e-f675-46dc-a25c-0a17c4b69f48 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:30.265035 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c52f3e-f675-46dc-a25c-0a17c4b69f48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:30.265547 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c52f3e-f675-46dc-a25c-0a17c4b69f48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:30.267127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c52f3e-f675-46dc-a25c-0a17c4b69f48 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:30.284273 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 482/950] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:30.286067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1691f-8f5c-441a-a9ad-81aa856d55db None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:30.307666 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da76c1-fa03-4755-abfe-a87516cd7602 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:30.307945 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da76c1-fa03-4755-abfe-a87516cd7602 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:30.308151 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da76c1-fa03-4755-abfe-a87516cd7602 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:30.311215 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 483/951] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:36:30.316065 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8a1c1-9ef2-44e2-a644-3deb137aaa82 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:30.316407 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8a1c1-9ef2-44e2-a644-3deb137aaa82 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:30.316719 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8a1c1-9ef2-44e2-a644-3deb137aaa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:30.337166 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-64f8a1c1-9ef2-44e2-a644-3deb137aaa82 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:30.338368 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-64f8a1c1-9ef2-44e2-a644-3deb137aaa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:30.406791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1691f-8f5c-441a-a9ad-81aa856d55db None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:30.417309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 484/952] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:30.438296 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8a1c1-9ef2-44e2-a644-3deb137aaa82 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:30.441131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1001545-3ea5-402b-87c6-1d0a72435c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:30.441949 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1001545-3ea5-402b-87c6-1d0a72435c76 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:30.442282 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1001545-3ea5-402b-87c6-1d0a72435c76 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:30.442553 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1001545-3ea5-402b-87c6-1d0a72435c76 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:30.450755 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1001545-3ea5-402b-87c6-1d0a72435c76 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:30.452252 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1001545-3ea5-402b-87c6-1d0a72435c76 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:30.467518 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-f1001545-3ea5-402b-87c6-1d0a72435c76 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 14 21:36:30.469124 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 469/953] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Apr 14 21:36:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:30.474671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1001545-3ea5-402b-87c6-1d0a72435c76 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:30.554652 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8a1c1-9ef2-44e2-a644-3deb137aaa82 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:30.587825 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1001545-3ea5-402b-87c6-1d0a72435c76 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:30.591169 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a285a-3425-47e2-bbf0-200890325937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:30.592203 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a285a-3425-47e2-bbf0-200890325937 None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:30.592746 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a285a-3425-47e2-bbf0-200890325937 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:30.593247 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a285a-3425-47e2-bbf0-200890325937 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:30.594215 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a285a-3425-47e2-bbf0-200890325937 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:30.595931 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a285a-3425-47e2-bbf0-200890325937 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:30.597662 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.common [None req-9e0a285a-3425-47e2-bbf0-200890325937 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 14 21:36:30.628981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7e21c-1bde-4d8c-a18c-37895772e180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:30.633858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7e21c-1bde-4d8c-a18c-37895772e180 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:30.633858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7e21c-1bde-4d8c-a18c-37895772e180 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:30.633858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7e21c-1bde-4d8c-a18c-37895772e180 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:30.633858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7e21c-1bde-4d8c-a18c-37895772e180 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:30.633858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7e21c-1bde-4d8c-a18c-37895772e180 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:30.633858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7e21c-1bde-4d8c-a18c-37895772e180 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:30.650899 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 470/954] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Apr 14 21:36:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:30.656456 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7e21c-1bde-4d8c-a18c-37895772e180 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:30.661315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.sql.core [None req-9e0a285a-3425-47e2-bbf0-200890325937 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 14 21:36:30.661315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 14 21:36:30.661315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [parameters: {'id': '5a4a6dda4733464ca065c59148761be7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 14 21:36:30.661315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86770) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 14 21:36:30.677448 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-9e0a285a-3425-47e2-bbf0-200890325937 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5a4a6dda4733464ca065c59148761be7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5a4a6dda4733464ca065c59148761be7. Apr 14 21:36:30.679223 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 485/955] 10.222.0.52 () {60 vars in 1140 bytes} [Thu Apr 14 21:36:30 2022] POST /identity/v3/projects => generated 262 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:30.685763 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a285a-3425-47e2-bbf0-200890325937 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:30.767368 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7e21c-1bde-4d8c-a18c-37895772e180 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:30.793346 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a285a-3425-47e2-bbf0-200890325937 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:30.801940 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cadb52-c533-4d7c-b695-de74330fc673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:30.802698 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cadb52-c533-4d7c-b695-de74330fc673 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:30.802861 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cadb52-c533-4d7c-b695-de74330fc673 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:30.803165 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cadb52-c533-4d7c-b695-de74330fc673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:30.830623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a730a21-3423-49d1-a91f-f0e1e441b08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:30.831772 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a730a21-3423-49d1-a91f-f0e1e441b08a None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:30.832264 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a730a21-3423-49d1-a91f-f0e1e441b08a None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:30.832745 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a730a21-3423-49d1-a91f-f0e1e441b08a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:30.840204 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a730a21-3423-49d1-a91f-f0e1e441b08a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:30.842459 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a730a21-3423-49d1-a91f-f0e1e441b08a None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:30.857504 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-1a730a21-3423-49d1-a91f-f0e1e441b08a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:36:30.863767 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 486/956] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:30.865240 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a730a21-3423-49d1-a91f-f0e1e441b08a None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:30.874793 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cadb52-c533-4d7c-b695-de74330fc673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:30.875914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cadb52-c533-4d7c-b695-de74330fc673 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:30.967968 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a730a21-3423-49d1-a91f-f0e1e441b08a None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:30.979834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 471/957] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:36:30 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 14 21:36:30.985834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cadb52-c533-4d7c-b695-de74330fc673 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:31.005555 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927a57b-ecad-45d5-b335-e343a3439106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:31.006296 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927a57b-ecad-45d5-b335-e343a3439106 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:31.006579 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927a57b-ecad-45d5-b335-e343a3439106 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:31.006855 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927a57b-ecad-45d5-b335-e343a3439106 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:31.007684 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927a57b-ecad-45d5-b335-e343a3439106 None admin] RBAC: Adding query filter params (name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:31.007997 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927a57b-ecad-45d5-b335-e343a3439106 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:31.009469 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927a57b-ecad-45d5-b335-e343a3439106 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:31.029541 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 487/958] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Apr 14 21:36:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:31.031000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd45076-28b0-4ac9-9b24-c85121e1df43 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:31.031291 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd45076-28b0-4ac9-9b24-c85121e1df43 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:31.031566 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd45076-28b0-4ac9-9b24-c85121e1df43 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:31.033046 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 488/959] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:31.038665 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21941670-f344-40a1-9c2b-94e7eb5081c6 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:31.039236 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21941670-f344-40a1-9c2b-94e7eb5081c6 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:31.039687 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21941670-f344-40a1-9c2b-94e7eb5081c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:31.069070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-21941670-f344-40a1-9c2b-94e7eb5081c6 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:31.073562 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-21941670-f344-40a1-9c2b-94e7eb5081c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:31.101061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cadb52-c533-4d7c-b695-de74330fc673 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:31.136295 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f0668-1b10-4383-9926-03128662a7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:31.137157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f0668-1b10-4383-9926-03128662a7ff None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:31.137528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f0668-1b10-4383-9926-03128662a7ff None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:31.137803 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f0668-1b10-4383-9926-03128662a7ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:31.145695 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 489/960] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:31.146874 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe54ad-d03c-46ce-8976-9426aaab2298 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:31.147157 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe54ad-d03c-46ce-8976-9426aaab2298 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:31.147429 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe54ad-d03c-46ce-8976-9426aaab2298 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:31.149014 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 490/961] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:31.155621 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd9cfd-f574-4d5a-981c-a33b6b1afff1 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:31.155896 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd9cfd-f574-4d5a-981c-a33b6b1afff1 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:31.158401 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd9cfd-f574-4d5a-981c-a33b6b1afff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:31.159715 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f0668-1b10-4383-9926-03128662a7ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:31.161412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f0668-1b10-4383-9926-03128662a7ff None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:31.176490 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-e9fd9cfd-f574-4d5a-981c-a33b6b1afff1 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:31.178049 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e9fd9cfd-f574-4d5a-981c-a33b6b1afff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:31.181135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-a95f0668-1b10-4383-9926-03128662a7ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:31.182396 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 472/962] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:31.183192 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f0668-1b10-4383-9926-03128662a7ff None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:31.255441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 491/963] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:31.260615 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd9cfd-f574-4d5a-981c-a33b6b1afff1 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:31.292751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f0668-1b10-4383-9926-03128662a7ff None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:31.327497 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf7da1-bf74-4488-9286-0da353574b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:31.328390 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf7da1-bf74-4488-9286-0da353574b9a None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:31.328699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf7da1-bf74-4488-9286-0da353574b9a None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:31.328972 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf7da1-bf74-4488-9286-0da353574b9a None admin] PATH_INFO: `/v3/services/compute` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:31.329623 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf7da1-bf74-4488-9286-0da353574b9a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:31.331112 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf7da1-bf74-4488-9286-0da353574b9a None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:31.342987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-14bf7da1-bf74-4488-9286-0da353574b9a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 14 21:36:31.344462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 473/964] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:31.345149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf7da1-bf74-4488-9286-0da353574b9a None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:31.366386 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd9cfd-f574-4d5a-981c-a33b6b1afff1 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:31.399676 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa5686-03e8-4bfb-b3ca-7726db77e45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:31.400610 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5686-03e8-4bfb-b3ca-7726db77e45d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:31.400891 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5686-03e8-4bfb-b3ca-7726db77e45d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:31.401164 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5686-03e8-4bfb-b3ca-7726db77e45d None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:31.401888 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa5686-03e8-4bfb-b3ca-7726db77e45d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:31.402194 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa5686-03e8-4bfb-b3ca-7726db77e45d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:31.404285 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa5686-03e8-4bfb-b3ca-7726db77e45d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:31.420878 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 492/965] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:31.421600 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa5686-03e8-4bfb-b3ca-7726db77e45d None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:31.454671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf7da1-bf74-4488-9286-0da353574b9a None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:31.487970 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fd52e-6820-40ee-a7e7-b0e4f276a0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:31.488800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fd52e-6820-40ee-a7e7-b0e4f276a0ef None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:31.489083 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fd52e-6820-40ee-a7e7-b0e4f276a0ef None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:31.489354 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fd52e-6820-40ee-a7e7-b0e4f276a0ef None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:31.490008 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fd52e-6820-40ee-a7e7-b0e4f276a0ef None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:31.491371 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fd52e-6820-40ee-a7e7-b0e4f276a0ef None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:31.502694 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-354fd52e-6820-40ee-a7e7-b0e4f276a0ef None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 14 21:36:31.508545 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 474/966] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Apr 14 21:36:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:31.508545 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fd52e-6820-40ee-a7e7-b0e4f276a0ef None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:31.521533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa5686-03e8-4bfb-b3ca-7726db77e45d None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:31.554657 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556bdd3-ee48-439d-92e3-644da5fa25f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:31.555689 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556bdd3-ee48-439d-92e3-644da5fa25f4 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:31.556641 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556bdd3-ee48-439d-92e3-644da5fa25f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:31.556985 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556bdd3-ee48-439d-92e3-644da5fa25f4 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:31.557695 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556bdd3-ee48-439d-92e3-644da5fa25f4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:31.558000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556bdd3-ee48-439d-92e3-644da5fa25f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:31.559424 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556bdd3-ee48-439d-92e3-644da5fa25f4 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:31.568752 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 493/967] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Apr 14 21:36:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:31.568752 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556bdd3-ee48-439d-92e3-644da5fa25f4 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:31.611183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fd52e-6820-40ee-a7e7-b0e4f276a0ef None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:31.645587 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6e1b7-e9e1-4992-987b-4cb460012736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:31.646305 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6e1b7-e9e1-4992-987b-4cb460012736 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:31.646584 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6e1b7-e9e1-4992-987b-4cb460012736 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:31.646857 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6e1b7-e9e1-4992-987b-4cb460012736 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:31.653981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6e1b7-e9e1-4992-987b-4cb460012736 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:31.655542 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6e1b7-e9e1-4992-987b-4cb460012736 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:31.665479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556bdd3-ee48-439d-92e3-644da5fa25f4 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:31.668876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-bcf6e1b7-e9e1-4992-987b-4cb460012736 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:36:31.675019 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 475/968] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:31.675019 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6e1b7-e9e1-4992-987b-4cb460012736 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:31.697526 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c5f91-0030-48b3-b267-8cdc6793184c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:31.698190 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c5f91-0030-48b3-b267-8cdc6793184c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:31.698486 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c5f91-0030-48b3-b267-8cdc6793184c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:31.698743 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c5f91-0030-48b3-b267-8cdc6793184c None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:31.699447 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c5f91-0030-48b3-b267-8cdc6793184c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:31.700273 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c5f91-0030-48b3-b267-8cdc6793184c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:31.701792 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c5f91-0030-48b3-b267-8cdc6793184c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:31.711582 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 494/969] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Apr 14 21:36:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:31.711582 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c5f91-0030-48b3-b267-8cdc6793184c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:31.776184 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6e1b7-e9e1-4992-987b-4cb460012736 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:31.810177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c5f91-0030-48b3-b267-8cdc6793184c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:31.815499 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751b060-e3f7-43a3-910c-65db52b49b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:31.816229 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751b060-e3f7-43a3-910c-65db52b49b9b None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:31.816518 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751b060-e3f7-43a3-910c-65db52b49b9b None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:31.816823 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751b060-e3f7-43a3-910c-65db52b49b9b None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:31.817590 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751b060-e3f7-43a3-910c-65db52b49b9b None admin] RBAC: Adding query filter params (type=compute) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:31.817944 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751b060-e3f7-43a3-910c-65db52b49b9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:31.819315 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751b060-e3f7-43a3-910c-65db52b49b9b None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:31.823716 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 476/970] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Apr 14 21:36:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:31.824522 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751b060-e3f7-43a3-910c-65db52b49b9b None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:31.861544 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a29cbb-a3c7-4108-bc1f-530651bba9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:31.862229 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a29cbb-a3c7-4108-bc1f-530651bba9f2 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:31.862512 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a29cbb-a3c7-4108-bc1f-530651bba9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:31.862850 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a29cbb-a3c7-4108-bc1f-530651bba9f2 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:31.863872 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a29cbb-a3c7-4108-bc1f-530651bba9f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:31.864061 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a29cbb-a3c7-4108-bc1f-530651bba9f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:31.865548 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a29cbb-a3c7-4108-bc1f-530651bba9f2 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:31.884243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 495/971] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:36:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:31.885768 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a29cbb-a3c7-4108-bc1f-530651bba9f2 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:31.958511 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751b060-e3f7-43a3-910c-65db52b49b9b None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:32.014164 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e947b-df30-4d02-ae62-bccef232658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:32.014969 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e947b-df30-4d02-ae62-bccef232658d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:32.015319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e947b-df30-4d02-ae62-bccef232658d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:32.015838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e947b-df30-4d02-ae62-bccef232658d None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:32.016992 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e947b-df30-4d02-ae62-bccef232658d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:32.017372 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e947b-df30-4d02-ae62-bccef232658d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:32.019253 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e947b-df30-4d02-ae62-bccef232658d None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:32.022702 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a29cbb-a3c7-4108-bc1f-530651bba9f2 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:32.026171 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 477/972] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Apr 14 21:36:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:32.032723 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e947b-df30-4d02-ae62-bccef232658d None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:32.067279 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d36096-d3f4-4f77-b27b-3aca2153653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:32.067942 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d36096-d3f4-4f77-b27b-3aca2153653c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:32.068221 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d36096-d3f4-4f77-b27b-3aca2153653c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:32.068496 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d36096-d3f4-4f77-b27b-3aca2153653c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:32.069360 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d36096-d3f4-4f77-b27b-3aca2153653c None admin] RBAC: Adding query filter params (role.id=928ab085e3e84586b2862ae16aca8595, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=1144e9036d0b4bafb30995ff1a8449ec) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:32.069667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d36096-d3f4-4f77-b27b-3aca2153653c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:32.071114 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d36096-d3f4-4f77-b27b-3aca2153653c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:32.077688 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 496/973] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:36:31 2022] GET /identity/v3/role_assignments?user.id=1144e9036d0b4bafb30995ff1a8449ec&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=928ab085e3e84586b2862ae16aca8595 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:32.155373 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e947b-df30-4d02-ae62-bccef232658d None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:32.195000 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1fbf7-da09-4efa-9be5-77c8ef0d8761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:32.195680 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1fbf7-da09-4efa-9be5-77c8ef0d8761 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:32.195963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1fbf7-da09-4efa-9be5-77c8ef0d8761 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:32.196238 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1fbf7-da09-4efa-9be5-77c8ef0d8761 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:32.197046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1fbf7-da09-4efa-9be5-77c8ef0d8761 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:32.198477 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1fbf7-da09-4efa-9be5-77c8ef0d8761 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:32.292711 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 478/974] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Apr 14 21:36:32 2022] POST /identity/v3/endpoints => generated 349 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:36:33.484729 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3901a9-4033-466f-8418-a9b5afdf81fd None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:33.485250 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3901a9-4033-466f-8418-a9b5afdf81fd None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:33.485327 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3901a9-4033-466f-8418-a9b5afdf81fd None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:33.486984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 497/975] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:33.492271 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8722ee5-a7da-424b-b4a6-2a35e2f08f31 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:33.493128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8722ee5-a7da-424b-b4a6-2a35e2f08f31 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:33.493603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8722ee5-a7da-424b-b4a6-2a35e2f08f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:33.510590 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-c8722ee5-a7da-424b-b4a6-2a35e2f08f31 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:33.512176 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c8722ee5-a7da-424b-b4a6-2a35e2f08f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:33.586183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 479/976] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:33.613573 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3901a9-4033-466f-8418-a9b5afdf81fd None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:33.717738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3901a9-4033-466f-8418-a9b5afdf81fd None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:33.753134 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841ddfc-e01f-4ee6-ade5-54c45865aaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:33.754151 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841ddfc-e01f-4ee6-ade5-54c45865aaec None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:33.754631 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841ddfc-e01f-4ee6-ade5-54c45865aaec None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:33.755104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841ddfc-e01f-4ee6-ade5-54c45865aaec None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:33.756028 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841ddfc-e01f-4ee6-ade5-54c45865aaec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:33.757683 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841ddfc-e01f-4ee6-ade5-54c45865aaec None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:33.806451 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.sql.core [None req-e841ddfc-e01f-4ee6-ade5-54c45865aaec None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 14 21:36:33.806451 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 14 21:36:33.806451 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [parameters: {'user_id': 'cf03d3f4b0e4443c9dfe3f04f9b6b1f4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 14 21:36:33.806451 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86770) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 14 21:36:33.813977 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-e841ddfc-e01f-4ee6-ade5-54c45865aaec None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 14 21:36:33.816183 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 498/977] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Apr 14 21:36:33 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:33.822804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8722ee5-a7da-424b-b4a6-2a35e2f08f31 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:33.926828 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8722ee5-a7da-424b-b4a6-2a35e2f08f31 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:33.962406 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149805a5-ca0f-41f2-aa9e-4e92a0201f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:33.963525 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149805a5-ca0f-41f2-aa9e-4e92a0201f88 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:33.963989 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149805a5-ca0f-41f2-aa9e-4e92a0201f88 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:33.964522 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149805a5-ca0f-41f2-aa9e-4e92a0201f88 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:33.972375 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149805a5-ca0f-41f2-aa9e-4e92a0201f88 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:33.974102 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149805a5-ca0f-41f2-aa9e-4e92a0201f88 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:33.990812 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-149805a5-ca0f-41f2-aa9e-4e92a0201f88 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 14 21:36:33.991143 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 480/978] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:36:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:33.997733 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841ddfc-e01f-4ee6-ade5-54c45865aaec None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:34.096525 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841ddfc-e01f-4ee6-ade5-54c45865aaec None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:34.132263 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1619804-7a97-46e1-a19e-65ee5d5d5413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:34.132966 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1619804-7a97-46e1-a19e-65ee5d5d5413 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:34.133240 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1619804-7a97-46e1-a19e-65ee5d5d5413 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:34.133510 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1619804-7a97-46e1-a19e-65ee5d5d5413 None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:34.134307 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1619804-7a97-46e1-a19e-65ee5d5d5413 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:34.134605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1619804-7a97-46e1-a19e-65ee5d5d5413 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:34.136233 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1619804-7a97-46e1-a19e-65ee5d5d5413 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:34.181840 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 499/979] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Apr 14 21:36:33 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:34.224287 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4298604-18f1-46eb-9297-da2e0deffc3a None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:34.224950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4298604-18f1-46eb-9297-da2e0deffc3a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:34.225431 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4298604-18f1-46eb-9297-da2e0deffc3a None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:34.227376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 481/980] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:34.237571 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2429d-e5b0-41f4-95c9-c1624d48e205 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:34.238266 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2429d-e5b0-41f4-95c9-c1624d48e205 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:34.238755 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2429d-e5b0-41f4-95c9-c1624d48e205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:34.258645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-eeb2429d-e5b0-41f4-95c9-c1624d48e205 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:34.260699 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-eeb2429d-e5b0-41f4-95c9-c1624d48e205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:34.345498 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 500/981] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:34.369997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4298604-18f1-46eb-9297-da2e0deffc3a None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:34.478153 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4298604-18f1-46eb-9297-da2e0deffc3a None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:34.514528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28956c8-bd85-4e62-b9a6-5a0b03f663ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:34.515294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28956c8-bd85-4e62-b9a6-5a0b03f663ad None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:34.515479 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28956c8-bd85-4e62-b9a6-5a0b03f663ad None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:34.515788 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28956c8-bd85-4e62-b9a6-5a0b03f663ad None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:34.516528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28956c8-bd85-4e62-b9a6-5a0b03f663ad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:34.517936 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28956c8-bd85-4e62-b9a6-5a0b03f663ad None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:34.572656 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882a4e9-867f-49bc-bddc-7e9fdf863ea6 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:34.573190 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882a4e9-867f-49bc-bddc-7e9fdf863ea6 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:34.573190 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882a4e9-867f-49bc-bddc-7e9fdf863ea6 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:34.574645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 501/982] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:36:34.579638 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25357e9-7626-4199-bb45-25e9e2393484 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:34.579926 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25357e9-7626-4199-bb45-25e9e2393484 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:34.580207 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25357e9-7626-4199-bb45-25e9e2393484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:34.597185 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-c25357e9-7626-4199-bb45-25e9e2393484 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:34.598422 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c25357e9-7626-4199-bb45-25e9e2393484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:34.624227 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 482/983] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Apr 14 21:36:34 2022] POST /identity/v3/services => generated 242 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:36:34.659990 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da5ad8-2042-4fff-a2c4-b14480ca1a58 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:34.660310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da5ad8-2042-4fff-a2c4-b14480ca1a58 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:34.660555 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da5ad8-2042-4fff-a2c4-b14480ca1a58 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:34.661992 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 483/984] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:36:34.667905 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed3037-67a7-4702-aed7-d8ffde14851f None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:34.668798 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed3037-67a7-4702-aed7-d8ffde14851f None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:34.669039 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed3037-67a7-4702-aed7-d8ffde14851f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:34.687049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-83ed3037-67a7-4702-aed7-d8ffde14851f None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:34.688644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 502/985] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:34.688782 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-83ed3037-67a7-4702-aed7-d8ffde14851f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:34.710447 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25357e9-7626-4199-bb45-25e9e2393484 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:34.761845 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 484/986] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:34.786423 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed3037-67a7-4702-aed7-d8ffde14851f None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:34.816452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25357e9-7626-4199-bb45-25e9e2393484 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:34.854376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53fa9b-f96e-459b-aa66-5d85a5a576b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:34.855198 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53fa9b-f96e-459b-aa66-5d85a5a576b6 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:34.855476 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53fa9b-f96e-459b-aa66-5d85a5a576b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:34.856355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53fa9b-f96e-459b-aa66-5d85a5a576b6 None admin] PATH_INFO: `/v3/services/image` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:34.857060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53fa9b-f96e-459b-aa66-5d85a5a576b6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:34.858451 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53fa9b-f96e-459b-aa66-5d85a5a576b6 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:34.869239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-dc53fa9b-f96e-459b-aa66-5d85a5a576b6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 14 21:36:34.870590 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 503/987] 10.222.0.52 () {56 vars in 1105 bytes} [Thu Apr 14 21:36:34 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:34.877940 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53fa9b-f96e-459b-aa66-5d85a5a576b6 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:34.889210 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed3037-67a7-4702-aed7-d8ffde14851f None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:34.926493 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9454af-3b60-47c8-b152-586a0f53784b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:34.927316 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9454af-3b60-47c8-b152-586a0f53784b None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:34.927597 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9454af-3b60-47c8-b152-586a0f53784b None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:34.927871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9454af-3b60-47c8-b152-586a0f53784b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:34.928541 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9454af-3b60-47c8-b152-586a0f53784b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:34.930026 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9454af-3b60-47c8-b152-586a0f53784b None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:34.942318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-7a9454af-3b60-47c8-b152-586a0f53784b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 14 21:36:34.943813 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 485/988] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Apr 14 21:36:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:34.950870 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9454af-3b60-47c8-b152-586a0f53784b None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:35.059738 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9454af-3b60-47c8-b152-586a0f53784b None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:35.093776 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b80586-f3ca-43ae-bd1a-f33004d6e2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:35.094431 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b80586-f3ca-43ae-bd1a-f33004d6e2a5 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:35.094709 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b80586-f3ca-43ae-bd1a-f33004d6e2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:35.094979 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b80586-f3ca-43ae-bd1a-f33004d6e2a5 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:35.095675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b80586-f3ca-43ae-bd1a-f33004d6e2a5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:35.096128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b80586-f3ca-43ae-bd1a-f33004d6e2a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:35.097359 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b80586-f3ca-43ae-bd1a-f33004d6e2a5 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:35.101613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53fa9b-f96e-459b-aa66-5d85a5a576b6 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:35.106792 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 486/989] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Apr 14 21:36:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:35.107765 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b80586-f3ca-43ae-bd1a-f33004d6e2a5 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:35.135011 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b6296-cbd9-48e9-a216-cdfb33877655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:35.135602 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b6296-cbd9-48e9-a216-cdfb33877655 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:35.135883 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b6296-cbd9-48e9-a216-cdfb33877655 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:35.136156 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b6296-cbd9-48e9-a216-cdfb33877655 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:35.136895 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b6296-cbd9-48e9-a216-cdfb33877655 None admin] RBAC: Adding query filter params (name=image) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:35.137356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b6296-cbd9-48e9-a216-cdfb33877655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:35.138715 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b6296-cbd9-48e9-a216-cdfb33877655 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:35.148015 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 504/990] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:35.148905 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b6296-cbd9-48e9-a216-cdfb33877655 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:35.207039 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b80586-f3ca-43ae-bd1a-f33004d6e2a5 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:35.241487 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cc431-8d23-4d83-b42e-f95d1fe13266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:35.242138 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cc431-8d23-4d83-b42e-f95d1fe13266 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:35.242414 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cc431-8d23-4d83-b42e-f95d1fe13266 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:35.242681 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cc431-8d23-4d83-b42e-f95d1fe13266 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:35.243383 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cc431-8d23-4d83-b42e-f95d1fe13266 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:35.243684 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cc431-8d23-4d83-b42e-f95d1fe13266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:35.245072 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cc431-8d23-4d83-b42e-f95d1fe13266 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:35.248294 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b6296-cbd9-48e9-a216-cdfb33877655 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:35.250841 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 487/991] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Apr 14 21:36:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:35.256419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cc431-8d23-4d83-b42e-f95d1fe13266 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:35.285698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f747e-90a6-41cb-8505-7752a9fa9548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:35.286365 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f747e-90a6-41cb-8505-7752a9fa9548 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:35.286645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f747e-90a6-41cb-8505-7752a9fa9548 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:35.286918 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f747e-90a6-41cb-8505-7752a9fa9548 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:35.287664 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f747e-90a6-41cb-8505-7752a9fa9548 None admin] RBAC: Adding query filter params (type=image) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:35.287951 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f747e-90a6-41cb-8505-7752a9fa9548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:35.289351 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f747e-90a6-41cb-8505-7752a9fa9548 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:35.293664 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 505/992] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:35.364898 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cc431-8d23-4d83-b42e-f95d1fe13266 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:35.400185 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7633e5-423b-44e8-a34a-6d7b49beb928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:35.401231 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7633e5-423b-44e8-a34a-6d7b49beb928 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:35.401717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7633e5-423b-44e8-a34a-6d7b49beb928 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:35.402229 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7633e5-423b-44e8-a34a-6d7b49beb928 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:35.403819 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7633e5-423b-44e8-a34a-6d7b49beb928 None admin] RBAC: Adding query filter params (interface=admin, service_id=662aa023234b47f2a64cc48830c2b828, region_id=RegionOne) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:35.404382 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7633e5-423b-44e8-a34a-6d7b49beb928 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:35.406051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7633e5-423b-44e8-a34a-6d7b49beb928 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:35.412434 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 488/993] 10.222.0.52 () {56 vars in 1249 bytes} [Thu Apr 14 21:36:35 2022] GET /identity/v3/endpoints?service_id=662aa023234b47f2a64cc48830c2b828&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:35.417711 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f747e-90a6-41cb-8505-7752a9fa9548 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:35.520545 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f747e-90a6-41cb-8505-7752a9fa9548 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:35.553560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1f6c6-bc73-47f5-a60d-72bcfcdd3b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:35.554220 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1f6c6-bc73-47f5-a60d-72bcfcdd3b6e None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:35.554494 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1f6c6-bc73-47f5-a60d-72bcfcdd3b6e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:35.554759 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1f6c6-bc73-47f5-a60d-72bcfcdd3b6e None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:35.555433 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1f6c6-bc73-47f5-a60d-72bcfcdd3b6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:35.556818 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1f6c6-bc73-47f5-a60d-72bcfcdd3b6e None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:35.563841 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 506/994] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Apr 14 21:36:35 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:36:37.001437 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4723fe8-379d-4521-8e89-ad5a0417fc88 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:37.001898 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4723fe8-379d-4521-8e89-ad5a0417fc88 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:37.001974 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4723fe8-379d-4521-8e89-ad5a0417fc88 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:37.003352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 489/995] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:37.008732 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d8a89-af84-4217-957b-469d48d439f8 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:37.009130 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d8a89-af84-4217-957b-469d48d439f8 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:37.009332 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d8a89-af84-4217-957b-469d48d439f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:37.027160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-642d8a89-af84-4217-957b-469d48d439f8 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:37.029132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-642d8a89-af84-4217-957b-469d48d439f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:37.093797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 507/996] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:37.117388 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4723fe8-379d-4521-8e89-ad5a0417fc88 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:37.217025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4723fe8-379d-4521-8e89-ad5a0417fc88 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:37.259888 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd69a92-923b-4056-b566-2aab286ff89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:37.263582 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd69a92-923b-4056-b566-2aab286ff89c None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:37.263884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd69a92-923b-4056-b566-2aab286ff89c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:37.264132 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd69a92-923b-4056-b566-2aab286ff89c None admin] PATH_INFO: `/v3/services/compute` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:37.264849 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd69a92-923b-4056-b566-2aab286ff89c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:37.266255 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd69a92-923b-4056-b566-2aab286ff89c None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:37.278531 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-dfd69a92-923b-4056-b566-2aab286ff89c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 14 21:36:37.279922 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 490/997] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:37.285719 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d8a89-af84-4217-957b-469d48d439f8 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:37.382875 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d8a89-af84-4217-957b-469d48d439f8 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:37.415455 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19dc39-117f-4e01-bda4-05c9784e37e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:37.416114 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19dc39-117f-4e01-bda4-05c9784e37e7 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:37.416388 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19dc39-117f-4e01-bda4-05c9784e37e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:37.416683 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19dc39-117f-4e01-bda4-05c9784e37e7 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:37.417380 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19dc39-117f-4e01-bda4-05c9784e37e7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:37.417696 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19dc39-117f-4e01-bda4-05c9784e37e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:37.419890 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19dc39-117f-4e01-bda4-05c9784e37e7 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:37.424627 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 508/998] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Apr 14 21:36:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:37.430002 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd69a92-923b-4056-b566-2aab286ff89c None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:37.533349 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd69a92-923b-4056-b566-2aab286ff89c None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:37.565564 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06daf5c3-69a2-43f5-b017-c3407890e33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:37.566222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daf5c3-69a2-43f5-b017-c3407890e33f None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:37.566498 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daf5c3-69a2-43f5-b017-c3407890e33f None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:37.566767 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daf5c3-69a2-43f5-b017-c3407890e33f None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:37.567465 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06daf5c3-69a2-43f5-b017-c3407890e33f None admin] RBAC: Adding query filter params (type=compute) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:37.567767 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06daf5c3-69a2-43f5-b017-c3407890e33f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:37.569175 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06daf5c3-69a2-43f5-b017-c3407890e33f None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:37.574172 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 491/999] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Apr 14 21:36:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:37.580670 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19dc39-117f-4e01-bda4-05c9784e37e7 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:37.624321 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29611176-8136-4793-98ad-be7fe675a34e None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:37.624658 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29611176-8136-4793-98ad-be7fe675a34e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:37.624895 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29611176-8136-4793-98ad-be7fe675a34e None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:37.626520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 492/1000] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:36:37.631317 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5413117-9feb-4b77-b237-1d07c9efd9e9 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:37.631600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5413117-9feb-4b77-b237-1d07c9efd9e9 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:37.631880 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5413117-9feb-4b77-b237-1d07c9efd9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:37.649023 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-b5413117-9feb-4b77-b237-1d07c9efd9e9 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:37.650215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b5413117-9feb-4b77-b237-1d07c9efd9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:37.678458 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19dc39-117f-4e01-bda4-05c9784e37e7 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:37.712349 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154c93c-4185-4983-82fe-98c52c01d4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:37.713189 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154c93c-4185-4983-82fe-98c52c01d4e0 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:37.713778 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154c93c-4185-4983-82fe-98c52c01d4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:37.714186 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154c93c-4185-4983-82fe-98c52c01d4e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:37.715679 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154c93c-4185-4983-82fe-98c52c01d4e0 None admin] RBAC: Adding query filter params (interface=public, service_id=209f95fffb36499db4900150dbcb51c5, region_id=RegionOne) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:37.715990 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154c93c-4185-4983-82fe-98c52c01d4e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:37.717379 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154c93c-4185-4983-82fe-98c52c01d4e0 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:37.718873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 493/1001] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:37.723741 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 509/1002] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Apr 14 21:36:37 2022] GET /identity/v3/endpoints?service_id=209f95fffb36499db4900150dbcb51c5&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:37.729012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5413117-9feb-4b77-b237-1d07c9efd9e9 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:37.742907 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154c93c-4185-4983-82fe-98c52c01d4e0 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:37.828049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5413117-9feb-4b77-b237-1d07c9efd9e9 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:37.847697 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154c93c-4185-4983-82fe-98c52c01d4e0 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:37.861802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a909e-c8e0-4cf8-a6c9-55886be99654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:37.862464 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a909e-c8e0-4cf8-a6c9-55886be99654 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:37.862744 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a909e-c8e0-4cf8-a6c9-55886be99654 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:37.863017 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a909e-c8e0-4cf8-a6c9-55886be99654 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:37.863694 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a909e-c8e0-4cf8-a6c9-55886be99654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:37.865102 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a909e-c8e0-4cf8-a6c9-55886be99654 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:37.871619 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 494/1003] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Apr 14 21:36:37 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:36:37.883968 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc7a6c-7ced-4286-93bf-b66ff4975fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:37.884998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc7a6c-7ced-4286-93bf-b66ff4975fde None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:37.885539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc7a6c-7ced-4286-93bf-b66ff4975fde None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:37.886031 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc7a6c-7ced-4286-93bf-b66ff4975fde None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:37.887603 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc7a6c-7ced-4286-93bf-b66ff4975fde None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:37.888282 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95319c6b-fd16-4ec6-8639-6d1791db5c51 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:37.888596 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95319c6b-fd16-4ec6-8639-6d1791db5c51 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:37.888878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95319c6b-fd16-4ec6-8639-6d1791db5c51 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:37.889811 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc7a6c-7ced-4286-93bf-b66ff4975fde None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:37.890307 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 495/1004] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:36:37.896225 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ed14-ce29-49ee-99cf-ffb329206fb3 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:37.896507 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ed14-ce29-49ee-99cf-ffb329206fb3 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:37.896847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ed14-ce29-49ee-99cf-ffb329206fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:37.915587 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-3799ed14-ce29-49ee-99cf-ffb329206fb3 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:37.916846 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-3799ed14-ce29-49ee-99cf-ffb329206fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:37.986563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 510/1005] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Apr 14 21:36:37 2022] POST /identity/v3/services => generated 242 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:36:38.001965 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 496/1006] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:37 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:38.026819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc7a6c-7ced-4286-93bf-b66ff4975fde None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:38.138295 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc7a6c-7ced-4286-93bf-b66ff4975fde None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:38.175492 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7fa47-87a1-4e35-8497-c9500ace93f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:38.176542 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7fa47-87a1-4e35-8497-c9500ace93f8 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:38.176781 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7fa47-87a1-4e35-8497-c9500ace93f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:38.177045 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7fa47-87a1-4e35-8497-c9500ace93f8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:38.177715 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7fa47-87a1-4e35-8497-c9500ace93f8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:38.179107 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7fa47-87a1-4e35-8497-c9500ace93f8 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:38.190989 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-f0f7fa47-87a1-4e35-8497-c9500ace93f8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 14 21:36:38.192529 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 511/1007] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Apr 14 21:36:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:38.198482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799ed14-ce29-49ee-99cf-ffb329206fb3 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:38.302579 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799ed14-ce29-49ee-99cf-ffb329206fb3 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:38.337206 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a10dd-ff3a-4c42-aba4-620ae6406ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:38.337869 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a10dd-ff3a-4c42-aba4-620ae6406ced None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:38.338151 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a10dd-ff3a-4c42-aba4-620ae6406ced None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:38.338427 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a10dd-ff3a-4c42-aba4-620ae6406ced None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:38.339137 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a10dd-ff3a-4c42-aba4-620ae6406ced None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:38.339466 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a10dd-ff3a-4c42-aba4-620ae6406ced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:38.341418 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a10dd-ff3a-4c42-aba4-620ae6406ced None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:38.346631 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 497/1008] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Apr 14 21:36:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:38.352088 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7fa47-87a1-4e35-8497-c9500ace93f8 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:38.455127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7fa47-87a1-4e35-8497-c9500ace93f8 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:38.487730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8608c-f033-49e7-95a4-4d10ae4957fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:38.488426 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8608c-f033-49e7-95a4-4d10ae4957fc None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:38.488706 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8608c-f033-49e7-95a4-4d10ae4957fc None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:38.488984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8608c-f033-49e7-95a4-4d10ae4957fc None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:38.489688 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8608c-f033-49e7-95a4-4d10ae4957fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:38.489994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8608c-f033-49e7-95a4-4d10ae4957fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:38.491356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8608c-f033-49e7-95a4-4d10ae4957fc None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:38.501050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 512/1009] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Apr 14 21:36:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:38.502363 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a10dd-ff3a-4c42-aba4-620ae6406ced None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:38.599689 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a10dd-ff3a-4c42-aba4-620ae6406ced None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:38.633020 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48df8a-48eb-4fc9-bcc4-f1dee366784e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:38.633675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48df8a-48eb-4fc9-bcc4-f1dee366784e None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:38.633953 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48df8a-48eb-4fc9-bcc4-f1dee366784e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:38.634225 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48df8a-48eb-4fc9-bcc4-f1dee366784e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:38.634973 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48df8a-48eb-4fc9-bcc4-f1dee366784e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:38.636326 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48df8a-48eb-4fc9-bcc4-f1dee366784e None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:38.725688 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 498/1010] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Apr 14 21:36:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:36:40.193959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11266-43b3-4b02-8896-8cbd9af59275 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:40.194492 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11266-43b3-4b02-8896-8cbd9af59275 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:40.194492 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11266-43b3-4b02-8896-8cbd9af59275 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:40.195997 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 513/1011] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:40.201169 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ee67a-c02e-45ad-9039-5bf9a13cb5f5 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:40.201588 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ee67a-c02e-45ad-9039-5bf9a13cb5f5 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:40.201761 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ee67a-c02e-45ad-9039-5bf9a13cb5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:40.218774 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-335ee67a-c02e-45ad-9039-5bf9a13cb5f5 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:40.219968 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-335ee67a-c02e-45ad-9039-5bf9a13cb5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:40.292360 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 499/1012] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:40 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:40.317996 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b11266-43b3-4b02-8896-8cbd9af59275 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:40.406104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759ad4-5de4-49a0-a7de-55e2fd9492fc None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:40.406443 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759ad4-5de4-49a0-a7de-55e2fd9492fc None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:40.406662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759ad4-5de4-49a0-a7de-55e2fd9492fc None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:40.408268 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 500/1013] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:36:40.412941 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9aa14-23e7-4fd1-b39a-3bc3c39ab480 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:40.413226 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9aa14-23e7-4fd1-b39a-3bc3c39ab480 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:40.413503 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9aa14-23e7-4fd1-b39a-3bc3c39ab480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:40.416722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b11266-43b3-4b02-8896-8cbd9af59275 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:40.430628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-29c9aa14-23e7-4fd1-b39a-3bc3c39ab480 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:40.431794 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-29c9aa14-23e7-4fd1-b39a-3bc3c39ab480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:40.451948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4c81e-b748-402a-94b6-850ab26b7d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:40.452929 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4c81e-b748-402a-94b6-850ab26b7d5d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:40.453061 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4c81e-b748-402a-94b6-850ab26b7d5d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:40.453284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4c81e-b748-402a-94b6-850ab26b7d5d None admin] PATH_INFO: `/v3/services/compute` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:40.453925 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4c81e-b748-402a-94b6-850ab26b7d5d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:40.455281 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4c81e-b748-402a-94b6-850ab26b7d5d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:40.466421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-2fd4c81e-b748-402a-94b6-850ab26b7d5d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 14 21:36:40.467613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 514/1014] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:40.473510 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4c81e-b748-402a-94b6-850ab26b7d5d None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:40.504321 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 501/1015] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:40 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:40.524869 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9aa14-23e7-4fd1-b39a-3bc3c39ab480 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:40.573782 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4c81e-b748-402a-94b6-850ab26b7d5d None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:40.607025 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7e805-31eb-419e-9718-9d222b1e36ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:40.607703 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7e805-31eb-419e-9718-9d222b1e36ee None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:40.607980 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7e805-31eb-419e-9718-9d222b1e36ee None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:40.608251 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7e805-31eb-419e-9718-9d222b1e36ee None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:40.608988 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7e805-31eb-419e-9718-9d222b1e36ee None admin] RBAC: Adding query filter params (name=compute) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:40.609297 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7e805-31eb-419e-9718-9d222b1e36ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:40.610707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7e805-31eb-419e-9718-9d222b1e36ee None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:40.620206 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 515/1016] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Apr 14 21:36:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:40.621709 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7e805-31eb-419e-9718-9d222b1e36ee None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:40.631132 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9aa14-23e7-4fd1-b39a-3bc3c39ab480 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:40.665195 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab9a2f-2dd8-40f1-b1ca-1102df46c53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:40.666136 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab9a2f-2dd8-40f1-b1ca-1102df46c53d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:40.666421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab9a2f-2dd8-40f1-b1ca-1102df46c53d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:40.666704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab9a2f-2dd8-40f1-b1ca-1102df46c53d None admin] PATH_INFO: `/v3/services/image` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:40.667374 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab9a2f-2dd8-40f1-b1ca-1102df46c53d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:40.669677 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab9a2f-2dd8-40f1-b1ca-1102df46c53d None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:40.681230 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-14ab9a2f-2dd8-40f1-b1ca-1102df46c53d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 14 21:36:40.682778 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 502/1017] 10.222.0.52 () {56 vars in 1105 bytes} [Thu Apr 14 21:36:40 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:40.689812 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab9a2f-2dd8-40f1-b1ca-1102df46c53d None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:40.725573 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7e805-31eb-419e-9718-9d222b1e36ee None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:40.759594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdc533-0d07-4511-b464-fbf49e9c1fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:40.760265 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdc533-0d07-4511-b464-fbf49e9c1fb1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:40.760543 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdc533-0d07-4511-b464-fbf49e9c1fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:40.760839 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdc533-0d07-4511-b464-fbf49e9c1fb1 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:40.761564 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdc533-0d07-4511-b464-fbf49e9c1fb1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:40.762383 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdc533-0d07-4511-b464-fbf49e9c1fb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:40.763750 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdc533-0d07-4511-b464-fbf49e9c1fb1 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:40.769691 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 516/1018] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Apr 14 21:36:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:40.774684 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdc533-0d07-4511-b464-fbf49e9c1fb1 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:40.791539 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab9a2f-2dd8-40f1-b1ca-1102df46c53d None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:40.826721 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d89338-11d7-4ee5-a176-4d2f7a26faa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:40.827308 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d89338-11d7-4ee5-a176-4d2f7a26faa2 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:40.827581 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d89338-11d7-4ee5-a176-4d2f7a26faa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:40.827920 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d89338-11d7-4ee5-a176-4d2f7a26faa2 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:40.828545 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d89338-11d7-4ee5-a176-4d2f7a26faa2 None admin] RBAC: Adding query filter params (name=image) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:40.828935 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d89338-11d7-4ee5-a176-4d2f7a26faa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:40.830292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d89338-11d7-4ee5-a176-4d2f7a26faa2 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:40.835362 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 503/1019] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:40.841040 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d89338-11d7-4ee5-a176-4d2f7a26faa2 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:40.873410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdc533-0d07-4511-b464-fbf49e9c1fb1 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:40.906535 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc58892-50ed-4c9b-b18f-f64761d265d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:40.907193 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc58892-50ed-4c9b-b18f-f64761d265d2 None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:40.907472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc58892-50ed-4c9b-b18f-f64761d265d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:40.907744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc58892-50ed-4c9b-b18f-f64761d265d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:40.908481 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc58892-50ed-4c9b-b18f-f64761d265d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:40.909866 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc58892-50ed-4c9b-b18f-f64761d265d2 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:40.939081 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d89338-11d7-4ee5-a176-4d2f7a26faa2 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:40.972544 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949fdd1-ed86-494b-b23d-3fa575011c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:40.973234 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949fdd1-ed86-494b-b23d-3fa575011c58 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:40.973517 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949fdd1-ed86-494b-b23d-3fa575011c58 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:40.973790 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949fdd1-ed86-494b-b23d-3fa575011c58 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:40.974495 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949fdd1-ed86-494b-b23d-3fa575011c58 None admin] RBAC: Adding query filter params (type=image) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:40.974801 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949fdd1-ed86-494b-b23d-3fa575011c58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:40.976306 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949fdd1-ed86-494b-b23d-3fa575011c58 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:40.981836 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 504/1020] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:40.987301 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949fdd1-ed86-494b-b23d-3fa575011c58 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:41.086577 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949fdd1-ed86-494b-b23d-3fa575011c58 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:41.118460 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616bf09-2c58-4856-99a8-cb65ac2f79a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:41.119115 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616bf09-2c58-4856-99a8-cb65ac2f79a3 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:41.119398 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616bf09-2c58-4856-99a8-cb65ac2f79a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:41.119672 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616bf09-2c58-4856-99a8-cb65ac2f79a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:41.120460 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616bf09-2c58-4856-99a8-cb65ac2f79a3 None admin] RBAC: Adding query filter params (interface=public, service_id=71c10155dffc407488cb46552dcc1b85, region_id=RegionOne) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:41.120794 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616bf09-2c58-4856-99a8-cb65ac2f79a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:41.122713 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616bf09-2c58-4856-99a8-cb65ac2f79a3 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:41.131966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 505/1021] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Apr 14 21:36:40 2022] GET /identity/v3/endpoints?service_id=71c10155dffc407488cb46552dcc1b85&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:41.131966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e1bb5-b384-4905-ad5c-c4bb6cfb4eb1 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:41.131966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e1bb5-b384-4905-ad5c-c4bb6cfb4eb1 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:41.131966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e1bb5-b384-4905-ad5c-c4bb6cfb4eb1 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:41.131966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 506/1022] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:41.132879 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e1bb5-b384-4905-ad5c-c4bb6cfb4eb1 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:41.144182 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 517/1023] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Apr 14 21:36:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:36:41.147018 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cb20a-1d0e-451a-86e5-a2a8d4567e72 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:41.147373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cb20a-1d0e-451a-86e5-a2a8d4567e72 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:41.147631 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cb20a-1d0e-451a-86e5-a2a8d4567e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:41.165248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-922cb20a-1d0e-451a-86e5-a2a8d4567e72 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:41.166470 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-922cb20a-1d0e-451a-86e5-a2a8d4567e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:41.247160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 518/1024] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:41.250502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e1bb5-b384-4905-ad5c-c4bb6cfb4eb1 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:41.272304 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cb20a-1d0e-451a-86e5-a2a8d4567e72 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:41.286824 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265acd0e-b3a6-47cb-87f7-fc9ca871ec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:41.287514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265acd0e-b3a6-47cb-87f7-fc9ca871ec37 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:41.287793 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265acd0e-b3a6-47cb-87f7-fc9ca871ec37 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:41.288067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265acd0e-b3a6-47cb-87f7-fc9ca871ec37 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:41.288804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265acd0e-b3a6-47cb-87f7-fc9ca871ec37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:41.290183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265acd0e-b3a6-47cb-87f7-fc9ca871ec37 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:41.298018 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 507/1025] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Apr 14 21:36:41 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:36:41.390114 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cb20a-1d0e-451a-86e5-a2a8d4567e72 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:41.428328 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26714c4-dc10-441d-904f-9fd9d93a8c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:41.429205 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26714c4-dc10-441d-904f-9fd9d93a8c77 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:41.429488 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26714c4-dc10-441d-904f-9fd9d93a8c77 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:41.429761 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26714c4-dc10-441d-904f-9fd9d93a8c77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:41.431021 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26714c4-dc10-441d-904f-9fd9d93a8c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:41.432487 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26714c4-dc10-441d-904f-9fd9d93a8c77 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:41.435443 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 519/1026] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:41.441626 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265acd0e-b3a6-47cb-87f7-fc9ca871ec37 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:41.546934 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265acd0e-b3a6-47cb-87f7-fc9ca871ec37 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:41.581265 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11763f0-2348-48b4-b46b-b29fbbcb001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:41.581971 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11763f0-2348-48b4-b46b-b29fbbcb001f None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:41.582236 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11763f0-2348-48b4-b46b-b29fbbcb001f None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:41.582506 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11763f0-2348-48b4-b46b-b29fbbcb001f None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:41.583228 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11763f0-2348-48b4-b46b-b29fbbcb001f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:41.584692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11763f0-2348-48b4-b46b-b29fbbcb001f None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:41.692893 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 508/1027] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Apr 14 21:36:41 2022] POST /identity/v3/projects => generated 311 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:36:43.584510 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b7653-2da8-4c1d-be04-3727992db307 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:43.585454 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b7653-2da8-4c1d-be04-3727992db307 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:43.585454 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b7653-2da8-4c1d-be04-3727992db307 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:43.590976 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 520/1028] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:43.593015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec6dd6-2f72-4f3f-b9fb-37a133309a22 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:43.593421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec6dd6-2f72-4f3f-b9fb-37a133309a22 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:43.593601 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec6dd6-2f72-4f3f-b9fb-37a133309a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:43.622237 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-78ec6dd6-2f72-4f3f-b9fb-37a133309a22 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:43.623872 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-78ec6dd6-2f72-4f3f-b9fb-37a133309a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:43.634707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c256a-f28c-41c3-8ae6-a2b110d88f19 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:43.634707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c256a-f28c-41c3-8ae6-a2b110d88f19 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:43.634707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c256a-f28c-41c3-8ae6-a2b110d88f19 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:43.636010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 521/1029] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:36:43.642524 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4499ff-b9c5-4578-b1b7-872d302a929d None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:43.642790 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4499ff-b9c5-4578-b1b7-872d302a929d None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:43.643060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4499ff-b9c5-4578-b1b7-872d302a929d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:43.660768 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-cf4499ff-b9c5-4578-b1b7-872d302a929d None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:43.661953 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-cf4499ff-b9c5-4578-b1b7-872d302a929d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:43.701401 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 509/1030] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:43.728344 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec6dd6-2f72-4f3f-b9fb-37a133309a22 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:43.735917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 522/1031] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:43.760652 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4499ff-b9c5-4578-b1b7-872d302a929d None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:43.836862 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec6dd6-2f72-4f3f-b9fb-37a133309a22 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:43.869002 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4499ff-b9c5-4578-b1b7-872d302a929d None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:43.876453 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d139cee-b56c-4575-b2ca-804c2a22abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:43.877945 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d139cee-b56c-4575-b2ca-804c2a22abc3 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:43.878814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d139cee-b56c-4575-b2ca-804c2a22abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:43.879085 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d139cee-b56c-4575-b2ca-804c2a22abc3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:43.891505 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d139cee-b56c-4575-b2ca-804c2a22abc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:43.899055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-0d139cee-b56c-4575-b2ca-804c2a22abc3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 14 21:36:43.900426 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 510/1032] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Apr 14 21:36:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:43.906936 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d139cee-b56c-4575-b2ca-804c2a22abc3 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:43.915195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5ace1-bc42-40c0-8f33-b800a3a91526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:43.916539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ace1-bc42-40c0-8f33-b800a3a91526 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:43.917035 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ace1-bc42-40c0-8f33-b800a3a91526 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:43.918648 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ace1-bc42-40c0-8f33-b800a3a91526 None admin] PATH_INFO: `/v3/services/image` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:43.921433 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5ace1-bc42-40c0-8f33-b800a3a91526 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:43.922843 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5ace1-bc42-40c0-8f33-b800a3a91526 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:43.934056 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-99e5ace1-bc42-40c0-8f33-b800a3a91526 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 14 21:36:43.935594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 523/1033] 10.222.0.52 () {56 vars in 1105 bytes} [Thu Apr 14 21:36:43 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:43.941470 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5ace1-bc42-40c0-8f33-b800a3a91526 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:44.018785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d139cee-b56c-4575-b2ca-804c2a22abc3 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:44.053828 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5ace1-bc42-40c0-8f33-b800a3a91526 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:44.056424 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c5120-594b-4cda-8e03-a614f6b22ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:44.057131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c5120-594b-4cda-8e03-a614f6b22ff7 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:44.057414 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c5120-594b-4cda-8e03-a614f6b22ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:44.057747 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c5120-594b-4cda-8e03-a614f6b22ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:44.058490 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c5120-594b-4cda-8e03-a614f6b22ff7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:44.058799 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c5120-594b-4cda-8e03-a614f6b22ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:44.060176 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c5120-594b-4cda-8e03-a614f6b22ff7 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:44.073147 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 511/1034] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Apr 14 21:36:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:44.073953 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c5120-594b-4cda-8e03-a614f6b22ff7 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:44.087671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc0922-8427-4828-a5cf-cef8c405ac30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:44.088273 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc0922-8427-4828-a5cf-cef8c405ac30 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:44.088557 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc0922-8427-4828-a5cf-cef8c405ac30 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:44.088862 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc0922-8427-4828-a5cf-cef8c405ac30 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:44.090216 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc0922-8427-4828-a5cf-cef8c405ac30 None admin] RBAC: Adding query filter params (name=image) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:44.090571 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc0922-8427-4828-a5cf-cef8c405ac30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:44.092012 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc0922-8427-4828-a5cf-cef8c405ac30 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:44.096912 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 524/1035] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:44.101688 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78765035-6d88-495a-ab8f-3e06cac0d260 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:44.101980 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78765035-6d88-495a-ab8f-3e06cac0d260 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:44.102269 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78765035-6d88-495a-ab8f-3e06cac0d260 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:44.103539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 525/1036] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:44.104234 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78765035-6d88-495a-ab8f-3e06cac0d260 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:44.174509 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c5120-594b-4cda-8e03-a614f6b22ff7 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:44.202272 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78765035-6d88-495a-ab8f-3e06cac0d260 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:44.207099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968461c-ddf3-4580-aa69-73d7a3da449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:44.207879 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968461c-ddf3-4580-aa69-73d7a3da449c None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:44.208161 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968461c-ddf3-4580-aa69-73d7a3da449c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:44.208435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968461c-ddf3-4580-aa69-73d7a3da449c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:44.219415 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968461c-ddf3-4580-aa69-73d7a3da449c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:44.220905 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968461c-ddf3-4580-aa69-73d7a3da449c None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:44.235388 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c73f21-1bf2-4490-805d-da285484697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:44.236049 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c73f21-1bf2-4490-805d-da285484697e None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:44.236332 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c73f21-1bf2-4490-805d-da285484697e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:44.236646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c73f21-1bf2-4490-805d-da285484697e None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:44.236905 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-b968461c-ddf3-4580-aa69-73d7a3da449c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:44.237354 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c73f21-1bf2-4490-805d-da285484697e None admin] RBAC: Adding query filter params (type=image) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:44.237661 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c73f21-1bf2-4490-805d-da285484697e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:44.238088 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 512/1037] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:44.239024 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c73f21-1bf2-4490-805d-da285484697e None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:44.239317 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0993e7e-0fb2-454c-a25c-684624acb7cb None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:44.239603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0993e7e-0fb2-454c-a25c-684624acb7cb None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:44.239876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0993e7e-0fb2-454c-a25c-684624acb7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:44.246630 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 526/1038] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:44.247410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c73f21-1bf2-4490-805d-da285484697e None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:44.256053 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-f0993e7e-0fb2-454c-a25c-684624acb7cb None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:44.257274 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f0993e7e-0fb2-454c-a25c-684624acb7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:44.320475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 513/1039] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:44.321142 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0993e7e-0fb2-454c-a25c-684624acb7cb None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:44.344504 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c73f21-1bf2-4490-805d-da285484697e None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:44.377214 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6048ce-a45b-47b4-8b0f-c43df2c9ba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:44.377962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6048ce-a45b-47b4-8b0f-c43df2c9ba10 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:44.378307 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6048ce-a45b-47b4-8b0f-c43df2c9ba10 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:44.378582 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6048ce-a45b-47b4-8b0f-c43df2c9ba10 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:44.379297 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6048ce-a45b-47b4-8b0f-c43df2c9ba10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:44.379598 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6048ce-a45b-47b4-8b0f-c43df2c9ba10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:44.380983 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6048ce-a45b-47b4-8b0f-c43df2c9ba10 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:44.392252 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 527/1040] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:44.393075 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6048ce-a45b-47b4-8b0f-c43df2c9ba10 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:44.419151 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0993e7e-0fb2-454c-a25c-684624acb7cb None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:44.451893 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2ad8c-ecfe-41be-80cc-de9e4039c04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:44.452543 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2ad8c-ecfe-41be-80cc-de9e4039c04a None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:44.452858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2ad8c-ecfe-41be-80cc-de9e4039c04a None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:44.453131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2ad8c-ecfe-41be-80cc-de9e4039c04a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:44.453873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2ad8c-ecfe-41be-80cc-de9e4039c04a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:44.455263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2ad8c-ecfe-41be-80cc-de9e4039c04a None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:44.488664 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6048ce-a45b-47b4-8b0f-c43df2c9ba10 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:44.520241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db8afe-feee-4716-ab57-8129ba1fa379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:44.521048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db8afe-feee-4716-ab57-8129ba1fa379 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:44.521325 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db8afe-feee-4716-ab57-8129ba1fa379 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:44.521592 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db8afe-feee-4716-ab57-8129ba1fa379 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:44.522757 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db8afe-feee-4716-ab57-8129ba1fa379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:44.524173 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db8afe-feee-4716-ab57-8129ba1fa379 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:44.525788 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 528/1041] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:44.526528 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db8afe-feee-4716-ab57-8129ba1fa379 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:44.539379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 514/1042] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Apr 14 21:36:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:36:44.540160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2ad8c-ecfe-41be-80cc-de9e4039c04a None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:44.634087 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db8afe-feee-4716-ab57-8129ba1fa379 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:44.663637 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2ad8c-ecfe-41be-80cc-de9e4039c04a None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:44.670283 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851a1f8-d3c1-4c41-a0bf-25b9d5d36f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:44.671102 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851a1f8-d3c1-4c41-a0bf-25b9d5d36f1d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:44.671378 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851a1f8-d3c1-4c41-a0bf-25b9d5d36f1d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:44.671646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851a1f8-d3c1-4c41-a0bf-25b9d5d36f1d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:44.680181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851a1f8-d3c1-4c41-a0bf-25b9d5d36f1d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:44.681689 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851a1f8-d3c1-4c41-a0bf-25b9d5d36f1d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:44.701626 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdd3c7-183e-49c1-b41e-2dcce6332719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:44.702115 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-8851a1f8-d3c1-4c41-a0bf-25b9d5d36f1d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 14 21:36:44.702312 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdd3c7-183e-49c1-b41e-2dcce6332719 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:44.702582 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdd3c7-183e-49c1-b41e-2dcce6332719 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:44.702853 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdd3c7-183e-49c1-b41e-2dcce6332719 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:44.703573 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdd3c7-183e-49c1-b41e-2dcce6332719 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:44.704778 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 529/1043] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Apr 14 21:36:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:44.705077 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdd3c7-183e-49c1-b41e-2dcce6332719 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:44.710811 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851a1f8-d3c1-4c41-a0bf-25b9d5d36f1d None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:44.810437 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 515/1044] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:36:44 2022] POST /identity/v3/users => generated 285 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:36:44.812908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851a1f8-d3c1-4c41-a0bf-25b9d5d36f1d None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:44.850998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e08c24-4a17-4178-88d0-70b89fd329be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:44.851690 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e08c24-4a17-4178-88d0-70b89fd329be None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:44.851966 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e08c24-4a17-4178-88d0-70b89fd329be None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:44.852241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e08c24-4a17-4178-88d0-70b89fd329be None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:44.853134 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e08c24-4a17-4178-88d0-70b89fd329be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:44.853445 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e08c24-4a17-4178-88d0-70b89fd329be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:44.854955 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e08c24-4a17-4178-88d0-70b89fd329be None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:44.875797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 530/1045] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Apr 14 21:36:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:44.881683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdd3c7-183e-49c1-b41e-2dcce6332719 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:44.989230 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdd3c7-183e-49c1-b41e-2dcce6332719 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:45.028953 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097552d3-f6f5-4349-8458-16f19f01685b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:45.029974 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097552d3-f6f5-4349-8458-16f19f01685b None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:45.030504 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097552d3-f6f5-4349-8458-16f19f01685b None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:45.030975 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097552d3-f6f5-4349-8458-16f19f01685b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:45.100745 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097552d3-f6f5-4349-8458-16f19f01685b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:45.102188 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097552d3-f6f5-4349-8458-16f19f01685b None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:45.201082 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 516/1046] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:36:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 14 21:36:45.202364 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e08c24-4a17-4178-88d0-70b89fd329be None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:45.301280 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e08c24-4a17-4178-88d0-70b89fd329be None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:45.334356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703042a-5c08-40df-a0a9-97589a233711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:45.335403 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703042a-5c08-40df-a0a9-97589a233711 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:45.335680 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703042a-5c08-40df-a0a9-97589a233711 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:45.335952 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703042a-5c08-40df-a0a9-97589a233711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:45.346532 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703042a-5c08-40df-a0a9-97589a233711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:45.347979 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703042a-5c08-40df-a0a9-97589a233711 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:45.364903 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-a703042a-5c08-40df-a0a9-97589a233711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:45.366254 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 531/1047] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:45.371982 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097552d3-f6f5-4349-8458-16f19f01685b None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:45.470154 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097552d3-f6f5-4349-8458-16f19f01685b None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:45.503156 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae002d-eb45-4c6e-ab90-cce18b6889bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:45.503811 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae002d-eb45-4c6e-ab90-cce18b6889bf None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:45.504093 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae002d-eb45-4c6e-ab90-cce18b6889bf None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:45.504365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae002d-eb45-4c6e-ab90-cce18b6889bf None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:45.505114 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae002d-eb45-4c6e-ab90-cce18b6889bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:45.505419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae002d-eb45-4c6e-ab90-cce18b6889bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:45.506779 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae002d-eb45-4c6e-ab90-cce18b6889bf None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:45.518043 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 517/1048] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:45.523428 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703042a-5c08-40df-a0a9-97589a233711 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:45.620294 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703042a-5c08-40df-a0a9-97589a233711 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:45.653657 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745c581-796d-42af-924a-bbd69c0e9f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:45.654447 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745c581-796d-42af-924a-bbd69c0e9f46 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:45.654726 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745c581-796d-42af-924a-bbd69c0e9f46 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:45.654995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745c581-796d-42af-924a-bbd69c0e9f46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:45.661750 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745c581-796d-42af-924a-bbd69c0e9f46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:45.663194 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745c581-796d-42af-924a-bbd69c0e9f46 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:45.677318 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-5745c581-796d-42af-924a-bbd69c0e9f46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:36:45.678594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 532/1049] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:45.684956 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae002d-eb45-4c6e-ab90-cce18b6889bf None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:45.783573 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae002d-eb45-4c6e-ab90-cce18b6889bf None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:45.816405 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f33dc-3eed-4c49-83a3-d602a27a70b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:45.817084 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f33dc-3eed-4c49-83a3-d602a27a70b1 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:45.817366 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f33dc-3eed-4c49-83a3-d602a27a70b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:45.817635 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f33dc-3eed-4c49-83a3-d602a27a70b1 None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:45.818420 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f33dc-3eed-4c49-83a3-d602a27a70b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:45.818725 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f33dc-3eed-4c49-83a3-d602a27a70b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:45.820160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f33dc-3eed-4c49-83a3-d602a27a70b1 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:45.832319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 518/1050] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:45.838344 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745c581-796d-42af-924a-bbd69c0e9f46 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:45.933926 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745c581-796d-42af-924a-bbd69c0e9f46 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:45.967361 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ea463-5a7a-4739-ab36-618c2be58ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:45.968016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ea463-5a7a-4739-ab36-618c2be58ab4 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:45.968294 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ea463-5a7a-4739-ab36-618c2be58ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:45.968566 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ea463-5a7a-4739-ab36-618c2be58ab4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:45.969413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ea463-5a7a-4739-ab36-618c2be58ab4 None admin] RBAC: Adding query filter params (role.id=928ab085e3e84586b2862ae16aca8595, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=e7f3ea629181433eb8c6d5dbc354c141) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:45.969809 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ea463-5a7a-4739-ab36-618c2be58ab4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:45.974417 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ea463-5a7a-4739-ab36-618c2be58ab4 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:45.977203 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 533/1051] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:36:45 2022] GET /identity/v3/role_assignments?user.id=e7f3ea629181433eb8c6d5dbc354c141&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=928ab085e3e84586b2862ae16aca8595 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:46.914535 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c23c71-eb03-4f99-8a96-0bfc183b1afa None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:46.923233 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c23c71-eb03-4f99-8a96-0bfc183b1afa None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:46.923233 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c23c71-eb03-4f99-8a96-0bfc183b1afa None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:46.923233 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 519/1052] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:46.923479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7ed3b-6a02-4999-9f67-c01822da387b None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:46.923479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7ed3b-6a02-4999-9f67-c01822da387b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:46.923479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7ed3b-6a02-4999-9f67-c01822da387b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:46.939549 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-36e7ed3b-6a02-4999-9f67-c01822da387b None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:46.940791 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-36e7ed3b-6a02-4999-9f67-c01822da387b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:47.012743 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 534/1053] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:47.032247 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c23c71-eb03-4f99-8a96-0bfc183b1afa None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:47.134309 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c23c71-eb03-4f99-8a96-0bfc183b1afa None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:47.167285 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a67dd-ca84-4a92-a20c-81c876760f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:47.168187 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a67dd-ca84-4a92-a20c-81c876760f47 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:47.168466 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a67dd-ca84-4a92-a20c-81c876760f47 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:47.168762 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a67dd-ca84-4a92-a20c-81c876760f47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:47.187669 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d83a59-e717-45fe-b619-278566931b40 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:47.187970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d83a59-e717-45fe-b619-278566931b40 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:47.188233 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d83a59-e717-45fe-b619-278566931b40 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:47.189763 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 535/1054] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:36:47.194744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7eae1-2313-4c80-90ed-ff7c7666093a None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:47.195029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7eae1-2313-4c80-90ed-ff7c7666093a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:47.195302 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7eae1-2313-4c80-90ed-ff7c7666093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:47.212280 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-52c7eae1-2313-4c80-90ed-ff7c7666093a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:47.213476 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-52c7eae1-2313-4c80-90ed-ff7c7666093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:47.237297 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a67dd-ca84-4a92-a20c-81c876760f47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:47.238747 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a67dd-ca84-4a92-a20c-81c876760f47 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:47.286399 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 536/1055] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:47.311679 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7eae1-2313-4c80-90ed-ff7c7666093a None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:47.344283 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 520/1056] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:36:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 14 21:36:47.348020 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a67dd-ca84-4a92-a20c-81c876760f47 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:47.411349 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7eae1-2313-4c80-90ed-ff7c7666093a None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:47.443432 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a67dd-ca84-4a92-a20c-81c876760f47 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:47.447450 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce091fec-e55c-47c2-95e8-0cf9027fc733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:47.448245 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce091fec-e55c-47c2-95e8-0cf9027fc733 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:47.448522 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce091fec-e55c-47c2-95e8-0cf9027fc733 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:47.449948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce091fec-e55c-47c2-95e8-0cf9027fc733 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:47.460132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce091fec-e55c-47c2-95e8-0cf9027fc733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:47.468122 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-ce091fec-e55c-47c2-95e8-0cf9027fc733 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:36:47.474207 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 537/1057] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:36:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:47.475192 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce091fec-e55c-47c2-95e8-0cf9027fc733 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:47.482084 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12f228-c4e9-4b04-8600-709d9962dd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:47.482878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12f228-c4e9-4b04-8600-709d9962dd3c None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:47.483157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12f228-c4e9-4b04-8600-709d9962dd3c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:47.483427 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12f228-c4e9-4b04-8600-709d9962dd3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:47.493347 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12f228-c4e9-4b04-8600-709d9962dd3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:47.494784 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12f228-c4e9-4b04-8600-709d9962dd3c None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:47.512363 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-4c12f228-c4e9-4b04-8600-709d9962dd3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:47.513556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 521/1058] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:47.519321 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12f228-c4e9-4b04-8600-709d9962dd3c None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:47.576959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce091fec-e55c-47c2-95e8-0cf9027fc733 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:47.610470 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b53d2e-bd53-45f9-8c6e-88e929b31283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:47.611141 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b53d2e-bd53-45f9-8c6e-88e929b31283 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:47.611427 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b53d2e-bd53-45f9-8c6e-88e929b31283 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:47.611704 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b53d2e-bd53-45f9-8c6e-88e929b31283 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:47.612457 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b53d2e-bd53-45f9-8c6e-88e929b31283 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:47.612799 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b53d2e-bd53-45f9-8c6e-88e929b31283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:47.614230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b53d2e-bd53-45f9-8c6e-88e929b31283 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:47.620201 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12f228-c4e9-4b04-8600-709d9962dd3c None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:47.624329 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 538/1059] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:36:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:47.629774 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b53d2e-bd53-45f9-8c6e-88e929b31283 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:47.653990 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d045ee-026b-4976-8c94-5596799051e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:47.654652 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d045ee-026b-4976-8c94-5596799051e6 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:47.654934 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d045ee-026b-4976-8c94-5596799051e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:47.655204 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d045ee-026b-4976-8c94-5596799051e6 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:47.655922 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d045ee-026b-4976-8c94-5596799051e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:47.656223 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d045ee-026b-4976-8c94-5596799051e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:47.657609 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d045ee-026b-4976-8c94-5596799051e6 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:47.668861 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 522/1060] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:47.743914 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b53d2e-bd53-45f9-8c6e-88e929b31283 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:47.783517 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154ebf5-e8d0-4046-a18f-77d06b2a2618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:47.784405 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154ebf5-e8d0-4046-a18f-77d06b2a2618 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:47.784722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154ebf5-e8d0-4046-a18f-77d06b2a2618 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:47.784993 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154ebf5-e8d0-4046-a18f-77d06b2a2618 None admin] PATH_INFO: `/v3/users/87b398d44d004876974554c155a13368` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:47.800397 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154ebf5-e8d0-4046-a18f-77d06b2a2618 None admin] RBAC: Authorizing `identity:get_user(user_id=87b398d44d004876974554c155a13368)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:47.801886 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154ebf5-e8d0-4046-a18f-77d06b2a2618 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:47.803823 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 539/1061] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:36:47 2022] GET /identity/v3/users/87b398d44d004876974554c155a13368 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:47.810844 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d045ee-026b-4976-8c94-5596799051e6 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:47.916373 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d045ee-026b-4976-8c94-5596799051e6 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:47.958829 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0e5df-5854-4157-84fa-5e58eea52c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:47.959485 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0e5df-5854-4157-84fa-5e58eea52c05 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:47.960043 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0e5df-5854-4157-84fa-5e58eea52c05 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:47.960312 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0e5df-5854-4157-84fa-5e58eea52c05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:48.029871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0e5df-5854-4157-84fa-5e58eea52c05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:48.031252 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0e5df-5854-4157-84fa-5e58eea52c05 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:48.126491 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 523/1062] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:36:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 14 21:36:48.132073 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154ebf5-e8d0-4046-a18f-77d06b2a2618 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:48.238307 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154ebf5-e8d0-4046-a18f-77d06b2a2618 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:48.271419 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449129da-ac5c-4136-bec4-fcd996a2d17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:48.272262 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449129da-ac5c-4136-bec4-fcd996a2d17a None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:48.272535 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449129da-ac5c-4136-bec4-fcd996a2d17a None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:48.272833 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449129da-ac5c-4136-bec4-fcd996a2d17a None admin] PATH_INFO: `/v3/projects/d937cd6be08f4d2c814c38df37f91dfc` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:48.273989 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449129da-ac5c-4136-bec4-fcd996a2d17a None admin] RBAC: Authorizing `identity:get_project(project_id=d937cd6be08f4d2c814c38df37f91dfc)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:48.275487 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449129da-ac5c-4136-bec4-fcd996a2d17a None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:48.278323 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 540/1063] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:36:48 2022] GET /identity/v3/projects/d937cd6be08f4d2c814c38df37f91dfc => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:48.284402 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0e5df-5854-4157-84fa-5e58eea52c05 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:48.309462 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594ac0c-0215-4547-9b90-5f02fa04d6b4 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:48.309843 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594ac0c-0215-4547-9b90-5f02fa04d6b4 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:48.310181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594ac0c-0215-4547-9b90-5f02fa04d6b4 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:48.311613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 541/1064] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:36:48.316686 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8be43-48b6-4dc3-815a-471523c8d10d None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:48.316972 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8be43-48b6-4dc3-815a-471523c8d10d None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:48.317244 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8be43-48b6-4dc3-815a-471523c8d10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:48.333997 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-2bb8be43-48b6-4dc3-815a-471523c8d10d None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:48.335426 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-2bb8be43-48b6-4dc3-815a-471523c8d10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:48.381952 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0e5df-5854-4157-84fa-5e58eea52c05 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:48.399152 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 542/1065] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:48.414860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91ecda-38cb-436e-9ece-e6267145fa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:48.415557 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91ecda-38cb-436e-9ece-e6267145fa84 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:48.415835 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91ecda-38cb-436e-9ece-e6267145fa84 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:48.416109 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91ecda-38cb-436e-9ece-e6267145fa84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:48.416966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91ecda-38cb-436e-9ece-e6267145fa84 None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=d937cd6be08f4d2c814c38df37f91dfc, user.id=87b398d44d004876974554c155a13368) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:48.417340 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91ecda-38cb-436e-9ece-e6267145fa84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:48.418894 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91ecda-38cb-436e-9ece-e6267145fa84 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:48.422824 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8be43-48b6-4dc3-815a-471523c8d10d None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:48.436619 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 524/1066] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:36:48 2022] GET /identity/v3/role_assignments?user.id=87b398d44d004876974554c155a13368&scope.project.id=d937cd6be08f4d2c814c38df37f91dfc&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:48.525560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8be43-48b6-4dc3-815a-471523c8d10d None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:48.559874 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01871229-065a-4420-bcd4-db5a1edf0800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:48.560642 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01871229-065a-4420-bcd4-db5a1edf0800 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:48.560923 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01871229-065a-4420-bcd4-db5a1edf0800 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:48.561193 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01871229-065a-4420-bcd4-db5a1edf0800 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:48.571981 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01871229-065a-4420-bcd4-db5a1edf0800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:48.580198 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-01871229-065a-4420-bcd4-db5a1edf0800 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 14 21:36:48.581493 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 543/1067] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Apr 14 21:36:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:48.589512 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91ecda-38cb-436e-9ece-e6267145fa84 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:48.688005 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91ecda-38cb-436e-9ece-e6267145fa84 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:48.722274 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb602ef-0a93-49dd-8e78-1870fd1c448e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:48.722940 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb602ef-0a93-49dd-8e78-1870fd1c448e None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:48.723220 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb602ef-0a93-49dd-8e78-1870fd1c448e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:48.723490 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb602ef-0a93-49dd-8e78-1870fd1c448e None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:48.724242 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb602ef-0a93-49dd-8e78-1870fd1c448e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:48.724543 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb602ef-0a93-49dd-8e78-1870fd1c448e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:48.725921 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb602ef-0a93-49dd-8e78-1870fd1c448e None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:48.733962 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 525/1068] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Apr 14 21:36:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:48.739564 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01871229-065a-4420-bcd4-db5a1edf0800 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:48.835610 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01871229-065a-4420-bcd4-db5a1edf0800 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:48.867668 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6880f-0e40-4cc5-8a2b-cfec2daaec75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:48.868451 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6880f-0e40-4cc5-8a2b-cfec2daaec75 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:48.868757 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6880f-0e40-4cc5-8a2b-cfec2daaec75 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:48.869030 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6880f-0e40-4cc5-8a2b-cfec2daaec75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:48.879845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6880f-0e40-4cc5-8a2b-cfec2daaec75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:48.881314 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6880f-0e40-4cc5-8a2b-cfec2daaec75 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:48.897649 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-51b6880f-0e40-4cc5-8a2b-cfec2daaec75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:48.898811 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 544/1069] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:48.905271 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb602ef-0a93-49dd-8e78-1870fd1c448e None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:48.999755 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb602ef-0a93-49dd-8e78-1870fd1c448e None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:49.032747 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cde4ab-11ea-4295-b620-6f21c685de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:49.033409 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cde4ab-11ea-4295-b620-6f21c685de41 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:49.033717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cde4ab-11ea-4295-b620-6f21c685de41 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:49.033993 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cde4ab-11ea-4295-b620-6f21c685de41 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:49.034713 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cde4ab-11ea-4295-b620-6f21c685de41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:49.035027 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cde4ab-11ea-4295-b620-6f21c685de41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:49.036407 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cde4ab-11ea-4295-b620-6f21c685de41 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:49.047678 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 526/1070] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:49.053218 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6880f-0e40-4cc5-8a2b-cfec2daaec75 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:49.151153 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6880f-0e40-4cc5-8a2b-cfec2daaec75 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:49.182432 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63811faa-a0d4-4115-b39c-c937fdfd8c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:49.183878 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63811faa-a0d4-4115-b39c-c937fdfd8c9d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:49.184151 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63811faa-a0d4-4115-b39c-c937fdfd8c9d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:49.184421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63811faa-a0d4-4115-b39c-c937fdfd8c9d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:49.191824 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63811faa-a0d4-4115-b39c-c937fdfd8c9d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:49.193281 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63811faa-a0d4-4115-b39c-c937fdfd8c9d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:49.206762 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-63811faa-a0d4-4115-b39c-c937fdfd8c9d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 14 21:36:49.207936 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 545/1071] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Apr 14 21:36:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:49.213941 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cde4ab-11ea-4295-b620-6f21c685de41 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:49.309809 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cde4ab-11ea-4295-b620-6f21c685de41 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:49.343411 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8336de-f8d6-41cb-9c72-d9887be84779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:49.344069 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8336de-f8d6-41cb-9c72-d9887be84779 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:49.344346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8336de-f8d6-41cb-9c72-d9887be84779 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:49.344643 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8336de-f8d6-41cb-9c72-d9887be84779 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:49.345474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8336de-f8d6-41cb-9c72-d9887be84779 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:49.345775 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8336de-f8d6-41cb-9c72-d9887be84779 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:49.347208 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8336de-f8d6-41cb-9c72-d9887be84779 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:49.364699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 527/1072] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Apr 14 21:36:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:49.370239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63811faa-a0d4-4115-b39c-c937fdfd8c9d None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:49.466736 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63811faa-a0d4-4115-b39c-c937fdfd8c9d None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:49.498250 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7db40-a958-4dce-a031-96566d33b468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:49.499037 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7db40-a958-4dce-a031-96566d33b468 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:49.499316 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7db40-a958-4dce-a031-96566d33b468 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:49.499593 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7db40-a958-4dce-a031-96566d33b468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:49.509945 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7db40-a958-4dce-a031-96566d33b468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:49.511869 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7db40-a958-4dce-a031-96566d33b468 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:49.528213 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-12a7db40-a958-4dce-a031-96566d33b468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:49.529433 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 546/1073] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:49.535086 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8336de-f8d6-41cb-9c72-d9887be84779 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:49.631447 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8336de-f8d6-41cb-9c72-d9887be84779 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:49.662873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855072a-29a9-43af-b453-cb8ed663696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:49.663515 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855072a-29a9-43af-b453-cb8ed663696d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:49.663789 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855072a-29a9-43af-b453-cb8ed663696d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:49.664055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855072a-29a9-43af-b453-cb8ed663696d None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:49.664795 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855072a-29a9-43af-b453-cb8ed663696d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:49.665094 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855072a-29a9-43af-b453-cb8ed663696d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:49.666446 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855072a-29a9-43af-b453-cb8ed663696d None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:49.677732 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 528/1074] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:49.683927 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7db40-a958-4dce-a031-96566d33b468 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:49.782375 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7db40-a958-4dce-a031-96566d33b468 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:49.814722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae093ed-30f3-4aa2-8418-1af943f00e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:49.815522 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae093ed-30f3-4aa2-8418-1af943f00e3a None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:49.815803 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae093ed-30f3-4aa2-8418-1af943f00e3a None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:49.816077 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae093ed-30f3-4aa2-8418-1af943f00e3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:49.822506 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae093ed-30f3-4aa2-8418-1af943f00e3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:49.824175 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae093ed-30f3-4aa2-8418-1af943f00e3a None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:49.838686 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-0ae093ed-30f3-4aa2-8418-1af943f00e3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:36:49.840404 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 547/1075] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:49.846191 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855072a-29a9-43af-b453-cb8ed663696d None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:49.942600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855072a-29a9-43af-b453-cb8ed663696d None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:49.974972 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad005e-4f53-4b9b-b60e-770be38ecb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:49.975634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad005e-4f53-4b9b-b60e-770be38ecb9e None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:49.975911 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad005e-4f53-4b9b-b60e-770be38ecb9e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:49.976185 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad005e-4f53-4b9b-b60e-770be38ecb9e None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:49.977012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad005e-4f53-4b9b-b60e-770be38ecb9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:49.977322 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad005e-4f53-4b9b-b60e-770be38ecb9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:49.978740 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad005e-4f53-4b9b-b60e-770be38ecb9e None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:49.991708 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 529/1076] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:49.997608 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae093ed-30f3-4aa2-8418-1af943f00e3a None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:50.092934 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae093ed-30f3-4aa2-8418-1af943f00e3a None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:50.125396 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19b1f1-a509-4540-9f1d-d7cd916c1c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:50.126442 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b1f1-a509-4540-9f1d-d7cd916c1c4e None admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:50.126722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b1f1-a509-4540-9f1d-d7cd916c1c4e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:50.126994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b1f1-a509-4540-9f1d-d7cd916c1c4e None admin] PATH_INFO: `/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/e7f3ea629181433eb8c6d5dbc354c141/roles/928ab085e3e84586b2862ae16aca8595` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:50.129216 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19b1f1-a509-4540-9f1d-d7cd916c1c4e None admin] RBAC: Authorizing `identity:create_grant(project_id=a3c1bb37aa1c407782b2f5501ae1f10a, user_id=e7f3ea629181433eb8c6d5dbc354c141, role_id=928ab085e3e84586b2862ae16aca8595)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:50.130646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19b1f1-a509-4540-9f1d-d7cd916c1c4e None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:50.284365 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 548/1077] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:36:49 2022] PUT /identity/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/e7f3ea629181433eb8c6d5dbc354c141/roles/928ab085e3e84586b2862ae16aca8595 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:36:50.739261 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2e20a-5714-46f5-a81e-79f1e4c3b90f None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:50.739825 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2e20a-5714-46f5-a81e-79f1e4c3b90f None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:50.739825 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2e20a-5714-46f5-a81e-79f1e4c3b90f None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:50.741197 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 530/1078] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:50.747407 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bff7d2-e159-4171-834f-726a2980007e None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:50.747689 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bff7d2-e159-4171-834f-726a2980007e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:50.747961 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bff7d2-e159-4171-834f-726a2980007e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:50.765775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-56bff7d2-e159-4171-834f-726a2980007e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:50.766929 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-56bff7d2-e159-4171-834f-726a2980007e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:50.830820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 549/1079] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:50.855390 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2e20a-5714-46f5-a81e-79f1e4c3b90f None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:50.954987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2e20a-5714-46f5-a81e-79f1e4c3b90f None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:50.989521 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d11155-4fe3-4e9c-9f66-d23361845534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:50.990262 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d11155-4fe3-4e9c-9f66-d23361845534 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:50.990545 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d11155-4fe3-4e9c-9f66-d23361845534 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:50.990821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d11155-4fe3-4e9c-9f66-d23361845534 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:51.000890 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d11155-4fe3-4e9c-9f66-d23361845534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:51.007836 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-38d11155-4fe3-4e9c-9f66-d23361845534 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:36:51.009054 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 531/1080] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:36:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:51.016824 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bff7d2-e159-4171-834f-726a2980007e None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:51.112677 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bff7d2-e159-4171-834f-726a2980007e None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:51.145173 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f779296-dbc8-43d3-a418-018041a685f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:51.145840 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f779296-dbc8-43d3-a418-018041a685f3 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:51.146121 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f779296-dbc8-43d3-a418-018041a685f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:51.146394 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f779296-dbc8-43d3-a418-018041a685f3 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:51.147139 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f779296-dbc8-43d3-a418-018041a685f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:51.147442 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f779296-dbc8-43d3-a418-018041a685f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:51.148825 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f779296-dbc8-43d3-a418-018041a685f3 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:51.157424 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 550/1081] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:36:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:51.163281 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d11155-4fe3-4e9c-9f66-d23361845534 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:51.260293 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d11155-4fe3-4e9c-9f66-d23361845534 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:51.292970 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e34bfa-ca54-4641-a2ed-969b199ec16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:51.293827 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e34bfa-ca54-4641-a2ed-969b199ec16d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:51.294107 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e34bfa-ca54-4641-a2ed-969b199ec16d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:51.294379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e34bfa-ca54-4641-a2ed-969b199ec16d None admin] PATH_INFO: `/v3/users/87b398d44d004876974554c155a13368` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:51.295558 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e34bfa-ca54-4641-a2ed-969b199ec16d None admin] RBAC: Authorizing `identity:get_user(user_id=87b398d44d004876974554c155a13368)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:51.297018 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e34bfa-ca54-4641-a2ed-969b199ec16d None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:51.298651 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 532/1082] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:36:51 2022] GET /identity/v3/users/87b398d44d004876974554c155a13368 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:51.304457 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f779296-dbc8-43d3-a418-018041a685f3 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:51.402039 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f779296-dbc8-43d3-a418-018041a685f3 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:51.436345 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32506a51-bb78-422c-b398-b0da8727ff87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:51.437230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32506a51-bb78-422c-b398-b0da8727ff87 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:51.437504 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32506a51-bb78-422c-b398-b0da8727ff87 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:51.437771 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32506a51-bb78-422c-b398-b0da8727ff87 None admin] PATH_INFO: `/v3/projects/d937cd6be08f4d2c814c38df37f91dfc` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:51.438941 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32506a51-bb78-422c-b398-b0da8727ff87 None admin] RBAC: Authorizing `identity:get_project(project_id=d937cd6be08f4d2c814c38df37f91dfc)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:51.440369 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32506a51-bb78-422c-b398-b0da8727ff87 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:51.442106 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 551/1083] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:36:51 2022] GET /identity/v3/projects/d937cd6be08f4d2c814c38df37f91dfc => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:51.447922 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e34bfa-ca54-4641-a2ed-969b199ec16d None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:51.546689 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e34bfa-ca54-4641-a2ed-969b199ec16d None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:51.579503 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e518c-0b46-4239-b05c-46b22a12316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:51.580369 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e518c-0b46-4239-b05c-46b22a12316c None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:51.580675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e518c-0b46-4239-b05c-46b22a12316c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:51.580947 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e518c-0b46-4239-b05c-46b22a12316c None admin] PATH_INFO: `/v3/projects/d937cd6be08f4d2c814c38df37f91dfc/users/87b398d44d004876974554c155a13368/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:51.582858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e518c-0b46-4239-b05c-46b22a12316c None admin] RBAC: Authorizing `identity:create_grant(project_id=d937cd6be08f4d2c814c38df37f91dfc, user_id=87b398d44d004876974554c155a13368, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:51.584276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e518c-0b46-4239-b05c-46b22a12316c None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:51.644985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 533/1084] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:36:51 2022] PUT /identity/v3/projects/d937cd6be08f4d2c814c38df37f91dfc/users/87b398d44d004876974554c155a13368/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:36:52.591650 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206ce4-4d71-4212-a9be-bca55676922b None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:52.592206 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206ce4-4d71-4212-a9be-bca55676922b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:52.592206 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206ce4-4d71-4212-a9be-bca55676922b None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:52.593769 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 552/1085] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:52.599168 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81237ba2-0a7f-4dfa-8f26-c91bd3450096 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:52.599549 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81237ba2-0a7f-4dfa-8f26-c91bd3450096 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:52.599832 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81237ba2-0a7f-4dfa-8f26-c91bd3450096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:52.617919 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-81237ba2-0a7f-4dfa-8f26-c91bd3450096 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:52.619096 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-81237ba2-0a7f-4dfa-8f26-c91bd3450096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:52.684367 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 534/1086] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:52.709893 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c206ce4-4d71-4212-a9be-bca55676922b None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:52.818421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c206ce4-4d71-4212-a9be-bca55676922b None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:52.850487 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb02d9-70c4-4580-bd50-bc2b35010e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:52.851223 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb02d9-70c4-4580-bd50-bc2b35010e60 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:52.851503 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb02d9-70c4-4580-bd50-bc2b35010e60 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:52.851776 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb02d9-70c4-4580-bd50-bc2b35010e60 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:52.862201 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb02d9-70c4-4580-bd50-bc2b35010e60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:52.869546 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-b6eb02d9-70c4-4580-bd50-bc2b35010e60 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 14 21:36:52.870897 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 553/1087] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Apr 14 21:36:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:52.876995 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81237ba2-0a7f-4dfa-8f26-c91bd3450096 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:52.972242 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81237ba2-0a7f-4dfa-8f26-c91bd3450096 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:53.018513 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3c69b-27ce-4766-9462-701a50f8078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:53.019164 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3c69b-27ce-4766-9462-701a50f8078f None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:53.019436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3c69b-27ce-4766-9462-701a50f8078f None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:53.019702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3c69b-27ce-4766-9462-701a50f8078f None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:53.020437 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3c69b-27ce-4766-9462-701a50f8078f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:53.020834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3c69b-27ce-4766-9462-701a50f8078f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:53.022199 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3c69b-27ce-4766-9462-701a50f8078f None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:53.030471 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 535/1088] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Apr 14 21:36:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:53.036047 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb02d9-70c4-4580-bd50-bc2b35010e60 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:53.131025 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb02d9-70c4-4580-bd50-bc2b35010e60 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:53.162054 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b92064-a9d2-44a9-b6fe-88f449488da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:53.162834 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b92064-a9d2-44a9-b6fe-88f449488da6 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:53.163110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b92064-a9d2-44a9-b6fe-88f449488da6 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:53.163380 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b92064-a9d2-44a9-b6fe-88f449488da6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:53.174142 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b92064-a9d2-44a9-b6fe-88f449488da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:53.175578 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b92064-a9d2-44a9-b6fe-88f449488da6 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:53.191258 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-d4b92064-a9d2-44a9-b6fe-88f449488da6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:53.192443 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 554/1089] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:53.198203 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3c69b-27ce-4766-9462-701a50f8078f None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:53.293042 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3c69b-27ce-4766-9462-701a50f8078f None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:53.324372 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8d9ce-a02a-414f-9475-76dc45311e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:53.325075 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8d9ce-a02a-414f-9475-76dc45311e50 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:53.325352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8d9ce-a02a-414f-9475-76dc45311e50 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:53.325619 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8d9ce-a02a-414f-9475-76dc45311e50 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:53.326327 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8d9ce-a02a-414f-9475-76dc45311e50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:53.326626 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8d9ce-a02a-414f-9475-76dc45311e50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:53.327973 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8d9ce-a02a-414f-9475-76dc45311e50 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:53.340109 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 536/1090] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:53.345804 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b92064-a9d2-44a9-b6fe-88f449488da6 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:53.440531 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b92064-a9d2-44a9-b6fe-88f449488da6 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:53.473146 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e8035-7100-4710-aa0e-9f53dbdcaba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:53.473922 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e8035-7100-4710-aa0e-9f53dbdcaba1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:53.474195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e8035-7100-4710-aa0e-9f53dbdcaba1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:53.474461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e8035-7100-4710-aa0e-9f53dbdcaba1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:53.481664 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e8035-7100-4710-aa0e-9f53dbdcaba1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:53.483098 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e8035-7100-4710-aa0e-9f53dbdcaba1 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:53.495831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-108e8035-7100-4710-aa0e-9f53dbdcaba1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 14 21:36:53.497043 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 555/1091] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Apr 14 21:36:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:53.502984 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8d9ce-a02a-414f-9475-76dc45311e50 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:53.601701 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8d9ce-a02a-414f-9475-76dc45311e50 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:53.634965 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf2195-08e4-4c78-af76-e7dac0a39fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:53.635625 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf2195-08e4-4c78-af76-e7dac0a39fbd None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:53.636602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf2195-08e4-4c78-af76-e7dac0a39fbd None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:53.636876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf2195-08e4-4c78-af76-e7dac0a39fbd None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:53.637696 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf2195-08e4-4c78-af76-e7dac0a39fbd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:53.637997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf2195-08e4-4c78-af76-e7dac0a39fbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:53.639406 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf2195-08e4-4c78-af76-e7dac0a39fbd None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:53.656750 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 537/1092] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Apr 14 21:36:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:53.662591 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e8035-7100-4710-aa0e-9f53dbdcaba1 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:53.757978 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e8035-7100-4710-aa0e-9f53dbdcaba1 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:53.790066 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa832d-74dc-4e10-9ca4-5f625c4c3585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:53.790709 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa832d-74dc-4e10-9ca4-5f625c4c3585 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:53.791419 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa832d-74dc-4e10-9ca4-5f625c4c3585 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:53.791419 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa832d-74dc-4e10-9ca4-5f625c4c3585 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:53.855745 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa832d-74dc-4e10-9ca4-5f625c4c3585 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:53.857211 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa832d-74dc-4e10-9ca4-5f625c4c3585 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:53.949535 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 556/1093] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:36:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 14 21:36:53.955389 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf2195-08e4-4c78-af76-e7dac0a39fbd None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:53.968018 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687954b-6e3c-4cea-ae4d-831604371b87 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:53.968309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687954b-6e3c-4cea-ae4d-831604371b87 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:53.968597 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687954b-6e3c-4cea-ae4d-831604371b87 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:53.970262 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 557/1094] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:36:53.975338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f1a26-81ca-48b0-87b2-023562127502 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:53.975680 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f1a26-81ca-48b0-87b2-023562127502 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:53.975985 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f1a26-81ca-48b0-87b2-023562127502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:53.994905 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-187f1a26-81ca-48b0-87b2-023562127502 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:53.996130 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-187f1a26-81ca-48b0-87b2-023562127502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:54.067257 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 558/1095] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:36:54.076263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf2195-08e4-4c78-af76-e7dac0a39fbd None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:54.093092 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f1a26-81ca-48b0-87b2-023562127502 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:54.109018 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed93732-c840-46a2-8f79-d0277b7fedd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:54.109824 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed93732-c840-46a2-8f79-d0277b7fedd1 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:54.110083 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed93732-c840-46a2-8f79-d0277b7fedd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:54.110355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed93732-c840-46a2-8f79-d0277b7fedd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:54.119899 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed93732-c840-46a2-8f79-d0277b7fedd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:54.121396 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed93732-c840-46a2-8f79-d0277b7fedd1 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:54.138783 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-bed93732-c840-46a2-8f79-d0277b7fedd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:36:54.139949 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 538/1096] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:36:54.145880 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed93732-c840-46a2-8f79-d0277b7fedd1 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:54.188236 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f1a26-81ca-48b0-87b2-023562127502 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:54.222064 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1a706-9ff2-49da-9f1c-7ac25731ebe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:54.222866 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1a706-9ff2-49da-9f1c-7ac25731ebe2 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:54.223148 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1a706-9ff2-49da-9f1c-7ac25731ebe2 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:54.223415 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1a706-9ff2-49da-9f1c-7ac25731ebe2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:54.233927 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1a706-9ff2-49da-9f1c-7ac25731ebe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:36:54.238786 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed93732-c840-46a2-8f79-d0277b7fedd1 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:54.240730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-46c1a706-9ff2-49da-9f1c-7ac25731ebe2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:36:54.241931 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 559/1097] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:36:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:54.248315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1a706-9ff2-49da-9f1c-7ac25731ebe2 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:54.271311 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39bb5c-4049-4d98-9f30-c4a06b9bd68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:54.271961 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39bb5c-4049-4d98-9f30-c4a06b9bd68c None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:54.272236 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39bb5c-4049-4d98-9f30-c4a06b9bd68c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:54.272506 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39bb5c-4049-4d98-9f30-c4a06b9bd68c None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:54.273248 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39bb5c-4049-4d98-9f30-c4a06b9bd68c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:54.273546 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39bb5c-4049-4d98-9f30-c4a06b9bd68c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:54.274916 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39bb5c-4049-4d98-9f30-c4a06b9bd68c None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:54.286220 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 539/1098] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:54.292097 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39bb5c-4049-4d98-9f30-c4a06b9bd68c None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:54.344046 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1a706-9ff2-49da-9f1c-7ac25731ebe2 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:54.375316 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e958a3-26f6-41d8-bc7a-affcc72b1151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:54.376013 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e958a3-26f6-41d8-bc7a-affcc72b1151 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:54.376277 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e958a3-26f6-41d8-bc7a-affcc72b1151 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:54.376503 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e958a3-26f6-41d8-bc7a-affcc72b1151 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:54.377254 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e958a3-26f6-41d8-bc7a-affcc72b1151 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:54.377610 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e958a3-26f6-41d8-bc7a-affcc72b1151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:54.378925 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e958a3-26f6-41d8-bc7a-affcc72b1151 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:54.387272 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 560/1099] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:36:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:54.387424 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39bb5c-4049-4d98-9f30-c4a06b9bd68c None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:54.393086 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e958a3-26f6-41d8-bc7a-affcc72b1151 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:54.419651 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72489c6-5335-48f0-b1f1-36b2560806df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:54.420443 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72489c6-5335-48f0-b1f1-36b2560806df None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:54.420750 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72489c6-5335-48f0-b1f1-36b2560806df None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:54.421028 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72489c6-5335-48f0-b1f1-36b2560806df None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:54.427574 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72489c6-5335-48f0-b1f1-36b2560806df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:54.429043 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72489c6-5335-48f0-b1f1-36b2560806df None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:54.442882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-a72489c6-5335-48f0-b1f1-36b2560806df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:36:54.444066 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 540/1100] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:36:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:36:54.450440 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72489c6-5335-48f0-b1f1-36b2560806df None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:54.487287 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e958a3-26f6-41d8-bc7a-affcc72b1151 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:54.519406 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6361d55-9708-41c3-afd4-e547c9245681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:54.520263 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6361d55-9708-41c3-afd4-e547c9245681 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:54.520537 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6361d55-9708-41c3-afd4-e547c9245681 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:54.520831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6361d55-9708-41c3-afd4-e547c9245681 None admin] PATH_INFO: `/v3/users/87b398d44d004876974554c155a13368` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:54.522006 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6361d55-9708-41c3-afd4-e547c9245681 None admin] RBAC: Authorizing `identity:get_user(user_id=87b398d44d004876974554c155a13368)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:54.523422 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6361d55-9708-41c3-afd4-e547c9245681 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:54.525067 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 561/1101] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:36:54 2022] GET /identity/v3/users/87b398d44d004876974554c155a13368 => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:54.531658 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6361d55-9708-41c3-afd4-e547c9245681 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:54.545148 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72489c6-5335-48f0-b1f1-36b2560806df None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:54.579398 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a37a8-17db-4a60-ae63-d12f9bda7ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:54.580055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a37a8-17db-4a60-ae63-d12f9bda7ac1 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:54.580336 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a37a8-17db-4a60-ae63-d12f9bda7ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:54.580633 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a37a8-17db-4a60-ae63-d12f9bda7ac1 None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:54.581423 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a37a8-17db-4a60-ae63-d12f9bda7ac1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:54.581730 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a37a8-17db-4a60-ae63-d12f9bda7ac1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:54.583149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a37a8-17db-4a60-ae63-d12f9bda7ac1 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:54.594603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 541/1102] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:36:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:54.600506 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a37a8-17db-4a60-ae63-d12f9bda7ac1 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:54.625424 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6361d55-9708-41c3-afd4-e547c9245681 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:54.657086 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2bbee-73ea-453b-9495-624bea78cd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:54.657724 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2bbee-73ea-453b-9495-624bea78cd22 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:54.658002 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2bbee-73ea-453b-9495-624bea78cd22 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:54.658268 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2bbee-73ea-453b-9495-624bea78cd22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:54.695829 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a37a8-17db-4a60-ae63-d12f9bda7ac1 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:54.721312 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2bbee-73ea-453b-9495-624bea78cd22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:54.722845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2bbee-73ea-453b-9495-624bea78cd22 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:54.727947 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3b791-0e5f-460b-9c4e-5d60804f58ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:54.728619 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3b791-0e5f-460b-9c4e-5d60804f58ac None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:54.728906 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3b791-0e5f-460b-9c4e-5d60804f58ac None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:54.729180 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3b791-0e5f-460b-9c4e-5d60804f58ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:54.731319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3b791-0e5f-460b-9c4e-5d60804f58ac None admin] RBAC: Adding query filter params (role.id=928ab085e3e84586b2862ae16aca8595, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=e7f3ea629181433eb8c6d5dbc354c141) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:54.731630 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3b791-0e5f-460b-9c4e-5d60804f58ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:54.733083 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3b791-0e5f-460b-9c4e-5d60804f58ac None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:54.738848 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 542/1103] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:36:54 2022] GET /identity/v3/role_assignments?user.id=e7f3ea629181433eb8c6d5dbc354c141&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=928ab085e3e84586b2862ae16aca8595 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:36:54.825293 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 562/1104] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:36:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 14 21:36:54.831631 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3b791-0e5f-460b-9c4e-5d60804f58ac None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:54.934592 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3b791-0e5f-460b-9c4e-5d60804f58ac None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:54.968782 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953496b-89a9-4cd0-a440-12874d8d6347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:54.970194 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953496b-89a9-4cd0-a440-12874d8d6347 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:54.970474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953496b-89a9-4cd0-a440-12874d8d6347 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:54.970751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953496b-89a9-4cd0-a440-12874d8d6347 None admin] PATH_INFO: `/v3/projects/d937cd6be08f4d2c814c38df37f91dfc` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:54.971963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953496b-89a9-4cd0-a440-12874d8d6347 None admin] RBAC: Authorizing `identity:get_project(project_id=d937cd6be08f4d2c814c38df37f91dfc)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:54.973470 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953496b-89a9-4cd0-a440-12874d8d6347 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:54.975338 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 543/1105] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:36:54 2022] GET /identity/v3/projects/d937cd6be08f4d2c814c38df37f91dfc => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:54.981936 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2bbee-73ea-453b-9495-624bea78cd22 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:55.085817 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2bbee-73ea-453b-9495-624bea78cd22 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:55.120900 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f60da6-dccc-450a-aea4-3fda4754478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:55.121551 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f60da6-dccc-450a-aea4-3fda4754478f None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:55.121832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f60da6-dccc-450a-aea4-3fda4754478f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:55.122103 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f60da6-dccc-450a-aea4-3fda4754478f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:55.122932 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f60da6-dccc-450a-aea4-3fda4754478f None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=d937cd6be08f4d2c814c38df37f91dfc, user.id=87b398d44d004876974554c155a13368) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:36:55.123241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f60da6-dccc-450a-aea4-3fda4754478f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:55.124698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f60da6-dccc-450a-aea4-3fda4754478f None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:55.130828 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 563/1106] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:36:54 2022] GET /identity/v3/role_assignments?user.id=87b398d44d004876974554c155a13368&scope.project.id=d937cd6be08f4d2c814c38df37f91dfc&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:57.439760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1619990-cc69-4f43-9f28-cc824260ae7d None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:57.440318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1619990-cc69-4f43-9f28-cc824260ae7d None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:57.440318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1619990-cc69-4f43-9f28-cc824260ae7d None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:57.441676 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 544/1107] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:36:57.446706 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718027b0-2933-4d6f-b32e-efd847e1408f None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:57.447129 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718027b0-2933-4d6f-b32e-efd847e1408f None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:57.447256 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718027b0-2933-4d6f-b32e-efd847e1408f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:57.465101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-718027b0-2933-4d6f-b32e-efd847e1408f None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:36:57.466266 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-718027b0-2933-4d6f-b32e-efd847e1408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:36:57.529273 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 564/1108] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:36:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:36:57.555971 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1619990-cc69-4f43-9f28-cc824260ae7d None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:57.653724 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1619990-cc69-4f43-9f28-cc824260ae7d None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:57.685486 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fcdda-3fbb-467a-abe7-0ad30d676238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:57.686259 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fcdda-3fbb-467a-abe7-0ad30d676238 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:57.686539 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fcdda-3fbb-467a-abe7-0ad30d676238 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:57.686813 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fcdda-3fbb-467a-abe7-0ad30d676238 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:57.687985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fcdda-3fbb-467a-abe7-0ad30d676238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:57.689439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fcdda-3fbb-467a-abe7-0ad30d676238 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:57.691088 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 545/1109] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:36:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:36:57.696775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718027b0-2933-4d6f-b32e-efd847e1408f None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:36:57.790797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718027b0-2933-4d6f-b32e-efd847e1408f None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:36:57.823880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8df1d-c994-4144-b26e-aeb406728c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:36:57.824526 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8df1d-c994-4144-b26e-aeb406728c44 None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:36:57.824904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8df1d-c994-4144-b26e-aeb406728c44 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:36:57.825177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8df1d-c994-4144-b26e-aeb406728c44 None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:36:57.825891 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8df1d-c994-4144-b26e-aeb406728c44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:36:57.827313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8df1d-c994-4144-b26e-aeb406728c44 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:36:57.941504 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 565/1110] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:36:57 2022] POST /identity/v3/users => generated 286 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:37:00.284090 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6a7b7-a2db-4d0e-b391-f3b4ce3da062 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:00.284640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6a7b7-a2db-4d0e-b391-f3b4ce3da062 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:00.284640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6a7b7-a2db-4d0e-b391-f3b4ce3da062 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:00.285946 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 546/1111] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:37:00.291931 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a136e72-03d5-483b-8412-0d8dfacfa662 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:00.292354 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a136e72-03d5-483b-8412-0d8dfacfa662 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:00.292487 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a136e72-03d5-483b-8412-0d8dfacfa662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:00.309475 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-8a136e72-03d5-483b-8412-0d8dfacfa662 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:37:00.310654 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8a136e72-03d5-483b-8412-0d8dfacfa662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:37:00.373935 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 566/1112] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:37:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:37:00.398276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6a7b7-a2db-4d0e-b391-f3b4ce3da062 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:00.494474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6a7b7-a2db-4d0e-b391-f3b4ce3da062 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:00.525725 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103fe08-c360-43e9-a0c4-0920cb167c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:00.526562 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103fe08-c360-43e9-a0c4-0920cb167c0f None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:00.526836 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103fe08-c360-43e9-a0c4-0920cb167c0f None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:00.527650 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103fe08-c360-43e9-a0c4-0920cb167c0f None admin] PATH_INFO: `/v3/roles/c25cb9d119a74c7281a986fa76a92af6` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:00.529275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103fe08-c360-43e9-a0c4-0920cb167c0f None admin] RBAC: Authorizing `identity:get_role(role_id=c25cb9d119a74c7281a986fa76a92af6)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:00.530619 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103fe08-c360-43e9-a0c4-0920cb167c0f None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:00.531959 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 547/1113] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:37:00 2022] GET /identity/v3/roles/c25cb9d119a74c7281a986fa76a92af6 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:00.537756 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a136e72-03d5-483b-8412-0d8dfacfa662 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:00.630439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a136e72-03d5-483b-8412-0d8dfacfa662 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:00.663253 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c094ba-3250-4804-bf7c-f2f16b11c3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:00.664106 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c094ba-3250-4804-bf7c-f2f16b11c3e1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:00.664388 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c094ba-3250-4804-bf7c-f2f16b11c3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:00.664692 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c094ba-3250-4804-bf7c-f2f16b11c3e1 None admin] PATH_INFO: `/v3/users/707ee9d2069244668b7f7f77db831694` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:00.677286 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c094ba-3250-4804-bf7c-f2f16b11c3e1 None admin] RBAC: Authorizing `identity:get_user(user_id=707ee9d2069244668b7f7f77db831694)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:00.678738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c094ba-3250-4804-bf7c-f2f16b11c3e1 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:00.680394 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 567/1114] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:37:00 2022] GET /identity/v3/users/707ee9d2069244668b7f7f77db831694 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:00.686373 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103fe08-c360-43e9-a0c4-0920cb167c0f None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:00.781878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103fe08-c360-43e9-a0c4-0920cb167c0f None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:00.813078 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf7330-ad6e-4d20-99bb-6ae148fa7189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:00.813654 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf7330-ad6e-4d20-99bb-6ae148fa7189 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:00.813934 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf7330-ad6e-4d20-99bb-6ae148fa7189 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:00.814208 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf7330-ad6e-4d20-99bb-6ae148fa7189 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:00.876917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf7330-ad6e-4d20-99bb-6ae148fa7189 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:00.878340 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf7330-ad6e-4d20-99bb-6ae148fa7189 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:00.970482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 548/1115] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:37:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 14 21:37:00.976323 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c094ba-3250-4804-bf7c-f2f16b11c3e1 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:01.073921 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c094ba-3250-4804-bf7c-f2f16b11c3e1 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:01.106230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9f2fc-da01-4c6a-b6b6-a4630d547040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:01.107079 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9f2fc-da01-4c6a-b6b6-a4630d547040 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:01.107362 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9f2fc-da01-4c6a-b6b6-a4630d547040 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:01.107664 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9f2fc-da01-4c6a-b6b6-a4630d547040 None admin] PATH_INFO: `/v3/projects/d937cd6be08f4d2c814c38df37f91dfc` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:01.109366 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9f2fc-da01-4c6a-b6b6-a4630d547040 None admin] RBAC: Authorizing `identity:get_project(project_id=d937cd6be08f4d2c814c38df37f91dfc)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:01.110803 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9f2fc-da01-4c6a-b6b6-a4630d547040 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:01.112483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 568/1116] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:37:00 2022] GET /identity/v3/projects/d937cd6be08f4d2c814c38df37f91dfc => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:01.118711 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf7330-ad6e-4d20-99bb-6ae148fa7189 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:01.213886 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf7330-ad6e-4d20-99bb-6ae148fa7189 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:01.245316 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204691e-8401-4161-8307-0d004641b718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:01.246638 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204691e-8401-4161-8307-0d004641b718 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:01.246923 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204691e-8401-4161-8307-0d004641b718 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:01.247195 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204691e-8401-4161-8307-0d004641b718 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:01.248012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204691e-8401-4161-8307-0d004641b718 None admin] RBAC: Adding query filter params (role.id=c25cb9d119a74c7281a986fa76a92af6, scope.project.id=d937cd6be08f4d2c814c38df37f91dfc, user.id=707ee9d2069244668b7f7f77db831694) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:37:01.248316 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204691e-8401-4161-8307-0d004641b718 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:01.249748 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204691e-8401-4161-8307-0d004641b718 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:01.254914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 549/1117] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:37:01 2022] GET /identity/v3/role_assignments?user.id=707ee9d2069244668b7f7f77db831694&scope.project.id=d937cd6be08f4d2c814c38df37f91dfc&role.id=c25cb9d119a74c7281a986fa76a92af6 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:03.553657 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5ffc5-ce43-45e0-a8fa-fc0dda93a10b None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:03.554204 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5ffc5-ce43-45e0-a8fa-fc0dda93a10b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:03.554204 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5ffc5-ce43-45e0-a8fa-fc0dda93a10b None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:03.555581 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 569/1118] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:37:03.561829 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33321b-ef16-4120-b5e4-3b6565f23690 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:03.562219 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33321b-ef16-4120-b5e4-3b6565f23690 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:03.562375 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33321b-ef16-4120-b5e4-3b6565f23690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:03.579489 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-5a33321b-ef16-4120-b5e4-3b6565f23690 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:37:03.580677 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5a33321b-ef16-4120-b5e4-3b6565f23690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:37:03.645562 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 550/1119] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:37:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:37:03.668419 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5ffc5-ce43-45e0-a8fa-fc0dda93a10b None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:03.764851 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5ffc5-ce43-45e0-a8fa-fc0dda93a10b None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:03.798715 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2b5f3-4d8c-4440-b8aa-40f600882b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:03.799555 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2b5f3-4d8c-4440-b8aa-40f600882b51 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:03.799835 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2b5f3-4d8c-4440-b8aa-40f600882b51 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:03.800108 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2b5f3-4d8c-4440-b8aa-40f600882b51 None admin] PATH_INFO: `/v3/roles/c25cb9d119a74c7281a986fa76a92af6` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:03.801594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2b5f3-4d8c-4440-b8aa-40f600882b51 None admin] RBAC: Authorizing `identity:get_role(role_id=c25cb9d119a74c7281a986fa76a92af6)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:03.802963 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2b5f3-4d8c-4440-b8aa-40f600882b51 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:03.804366 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 570/1120] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:37:03 2022] GET /identity/v3/roles/c25cb9d119a74c7281a986fa76a92af6 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:03.810662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33321b-ef16-4120-b5e4-3b6565f23690 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:03.903314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33321b-ef16-4120-b5e4-3b6565f23690 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:03.935982 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726309fa-b63b-4a8d-9df8-9e7e89a49cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:03.936860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726309fa-b63b-4a8d-9df8-9e7e89a49cdf None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:03.937137 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726309fa-b63b-4a8d-9df8-9e7e89a49cdf None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:03.937403 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726309fa-b63b-4a8d-9df8-9e7e89a49cdf None admin] PATH_INFO: `/v3/users/707ee9d2069244668b7f7f77db831694` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:03.938573 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726309fa-b63b-4a8d-9df8-9e7e89a49cdf None admin] RBAC: Authorizing `identity:get_user(user_id=707ee9d2069244668b7f7f77db831694)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:03.940008 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726309fa-b63b-4a8d-9df8-9e7e89a49cdf None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:03.941629 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 551/1121] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:37:03 2022] GET /identity/v3/users/707ee9d2069244668b7f7f77db831694 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:03.947230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2b5f3-4d8c-4440-b8aa-40f600882b51 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:04.042318 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2b5f3-4d8c-4440-b8aa-40f600882b51 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:04.074237 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1459b-8a88-42e0-8d4f-2b940d3b07bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:04.075004 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1459b-8a88-42e0-8d4f-2b940d3b07bb None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:04.075280 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1459b-8a88-42e0-8d4f-2b940d3b07bb None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:04.075550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1459b-8a88-42e0-8d4f-2b940d3b07bb None admin] PATH_INFO: `/v3/projects/d937cd6be08f4d2c814c38df37f91dfc` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:04.076748 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1459b-8a88-42e0-8d4f-2b940d3b07bb None admin] RBAC: Authorizing `identity:get_project(project_id=d937cd6be08f4d2c814c38df37f91dfc)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:04.078176 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1459b-8a88-42e0-8d4f-2b940d3b07bb None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:04.079849 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 571/1122] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:37:03 2022] GET /identity/v3/projects/d937cd6be08f4d2c814c38df37f91dfc => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:04.087326 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726309fa-b63b-4a8d-9df8-9e7e89a49cdf None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:04.182212 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726309fa-b63b-4a8d-9df8-9e7e89a49cdf None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:04.214772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb2224-187d-4fa3-8daf-c6d0e5b58df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:04.215671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb2224-187d-4fa3-8daf-c6d0e5b58df4 None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:04.215959 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb2224-187d-4fa3-8daf-c6d0e5b58df4 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:04.216235 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb2224-187d-4fa3-8daf-c6d0e5b58df4 None admin] PATH_INFO: `/v3/projects/d937cd6be08f4d2c814c38df37f91dfc/users/707ee9d2069244668b7f7f77db831694/roles/c25cb9d119a74c7281a986fa76a92af6` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:04.218462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb2224-187d-4fa3-8daf-c6d0e5b58df4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d937cd6be08f4d2c814c38df37f91dfc, user_id=707ee9d2069244668b7f7f77db831694, role_id=c25cb9d119a74c7281a986fa76a92af6)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:04.219886 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb2224-187d-4fa3-8daf-c6d0e5b58df4 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:04.324013 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 552/1123] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:37:04 2022] PUT /identity/v3/projects/d937cd6be08f4d2c814c38df37f91dfc/users/707ee9d2069244668b7f7f77db831694/roles/c25cb9d119a74c7281a986fa76a92af6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:37:06.600749 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef5401-b415-4939-b3b8-79ce587a6bdf None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:06.601285 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef5401-b415-4939-b3b8-79ce587a6bdf None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:06.601285 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef5401-b415-4939-b3b8-79ce587a6bdf None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:06.602696 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 572/1124] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:37:06.608613 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef2af6-1123-4552-97b7-2057a910e221 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:06.609062 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef2af6-1123-4552-97b7-2057a910e221 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:06.609178 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef2af6-1123-4552-97b7-2057a910e221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:06.626026 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-c4ef2af6-1123-4552-97b7-2057a910e221 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:37:06.627210 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c4ef2af6-1123-4552-97b7-2057a910e221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:37:06.691853 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 553/1125] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:37:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:37:06.716890 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef5401-b415-4939-b3b8-79ce587a6bdf None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:06.813736 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef5401-b415-4939-b3b8-79ce587a6bdf None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:06.845444 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29794f7b-c59e-423d-8325-5e11c47c2c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:06.846284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29794f7b-c59e-423d-8325-5e11c47c2c3c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:06.846564 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29794f7b-c59e-423d-8325-5e11c47c2c3c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:06.846837 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29794f7b-c59e-423d-8325-5e11c47c2c3c None admin] PATH_INFO: `/v3/roles/c25cb9d119a74c7281a986fa76a92af6` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:06.848306 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29794f7b-c59e-423d-8325-5e11c47c2c3c None admin] RBAC: Authorizing `identity:get_role(role_id=c25cb9d119a74c7281a986fa76a92af6)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:06.849712 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29794f7b-c59e-423d-8325-5e11c47c2c3c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:06.851104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 573/1126] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:37:06 2022] GET /identity/v3/roles/c25cb9d119a74c7281a986fa76a92af6 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:06.857425 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef2af6-1123-4552-97b7-2057a910e221 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:06.949571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef2af6-1123-4552-97b7-2057a910e221 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:06.982167 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ba08d-0bb9-4f1e-a76b-e90c36300110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:06.983029 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ba08d-0bb9-4f1e-a76b-e90c36300110 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:06.983303 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ba08d-0bb9-4f1e-a76b-e90c36300110 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:06.983568 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ba08d-0bb9-4f1e-a76b-e90c36300110 None admin] PATH_INFO: `/v3/users/707ee9d2069244668b7f7f77db831694` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:06.985868 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ba08d-0bb9-4f1e-a76b-e90c36300110 None admin] RBAC: Authorizing `identity:get_user(user_id=707ee9d2069244668b7f7f77db831694)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:06.986497 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ba08d-0bb9-4f1e-a76b-e90c36300110 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:06.987787 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 554/1127] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:37:06 2022] GET /identity/v3/users/707ee9d2069244668b7f7f77db831694 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:06.993632 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29794f7b-c59e-423d-8325-5e11c47c2c3c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:07.088426 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29794f7b-c59e-423d-8325-5e11c47c2c3c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:07.121731 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61bdfe-1bd0-48e2-a770-9d7e46f7a274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:07.122303 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61bdfe-1bd0-48e2-a770-9d7e46f7a274 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:07.122582 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61bdfe-1bd0-48e2-a770-9d7e46f7a274 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:07.122853 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61bdfe-1bd0-48e2-a770-9d7e46f7a274 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:07.185361 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61bdfe-1bd0-48e2-a770-9d7e46f7a274 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:07.186823 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61bdfe-1bd0-48e2-a770-9d7e46f7a274 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:07.279156 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 574/1128] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:37:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 14 21:37:07.285117 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ba08d-0bb9-4f1e-a76b-e90c36300110 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:07.377338 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ba08d-0bb9-4f1e-a76b-e90c36300110 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:07.408959 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0f4f3-d1a4-46cc-a6af-ab5f8cce08c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:07.409790 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0f4f3-d1a4-46cc-a6af-ab5f8cce08c8 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:07.410066 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0f4f3-d1a4-46cc-a6af-ab5f8cce08c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:07.410333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0f4f3-d1a4-46cc-a6af-ab5f8cce08c8 None admin] PATH_INFO: `/v3/projects/d937cd6be08f4d2c814c38df37f91dfc` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:07.411488 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0f4f3-d1a4-46cc-a6af-ab5f8cce08c8 None admin] RBAC: Authorizing `identity:get_project(project_id=d937cd6be08f4d2c814c38df37f91dfc)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:07.412920 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0f4f3-d1a4-46cc-a6af-ab5f8cce08c8 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:07.414562 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 555/1129] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:37:07 2022] GET /identity/v3/projects/d937cd6be08f4d2c814c38df37f91dfc => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:07.421796 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61bdfe-1bd0-48e2-a770-9d7e46f7a274 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:07.515016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61bdfe-1bd0-48e2-a770-9d7e46f7a274 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:07.546970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6c7e3-0fd1-4fc2-97a4-bc332f375b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:07.547596 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6c7e3-0fd1-4fc2-97a4-bc332f375b24 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:07.547869 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6c7e3-0fd1-4fc2-97a4-bc332f375b24 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:07.548137 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6c7e3-0fd1-4fc2-97a4-bc332f375b24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:07.549014 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6c7e3-0fd1-4fc2-97a4-bc332f375b24 None admin] RBAC: Adding query filter params (role.id=c25cb9d119a74c7281a986fa76a92af6, scope.project.id=d937cd6be08f4d2c814c38df37f91dfc, user.id=707ee9d2069244668b7f7f77db831694) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:37:07.549322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6c7e3-0fd1-4fc2-97a4-bc332f375b24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:07.550743 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6c7e3-0fd1-4fc2-97a4-bc332f375b24 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:07.556374 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 575/1130] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:37:07 2022] GET /identity/v3/role_assignments?user.id=707ee9d2069244668b7f7f77db831694&scope.project.id=d937cd6be08f4d2c814c38df37f91dfc&role.id=c25cb9d119a74c7281a986fa76a92af6 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:09.862453 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbea59-a6e7-4f23-b503-9356513107c3 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:09.863015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbea59-a6e7-4f23-b503-9356513107c3 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:09.863015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbea59-a6e7-4f23-b503-9356513107c3 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:09.864390 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 556/1131] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:37:09.869525 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766253bc-d09a-4c30-bf55-547c55e2b6c3 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:09.869899 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766253bc-d09a-4c30-bf55-547c55e2b6c3 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:09.870097 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766253bc-d09a-4c30-bf55-547c55e2b6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:09.887693 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-766253bc-d09a-4c30-bf55-547c55e2b6c3 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:37:09.888895 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-766253bc-d09a-4c30-bf55-547c55e2b6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:37:09.950577 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 576/1132] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:37:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:37:09.974958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbea59-a6e7-4f23-b503-9356513107c3 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:10.071716 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbea59-a6e7-4f23-b503-9356513107c3 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:10.106673 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac8422-0bb6-4ceb-b9ff-d06dc8d64a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:10.107663 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac8422-0bb6-4ceb-b9ff-d06dc8d64a69 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:10.107938 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac8422-0bb6-4ceb-b9ff-d06dc8d64a69 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:10.108203 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac8422-0bb6-4ceb-b9ff-d06dc8d64a69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:10.109383 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac8422-0bb6-4ceb-b9ff-d06dc8d64a69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:10.111244 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac8422-0bb6-4ceb-b9ff-d06dc8d64a69 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:10.112929 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 557/1133] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:37:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:10.119058 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766253bc-d09a-4c30-bf55-547c55e2b6c3 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:10.212342 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766253bc-d09a-4c30-bf55-547c55e2b6c3 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:10.245387 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191c6b1-72bc-458d-b48e-0ffc6456eba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:10.246067 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191c6b1-72bc-458d-b48e-0ffc6456eba2 None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:10.246345 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191c6b1-72bc-458d-b48e-0ffc6456eba2 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:10.246617 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191c6b1-72bc-458d-b48e-0ffc6456eba2 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:10.247323 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191c6b1-72bc-458d-b48e-0ffc6456eba2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:10.248769 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191c6b1-72bc-458d-b48e-0ffc6456eba2 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:10.348190 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 577/1134] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Apr 14 21:37:10 2022] POST /identity/v3/projects => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:37:12.666039 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e982b0-7f8c-4fa0-a3bb-04a4753a80b2 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:12.666571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e982b0-7f8c-4fa0-a3bb-04a4753a80b2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:12.666571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e982b0-7f8c-4fa0-a3bb-04a4753a80b2 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:12.668467 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 558/1135] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:37:12.673612 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c86db-d64c-44e5-8192-4a638f8ffde0 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:12.674044 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c86db-d64c-44e5-8192-4a638f8ffde0 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:12.674160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c86db-d64c-44e5-8192-4a638f8ffde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:12.690970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-765c86db-d64c-44e5-8192-4a638f8ffde0 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:37:12.692135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-765c86db-d64c-44e5-8192-4a638f8ffde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:37:12.755065 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 578/1136] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:37:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:37:12.780850 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e982b0-7f8c-4fa0-a3bb-04a4753a80b2 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:12.877731 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e982b0-7f8c-4fa0-a3bb-04a4753a80b2 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:12.908955 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6608aa9-7d62-483b-9a7d-fb7f6f352d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:12.909732 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6608aa9-7d62-483b-9a7d-fb7f6f352d0a None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:12.910014 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6608aa9-7d62-483b-9a7d-fb7f6f352d0a None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:12.910287 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6608aa9-7d62-483b-9a7d-fb7f6f352d0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:12.911446 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6608aa9-7d62-483b-9a7d-fb7f6f352d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:12.912900 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6608aa9-7d62-483b-9a7d-fb7f6f352d0a None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:12.914501 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 559/1137] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:37:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:12.920931 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c86db-d64c-44e5-8192-4a638f8ffde0 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:13.016894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c86db-d64c-44e5-8192-4a638f8ffde0 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:13.049406 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f7fa9-92b8-464d-ac18-2b6db1a2ab38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:13.050060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f7fa9-92b8-464d-ac18-2b6db1a2ab38 None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:13.050337 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f7fa9-92b8-464d-ac18-2b6db1a2ab38 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:13.050608 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f7fa9-92b8-464d-ac18-2b6db1a2ab38 None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:13.051305 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f7fa9-92b8-464d-ac18-2b6db1a2ab38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:13.052867 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f7fa9-92b8-464d-ac18-2b6db1a2ab38 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:13.139463 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 579/1138] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:37:12 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:37:15.466663 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f02ce-5950-484f-bcc8-e1d9ca6bd997 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:15.467210 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f02ce-5950-484f-bcc8-e1d9ca6bd997 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:15.467210 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f02ce-5950-484f-bcc8-e1d9ca6bd997 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:15.468547 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 560/1139] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:37:15.473605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00666f-b492-4245-8b26-7d65888b8430 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:15.473992 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00666f-b492-4245-8b26-7d65888b8430 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:15.474111 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00666f-b492-4245-8b26-7d65888b8430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:15.490494 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-ba00666f-b492-4245-8b26-7d65888b8430 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:37:15.491671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ba00666f-b492-4245-8b26-7d65888b8430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:37:15.554283 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 580/1140] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:37:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:37:15.580039 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f02ce-5950-484f-bcc8-e1d9ca6bd997 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:15.675806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f02ce-5950-484f-bcc8-e1d9ca6bd997 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:15.707849 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf283d-1c07-4075-a10a-04e85ca24a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:15.708651 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf283d-1c07-4075-a10a-04e85ca24a15 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:15.708934 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf283d-1c07-4075-a10a-04e85ca24a15 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:15.709461 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf283d-1c07-4075-a10a-04e85ca24a15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:15.719272 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf283d-1c07-4075-a10a-04e85ca24a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:37:15.726095 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-04bf283d-1c07-4075-a10a-04e85ca24a15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:37:15.727253 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 561/1141] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:37:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:37:15.733784 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00666f-b492-4245-8b26-7d65888b8430 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:15.826610 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00666f-b492-4245-8b26-7d65888b8430 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:15.858499 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516c40b-a663-4de4-94ce-96474fb7040d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:15.859154 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516c40b-a663-4de4-94ce-96474fb7040d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:15.859429 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516c40b-a663-4de4-94ce-96474fb7040d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:15.859699 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516c40b-a663-4de4-94ce-96474fb7040d None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:15.860439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516c40b-a663-4de4-94ce-96474fb7040d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:37:15.860770 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516c40b-a663-4de4-94ce-96474fb7040d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:15.862126 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516c40b-a663-4de4-94ce-96474fb7040d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:15.870578 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 581/1142] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:37:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:15.876678 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf283d-1c07-4075-a10a-04e85ca24a15 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:15.976571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf283d-1c07-4075-a10a-04e85ca24a15 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:16.009539 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99400ba-28a5-4313-9af5-d71998766ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:16.010398 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99400ba-28a5-4313-9af5-d71998766ebf None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:16.010756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99400ba-28a5-4313-9af5-d71998766ebf None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:16.011028 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99400ba-28a5-4313-9af5-d71998766ebf None admin] PATH_INFO: `/v3/users/bbc2f052f8ae4051b3a4c6b6a5dc9520` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:16.023574 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99400ba-28a5-4313-9af5-d71998766ebf None admin] RBAC: Authorizing `identity:get_user(user_id=bbc2f052f8ae4051b3a4c6b6a5dc9520)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:16.025048 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99400ba-28a5-4313-9af5-d71998766ebf None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:16.027607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 562/1143] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:37:15 2022] GET /identity/v3/users/bbc2f052f8ae4051b3a4c6b6a5dc9520 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:16.033497 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516c40b-a663-4de4-94ce-96474fb7040d None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:16.129015 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516c40b-a663-4de4-94ce-96474fb7040d None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:16.160463 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc3357-cdd5-4ef4-abc7-5a152e6e33ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:16.161125 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc3357-cdd5-4ef4-abc7-5a152e6e33ad None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:16.161404 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc3357-cdd5-4ef4-abc7-5a152e6e33ad None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:16.161674 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc3357-cdd5-4ef4-abc7-5a152e6e33ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:16.226235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc3357-cdd5-4ef4-abc7-5a152e6e33ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:16.227721 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc3357-cdd5-4ef4-abc7-5a152e6e33ad None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:16.319164 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 582/1144] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:37:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 14 21:37:16.325065 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99400ba-28a5-4313-9af5-d71998766ebf None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:16.419400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99400ba-28a5-4313-9af5-d71998766ebf None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:16.451031 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7d62e-0ae8-4a66-b59e-94b8d87c1f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:16.451927 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d62e-0ae8-4a66-b59e-94b8d87c1f5e None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:16.452211 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d62e-0ae8-4a66-b59e-94b8d87c1f5e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:16.452481 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d62e-0ae8-4a66-b59e-94b8d87c1f5e None admin] PATH_INFO: `/v3/projects/f995763b50034326b42a3da3c045ebdc` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:16.453680 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7d62e-0ae8-4a66-b59e-94b8d87c1f5e None admin] RBAC: Authorizing `identity:get_project(project_id=f995763b50034326b42a3da3c045ebdc)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:16.455099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7d62e-0ae8-4a66-b59e-94b8d87c1f5e None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:16.456783 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 563/1145] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:37:16 2022] GET /identity/v3/projects/f995763b50034326b42a3da3c045ebdc => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:16.463131 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc3357-cdd5-4ef4-abc7-5a152e6e33ad None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:16.557238 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc3357-cdd5-4ef4-abc7-5a152e6e33ad None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:16.590431 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cfc2e-d2c9-4a40-b38b-1416e079316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:16.591066 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cfc2e-d2c9-4a40-b38b-1416e079316b None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:16.591347 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cfc2e-d2c9-4a40-b38b-1416e079316b None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:16.591618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cfc2e-d2c9-4a40-b38b-1416e079316b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:16.592496 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cfc2e-d2c9-4a40-b38b-1416e079316b None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=f995763b50034326b42a3da3c045ebdc, user.id=bbc2f052f8ae4051b3a4c6b6a5dc9520) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:37:16.592846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cfc2e-d2c9-4a40-b38b-1416e079316b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:16.594279 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cfc2e-d2c9-4a40-b38b-1416e079316b None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:16.599568 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 583/1146] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:37:16 2022] GET /identity/v3/role_assignments?user.id=bbc2f052f8ae4051b3a4c6b6a5dc9520&scope.project.id=f995763b50034326b42a3da3c045ebdc&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:18.869399 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eeb683-184b-4eb6-9cb6-3aa8dc83a477 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:18.870764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eeb683-184b-4eb6-9cb6-3aa8dc83a477 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:18.871045 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eeb683-184b-4eb6-9cb6-3aa8dc83a477 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:18.872417 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 564/1147] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:37:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:37:18.878185 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f77b5-c660-4ed6-9acc-6b6dbc532056 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:18.878185 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f77b5-c660-4ed6-9acc-6b6dbc532056 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:18.878697 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f77b5-c660-4ed6-9acc-6b6dbc532056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:18.895132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-8d5f77b5-c660-4ed6-9acc-6b6dbc532056 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:37:18.896473 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8d5f77b5-c660-4ed6-9acc-6b6dbc532056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:37:18.964415 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 584/1148] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:37:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:37:18.987370 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eeb683-184b-4eb6-9cb6-3aa8dc83a477 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:19.087428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eeb683-184b-4eb6-9cb6-3aa8dc83a477 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:19.132023 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431b697-b6ef-407b-b2ca-a5686c0fd54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:19.132766 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431b697-b6ef-407b-b2ca-a5686c0fd54d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:19.133049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431b697-b6ef-407b-b2ca-a5686c0fd54d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:19.133324 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431b697-b6ef-407b-b2ca-a5686c0fd54d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:19.143032 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431b697-b6ef-407b-b2ca-a5686c0fd54d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:37:19.149931 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-4431b697-b6ef-407b-b2ca-a5686c0fd54d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:37:19.151647 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 565/1149] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:37:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:37:19.159176 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f77b5-c660-4ed6-9acc-6b6dbc532056 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:19.252257 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f77b5-c660-4ed6-9acc-6b6dbc532056 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:19.283856 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb21c3b-f4b4-4a89-9051-99f01db6d09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:19.284503 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb21c3b-f4b4-4a89-9051-99f01db6d09f None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:19.284815 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb21c3b-f4b4-4a89-9051-99f01db6d09f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:19.285085 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb21c3b-f4b4-4a89-9051-99f01db6d09f None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:19.285822 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb21c3b-f4b4-4a89-9051-99f01db6d09f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:37:19.286130 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb21c3b-f4b4-4a89-9051-99f01db6d09f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:19.287488 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb21c3b-f4b4-4a89-9051-99f01db6d09f None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:19.295755 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 585/1150] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:37:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:19.301475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431b697-b6ef-407b-b2ca-a5686c0fd54d None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:19.396467 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431b697-b6ef-407b-b2ca-a5686c0fd54d None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:19.427747 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cd346-3215-4140-b6a7-0fdaa6447c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:19.428612 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cd346-3215-4140-b6a7-0fdaa6447c01 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:19.428897 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cd346-3215-4140-b6a7-0fdaa6447c01 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:19.429167 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cd346-3215-4140-b6a7-0fdaa6447c01 None admin] PATH_INFO: `/v3/users/bbc2f052f8ae4051b3a4c6b6a5dc9520` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:19.430332 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cd346-3215-4140-b6a7-0fdaa6447c01 None admin] RBAC: Authorizing `identity:get_user(user_id=bbc2f052f8ae4051b3a4c6b6a5dc9520)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:19.431743 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cd346-3215-4140-b6a7-0fdaa6447c01 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:19.433530 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 566/1151] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:37:19 2022] GET /identity/v3/users/bbc2f052f8ae4051b3a4c6b6a5dc9520 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:19.439367 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb21c3b-f4b4-4a89-9051-99f01db6d09f None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:19.532986 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb21c3b-f4b4-4a89-9051-99f01db6d09f None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:19.563853 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b026d9f-b830-4990-8c4e-07e743e8639e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:19.564701 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b026d9f-b830-4990-8c4e-07e743e8639e None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:19.564976 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b026d9f-b830-4990-8c4e-07e743e8639e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:19.565239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b026d9f-b830-4990-8c4e-07e743e8639e None admin] PATH_INFO: `/v3/projects/f995763b50034326b42a3da3c045ebdc` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:19.566392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b026d9f-b830-4990-8c4e-07e743e8639e None admin] RBAC: Authorizing `identity:get_project(project_id=f995763b50034326b42a3da3c045ebdc)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:19.567806 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b026d9f-b830-4990-8c4e-07e743e8639e None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:19.569482 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 586/1152] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:37:19 2022] GET /identity/v3/projects/f995763b50034326b42a3da3c045ebdc => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:19.576126 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cd346-3215-4140-b6a7-0fdaa6447c01 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:19.670917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cd346-3215-4140-b6a7-0fdaa6447c01 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:19.702358 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd18f10-e7f3-41ab-9e45-4f0bddc86072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:19.703230 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd18f10-e7f3-41ab-9e45-4f0bddc86072 None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:19.703510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd18f10-e7f3-41ab-9e45-4f0bddc86072 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:19.703782 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd18f10-e7f3-41ab-9e45-4f0bddc86072 None admin] PATH_INFO: `/v3/projects/f995763b50034326b42a3da3c045ebdc/users/bbc2f052f8ae4051b3a4c6b6a5dc9520/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:19.705726 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd18f10-e7f3-41ab-9e45-4f0bddc86072 None admin] RBAC: Authorizing `identity:create_grant(project_id=f995763b50034326b42a3da3c045ebdc, user_id=bbc2f052f8ae4051b3a4c6b6a5dc9520, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:19.707134 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd18f10-e7f3-41ab-9e45-4f0bddc86072 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:19.786182 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 567/1153] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:37:19 2022] PUT /identity/v3/projects/f995763b50034326b42a3da3c045ebdc/users/bbc2f052f8ae4051b3a4c6b6a5dc9520/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:37:22.082859 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b465936-98f3-48e9-a005-e514806c5395 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:22.083385 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b465936-98f3-48e9-a005-e514806c5395 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:22.083385 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b465936-98f3-48e9-a005-e514806c5395 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:22.085065 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 587/1154] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:37:22.090137 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e01763-0c0f-4a6a-ada9-2f6271dff393 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:22.090557 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e01763-0c0f-4a6a-ada9-2f6271dff393 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:22.090704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e01763-0c0f-4a6a-ada9-2f6271dff393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:22.107084 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-f4e01763-0c0f-4a6a-ada9-2f6271dff393 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:37:22.108276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f4e01763-0c0f-4a6a-ada9-2f6271dff393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:37:22.171737 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 568/1155] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:37:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:37:22.196346 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b465936-98f3-48e9-a005-e514806c5395 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:22.291953 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b465936-98f3-48e9-a005-e514806c5395 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:22.324061 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ba8f3-0a0d-41e0-933f-9b857d373b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:22.324861 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ba8f3-0a0d-41e0-933f-9b857d373b2c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:22.325143 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ba8f3-0a0d-41e0-933f-9b857d373b2c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:22.325416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ba8f3-0a0d-41e0-933f-9b857d373b2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:22.335277 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ba8f3-0a0d-41e0-933f-9b857d373b2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:37:22.342145 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-b06ba8f3-0a0d-41e0-933f-9b857d373b2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:37:22.343315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 588/1156] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:37:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:37:22.349311 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e01763-0c0f-4a6a-ada9-2f6271dff393 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:22.443845 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e01763-0c0f-4a6a-ada9-2f6271dff393 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:22.475904 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56939e-7049-426d-be17-b0cc53c3eb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:22.476549 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56939e-7049-426d-be17-b0cc53c3eb91 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:22.476853 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56939e-7049-426d-be17-b0cc53c3eb91 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:22.477123 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56939e-7049-426d-be17-b0cc53c3eb91 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:22.477858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56939e-7049-426d-be17-b0cc53c3eb91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:37:22.478159 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56939e-7049-426d-be17-b0cc53c3eb91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:22.480501 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56939e-7049-426d-be17-b0cc53c3eb91 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:22.488044 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 569/1157] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:37:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:22.493628 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ba8f3-0a0d-41e0-933f-9b857d373b2c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:22.587435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ba8f3-0a0d-41e0-933f-9b857d373b2c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:22.620683 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02a8a6-eee8-405c-b8b9-401bbe059826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:22.621526 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02a8a6-eee8-405c-b8b9-401bbe059826 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:22.621799 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02a8a6-eee8-405c-b8b9-401bbe059826 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:22.622064 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02a8a6-eee8-405c-b8b9-401bbe059826 None admin] PATH_INFO: `/v3/users/bbc2f052f8ae4051b3a4c6b6a5dc9520` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:22.623232 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02a8a6-eee8-405c-b8b9-401bbe059826 None admin] RBAC: Authorizing `identity:get_user(user_id=bbc2f052f8ae4051b3a4c6b6a5dc9520)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:22.624676 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02a8a6-eee8-405c-b8b9-401bbe059826 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:22.626259 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 589/1158] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:37:22 2022] GET /identity/v3/users/bbc2f052f8ae4051b3a4c6b6a5dc9520 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:22.632010 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56939e-7049-426d-be17-b0cc53c3eb91 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:22.727695 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56939e-7049-426d-be17-b0cc53c3eb91 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:22.760819 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cc299-fbcd-42d7-8596-545c9e4420f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:22.761462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cc299-fbcd-42d7-8596-545c9e4420f0 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:22.761740 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cc299-fbcd-42d7-8596-545c9e4420f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:22.762012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cc299-fbcd-42d7-8596-545c9e4420f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:22.825271 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cc299-fbcd-42d7-8596-545c9e4420f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:22.826699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cc299-fbcd-42d7-8596-545c9e4420f0 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:22.919569 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 570/1159] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:37:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 14 21:37:22.925323 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02a8a6-eee8-405c-b8b9-401bbe059826 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:23.019956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02a8a6-eee8-405c-b8b9-401bbe059826 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:23.051923 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69a6ec-9d15-4ad3-84e5-c25224d8a0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:23.052780 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69a6ec-9d15-4ad3-84e5-c25224d8a0d1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:23.053060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69a6ec-9d15-4ad3-84e5-c25224d8a0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:23.053327 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69a6ec-9d15-4ad3-84e5-c25224d8a0d1 None admin] PATH_INFO: `/v3/projects/f995763b50034326b42a3da3c045ebdc` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:23.054497 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69a6ec-9d15-4ad3-84e5-c25224d8a0d1 None admin] RBAC: Authorizing `identity:get_project(project_id=f995763b50034326b42a3da3c045ebdc)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:23.055919 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69a6ec-9d15-4ad3-84e5-c25224d8a0d1 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:23.058100 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 590/1160] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:37:22 2022] GET /identity/v3/projects/f995763b50034326b42a3da3c045ebdc => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:23.064124 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cc299-fbcd-42d7-8596-545c9e4420f0 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:23.281975 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cc299-fbcd-42d7-8596-545c9e4420f0 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:23.314339 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9a5e8-8090-4124-afed-bcf38579f8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:23.315061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9a5e8-8090-4124-afed-bcf38579f8f5 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:23.315342 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9a5e8-8090-4124-afed-bcf38579f8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:23.315615 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9a5e8-8090-4124-afed-bcf38579f8f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:23.316439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9a5e8-8090-4124-afed-bcf38579f8f5 None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=f995763b50034326b42a3da3c045ebdc, user.id=bbc2f052f8ae4051b3a4c6b6a5dc9520) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:37:23.316774 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9a5e8-8090-4124-afed-bcf38579f8f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:23.318182 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9a5e8-8090-4124-afed-bcf38579f8f5 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:23.323703 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 571/1161] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:37:23 2022] GET /identity/v3/role_assignments?user.id=bbc2f052f8ae4051b3a4c6b6a5dc9520&scope.project.id=f995763b50034326b42a3da3c045ebdc&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:25.683498 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e614c-e082-4078-8552-11d97447f5d9 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:25.684032 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e614c-e082-4078-8552-11d97447f5d9 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:25.684032 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e614c-e082-4078-8552-11d97447f5d9 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:25.685435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 591/1162] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:37:25.690634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de61b00-c8ec-4445-9082-5bbad4022538 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:25.691046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de61b00-c8ec-4445-9082-5bbad4022538 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:25.691186 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de61b00-c8ec-4445-9082-5bbad4022538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:25.708082 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-5de61b00-c8ec-4445-9082-5bbad4022538 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:37:25.709567 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5de61b00-c8ec-4445-9082-5bbad4022538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:37:25.772807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 572/1163] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:37:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:37:25.795789 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e614c-e082-4078-8552-11d97447f5d9 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:25.890927 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e614c-e082-4078-8552-11d97447f5d9 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:25.922133 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de3bdb-ffba-4da2-9a2e-f4b656ca03b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:25.922760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de3bdb-ffba-4da2-9a2e-f4b656ca03b4 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:25.923034 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de3bdb-ffba-4da2-9a2e-f4b656ca03b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:25.923301 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de3bdb-ffba-4da2-9a2e-f4b656ca03b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:25.987306 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de3bdb-ffba-4da2-9a2e-f4b656ca03b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:25.988792 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de3bdb-ffba-4da2-9a2e-f4b656ca03b4 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:26.084323 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 592/1164] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:37:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 14 21:37:26.091870 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de61b00-c8ec-4445-9082-5bbad4022538 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:26.184402 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de61b00-c8ec-4445-9082-5bbad4022538 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:26.216057 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997d372-d7ea-4ae8-93f5-84c4220e1a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:26.216876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997d372-d7ea-4ae8-93f5-84c4220e1a45 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:26.217159 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997d372-d7ea-4ae8-93f5-84c4220e1a45 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:26.217431 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997d372-d7ea-4ae8-93f5-84c4220e1a45 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:26.223885 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997d372-d7ea-4ae8-93f5-84c4220e1a45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:26.225334 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997d372-d7ea-4ae8-93f5-84c4220e1a45 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:26.239642 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-4997d372-d7ea-4ae8-93f5-84c4220e1a45 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 14 21:37:26.240758 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 573/1165] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Apr 14 21:37:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:37:26.247282 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de3bdb-ffba-4da2-9a2e-f4b656ca03b4 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:26.338703 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de3bdb-ffba-4da2-9a2e-f4b656ca03b4 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:26.370870 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3d4bf-d704-4860-b70a-087de87f0649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:26.371508 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3d4bf-d704-4860-b70a-087de87f0649 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:26.371784 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3d4bf-d704-4860-b70a-087de87f0649 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:26.372053 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3d4bf-d704-4860-b70a-087de87f0649 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:26.372788 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3d4bf-d704-4860-b70a-087de87f0649 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:37:26.373091 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3d4bf-d704-4860-b70a-087de87f0649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:26.374439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3d4bf-d704-4860-b70a-087de87f0649 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:26.381302 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 593/1166] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Apr 14 21:37:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:28.656466 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93048393-56e2-4ca0-ae38-31ccc9e4c276 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:28.657051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93048393-56e2-4ca0-ae38-31ccc9e4c276 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:28.657051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93048393-56e2-4ca0-ae38-31ccc9e4c276 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:28.658375 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 574/1167] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:37:28.663547 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f4909-2ee3-4441-806e-4ae04efdb77f None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:28.663965 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f4909-2ee3-4441-806e-4ae04efdb77f None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:28.664102 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f4909-2ee3-4441-806e-4ae04efdb77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:28.680388 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-150f4909-2ee3-4441-806e-4ae04efdb77f None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:37:28.681636 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-150f4909-2ee3-4441-806e-4ae04efdb77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:37:28.743814 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 594/1168] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:37:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:37:28.767884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93048393-56e2-4ca0-ae38-31ccc9e4c276 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:28.865703 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93048393-56e2-4ca0-ae38-31ccc9e4c276 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:28.898105 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef1a1b-5057-4376-86f6-e30dbddd70dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:28.898747 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef1a1b-5057-4376-86f6-e30dbddd70dd None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:28.899021 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef1a1b-5057-4376-86f6-e30dbddd70dd None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:28.899289 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef1a1b-5057-4376-86f6-e30dbddd70dd None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:28.900021 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef1a1b-5057-4376-86f6-e30dbddd70dd None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:28.901525 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef1a1b-5057-4376-86f6-e30dbddd70dd None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:28.980213 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 575/1169] 10.222.0.52 () {60 vars in 1138 bytes} [Thu Apr 14 21:37:28 2022] POST /identity/v3/domains => generated 267 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:37:31.315976 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a69b8-821a-4192-b8c0-7fa4d00e04ff None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:31.316483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a69b8-821a-4192-b8c0-7fa4d00e04ff None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:31.316483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a69b8-821a-4192-b8c0-7fa4d00e04ff None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:31.317973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 595/1170] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:37:31.323026 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d8816-4f54-4618-bacf-2b474375371d None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:31.323468 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d8816-4f54-4618-bacf-2b474375371d None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:31.323561 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d8816-4f54-4618-bacf-2b474375371d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:31.340406 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-5b1d8816-4f54-4618-bacf-2b474375371d None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:37:31.341593 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5b1d8816-4f54-4618-bacf-2b474375371d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:37:31.403436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 576/1171] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:37:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:37:31.428566 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a69b8-821a-4192-b8c0-7fa4d00e04ff None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:31.523840 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a69b8-821a-4192-b8c0-7fa4d00e04ff None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:31.555380 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e6a77-3edc-40ab-b621-6be86952b508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:31.556306 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e6a77-3edc-40ab-b621-6be86952b508 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:31.557235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e6a77-3edc-40ab-b621-6be86952b508 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:31.557528 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e6a77-3edc-40ab-b621-6be86952b508 None admin] PATH_INFO: `/v3/domains/51c1d57e9cd94ee79f922a1d52e223b7` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:31.567673 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e6a77-3edc-40ab-b621-6be86952b508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=51c1d57e9cd94ee79f922a1d52e223b7)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:31.572655 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e6a77-3edc-40ab-b621-6be86952b508 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:31.572655 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 596/1172] 10.222.0.52 () {56 vars in 1183 bytes} [Thu Apr 14 21:37:31 2022] GET /identity/v3/domains/51c1d57e9cd94ee79f922a1d52e223b7 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:31.577584 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d8816-4f54-4618-bacf-2b474375371d None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:31.668963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d8816-4f54-4618-bacf-2b474375371d None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:31.701236 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63301f6b-abde-4d4f-9d2a-52fd3c38915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:31.701873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63301f6b-abde-4d4f-9d2a-52fd3c38915a None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:31.702146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63301f6b-abde-4d4f-9d2a-52fd3c38915a None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:31.702673 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63301f6b-abde-4d4f-9d2a-52fd3c38915a None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:31.703376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63301f6b-abde-4d4f-9d2a-52fd3c38915a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:31.704815 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63301f6b-abde-4d4f-9d2a-52fd3c38915a None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:31.815466 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 577/1173] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Apr 14 21:37:31 2022] POST /identity/v3/projects => generated 361 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:37:34.137333 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544511f1-4d0a-4c3a-9026-34d3bdb28d5a None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:34.137857 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544511f1-4d0a-4c3a-9026-34d3bdb28d5a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:34.137947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544511f1-4d0a-4c3a-9026-34d3bdb28d5a None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:34.139246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 597/1174] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:37:34.144623 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d487be-9091-4579-b0c7-f55e231a9096 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:34.145009 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d487be-9091-4579-b0c7-f55e231a9096 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:34.145185 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d487be-9091-4579-b0c7-f55e231a9096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:34.163694 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-e0d487be-9091-4579-b0c7-f55e231a9096 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:37:34.164894 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e0d487be-9091-4579-b0c7-f55e231a9096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:37:34.229257 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 578/1175] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:37:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:37:34.256070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544511f1-4d0a-4c3a-9026-34d3bdb28d5a None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:34.352644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544511f1-4d0a-4c3a-9026-34d3bdb28d5a None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:34.385138 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b39d87-ea72-46ac-aeba-b67545373a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:34.385975 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b39d87-ea72-46ac-aeba-b67545373a90 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:34.386253 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b39d87-ea72-46ac-aeba-b67545373a90 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:34.386525 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b39d87-ea72-46ac-aeba-b67545373a90 None admin] PATH_INFO: `/v3/domains/51c1d57e9cd94ee79f922a1d52e223b7` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:34.387698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b39d87-ea72-46ac-aeba-b67545373a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=51c1d57e9cd94ee79f922a1d52e223b7)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:34.389162 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b39d87-ea72-46ac-aeba-b67545373a90 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:34.390745 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 598/1176] 10.222.0.52 () {56 vars in 1183 bytes} [Thu Apr 14 21:37:34 2022] GET /identity/v3/domains/51c1d57e9cd94ee79f922a1d52e223b7 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:34.396496 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d487be-9091-4579-b0c7-f55e231a9096 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:34.488412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d487be-9091-4579-b0c7-f55e231a9096 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:34.520514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a4870-1907-45f4-a89a-aa36e9b671f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:34.521134 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a4870-1907-45f4-a89a-aa36e9b671f2 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:34.521413 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a4870-1907-45f4-a89a-aa36e9b671f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:34.521689 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a4870-1907-45f4-a89a-aa36e9b671f2 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:34.522422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a4870-1907-45f4-a89a-aa36e9b671f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:34.523833 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a4870-1907-45f4-a89a-aa36e9b671f2 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:34.646932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 579/1177] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:37:34 2022] POST /identity/v3/users => generated 311 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:37:36.980938 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cb123-2571-49ed-a24f-515ce649f970 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:36.981471 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cb123-2571-49ed-a24f-515ce649f970 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:36.981648 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cb123-2571-49ed-a24f-515ce649f970 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:36.983116 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 599/1178] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:37:36.988607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52334b4-56dc-41b3-b98d-9c3601fb1e3f None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:36.989017 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52334b4-56dc-41b3-b98d-9c3601fb1e3f None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:36.989152 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52334b4-56dc-41b3-b98d-9c3601fb1e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:37.005778 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d52334b4-56dc-41b3-b98d-9c3601fb1e3f None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:37:37.006932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d52334b4-56dc-41b3-b98d-9c3601fb1e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:37:37.068494 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 580/1179] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:37:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:37:37.093935 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cb123-2571-49ed-a24f-515ce649f970 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:37.189101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cb123-2571-49ed-a24f-515ce649f970 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:37.222191 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfbf0b-68a6-4b37-969a-87d355288bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:37.222959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfbf0b-68a6-4b37-969a-87d355288bef None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:37.223235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfbf0b-68a6-4b37-969a-87d355288bef None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:37.223505 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfbf0b-68a6-4b37-969a-87d355288bef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:37.233668 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfbf0b-68a6-4b37-969a-87d355288bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:37:37.240362 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-cfbfbf0b-68a6-4b37-969a-87d355288bef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:37:37.241556 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 600/1180] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:37:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:37:37.248444 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52334b4-56dc-41b3-b98d-9c3601fb1e3f None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:37.340509 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52334b4-56dc-41b3-b98d-9c3601fb1e3f None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:37.372204 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d7ce1-e79a-4117-9ff1-5628846d9ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:37.372867 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d7ce1-e79a-4117-9ff1-5628846d9ab9 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:37.373142 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d7ce1-e79a-4117-9ff1-5628846d9ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:37.373408 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d7ce1-e79a-4117-9ff1-5628846d9ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:37.374142 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d7ce1-e79a-4117-9ff1-5628846d9ab9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:37:37.374441 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d7ce1-e79a-4117-9ff1-5628846d9ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:37.375790 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d7ce1-e79a-4117-9ff1-5628846d9ab9 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:37.383274 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 581/1181] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:37:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:37.389719 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfbf0b-68a6-4b37-969a-87d355288bef None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:37.484287 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfbf0b-68a6-4b37-969a-87d355288bef None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:37.515619 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8909b8-af25-42a6-ac96-ab8a87ab0dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:37.516452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8909b8-af25-42a6-ac96-ab8a87ab0dbc None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:37.516768 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8909b8-af25-42a6-ac96-ab8a87ab0dbc None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:37.517040 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8909b8-af25-42a6-ac96-ab8a87ab0dbc None admin] PATH_INFO: `/v3/users/1b3698f41f3a4e5c98189d3e06c52c4f` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:37.529491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8909b8-af25-42a6-ac96-ab8a87ab0dbc None admin] RBAC: Authorizing `identity:get_user(user_id=1b3698f41f3a4e5c98189d3e06c52c4f)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:37.530927 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8909b8-af25-42a6-ac96-ab8a87ab0dbc None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:37.532559 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 601/1182] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:37:37 2022] GET /identity/v3/users/1b3698f41f3a4e5c98189d3e06c52c4f => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:37.538361 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d7ce1-e79a-4117-9ff1-5628846d9ab9 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:37.634470 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d7ce1-e79a-4117-9ff1-5628846d9ab9 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:37.666415 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669ff36-e630-4382-b3ee-a9c31a71b8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:37.667044 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669ff36-e630-4382-b3ee-a9c31a71b8bb None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:37.667323 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669ff36-e630-4382-b3ee-a9c31a71b8bb None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:37.667596 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669ff36-e630-4382-b3ee-a9c31a71b8bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:37.731594 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669ff36-e630-4382-b3ee-a9c31a71b8bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:37.733047 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669ff36-e630-4382-b3ee-a9c31a71b8bb None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:37.826001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 582/1183] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:37:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 14 21:37:37.831830 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8909b8-af25-42a6-ac96-ab8a87ab0dbc None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:37.926284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8909b8-af25-42a6-ac96-ab8a87ab0dbc None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:37.957684 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62263e0-c842-44c2-a69b-313d24f7493a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:37.958841 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62263e0-c842-44c2-a69b-313d24f7493a None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:37.959121 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62263e0-c842-44c2-a69b-313d24f7493a None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:37.959391 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62263e0-c842-44c2-a69b-313d24f7493a None admin] PATH_INFO: `/v3/projects/86fca008c1a342deb033b159153d91f7` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:37.960555 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62263e0-c842-44c2-a69b-313d24f7493a None admin] RBAC: Authorizing `identity:get_project(project_id=86fca008c1a342deb033b159153d91f7)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:37.962003 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62263e0-c842-44c2-a69b-313d24f7493a None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:37.964320 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 602/1184] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:37:37 2022] GET /identity/v3/projects/86fca008c1a342deb033b159153d91f7 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:37.970369 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669ff36-e630-4382-b3ee-a9c31a71b8bb None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:38.063966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669ff36-e630-4382-b3ee-a9c31a71b8bb None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:38.096451 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ed246-da97-439c-b660-d850046277c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:38.097133 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ed246-da97-439c-b660-d850046277c2 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:38.097411 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ed246-da97-439c-b660-d850046277c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:38.097683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ed246-da97-439c-b660-d850046277c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:38.098505 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ed246-da97-439c-b660-d850046277c2 None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=86fca008c1a342deb033b159153d91f7, user.id=1b3698f41f3a4e5c98189d3e06c52c4f) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:37:38.098813 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ed246-da97-439c-b660-d850046277c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:38.100247 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ed246-da97-439c-b660-d850046277c2 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:38.106048 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 583/1185] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:37:37 2022] GET /identity/v3/role_assignments?user.id=1b3698f41f3a4e5c98189d3e06c52c4f&scope.project.id=86fca008c1a342deb033b159153d91f7&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:37:40.369860 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ee72c-a8d5-4b11-8543-9603ae597937 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:40.370380 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ee72c-a8d5-4b11-8543-9603ae597937 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:40.370380 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ee72c-a8d5-4b11-8543-9603ae597937 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:40.371769 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 603/1186] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:37:40.377045 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82fbb2-1f17-4b6b-bb2f-de74811de56e None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:40.377486 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82fbb2-1f17-4b6b-bb2f-de74811de56e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:40.377575 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82fbb2-1f17-4b6b-bb2f-de74811de56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:40.394862 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-8c82fbb2-1f17-4b6b-bb2f-de74811de56e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:37:40.396030 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-8c82fbb2-1f17-4b6b-bb2f-de74811de56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:37:40.459207 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 584/1187] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:37:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:37:40.482287 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ee72c-a8d5-4b11-8543-9603ae597937 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:40.578454 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ee72c-a8d5-4b11-8543-9603ae597937 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:40.610892 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c26f1-7d67-47e8-a70a-61b9f41cdcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:40.611665 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c26f1-7d67-47e8-a70a-61b9f41cdcef None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:40.611942 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c26f1-7d67-47e8-a70a-61b9f41cdcef None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:40.612213 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c26f1-7d67-47e8-a70a-61b9f41cdcef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:40.622029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c26f1-7d67-47e8-a70a-61b9f41cdcef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:37:40.628816 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-ee6c26f1-7d67-47e8-a70a-61b9f41cdcef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:37:40.629988 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 604/1188] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:37:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:37:40.638046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82fbb2-1f17-4b6b-bb2f-de74811de56e None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:40.730980 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82fbb2-1f17-4b6b-bb2f-de74811de56e None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:40.762462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41644fe-be23-43ce-8a9d-4c7398f84265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:40.763118 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41644fe-be23-43ce-8a9d-4c7398f84265 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:40.763397 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41644fe-be23-43ce-8a9d-4c7398f84265 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:40.763669 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41644fe-be23-43ce-8a9d-4c7398f84265 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:40.764409 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41644fe-be23-43ce-8a9d-4c7398f84265 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:37:40.764868 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41644fe-be23-43ce-8a9d-4c7398f84265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:40.766225 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41644fe-be23-43ce-8a9d-4c7398f84265 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:40.773808 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 585/1189] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:37:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:37:40.780265 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c26f1-7d67-47e8-a70a-61b9f41cdcef None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:40.874965 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c26f1-7d67-47e8-a70a-61b9f41cdcef None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:40.906549 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307ede0-b02c-44b8-b856-e3c851bc7aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:40.907402 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307ede0-b02c-44b8-b856-e3c851bc7aad None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:40.907683 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307ede0-b02c-44b8-b856-e3c851bc7aad None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:40.907954 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307ede0-b02c-44b8-b856-e3c851bc7aad None admin] PATH_INFO: `/v3/users/1b3698f41f3a4e5c98189d3e06c52c4f` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:40.909150 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307ede0-b02c-44b8-b856-e3c851bc7aad None admin] RBAC: Authorizing `identity:get_user(user_id=1b3698f41f3a4e5c98189d3e06c52c4f)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:40.910575 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307ede0-b02c-44b8-b856-e3c851bc7aad None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:40.912178 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 605/1190] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:37:40 2022] GET /identity/v3/users/1b3698f41f3a4e5c98189d3e06c52c4f => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:40.917818 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41644fe-be23-43ce-8a9d-4c7398f84265 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:41.013676 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41644fe-be23-43ce-8a9d-4c7398f84265 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:41.044816 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7842f-34d9-4e7d-9674-4fa94b0b50d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:41.045653 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7842f-34d9-4e7d-9674-4fa94b0b50d7 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:41.045930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7842f-34d9-4e7d-9674-4fa94b0b50d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:41.046200 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7842f-34d9-4e7d-9674-4fa94b0b50d7 None admin] PATH_INFO: `/v3/projects/86fca008c1a342deb033b159153d91f7` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:41.047354 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7842f-34d9-4e7d-9674-4fa94b0b50d7 None admin] RBAC: Authorizing `identity:get_project(project_id=86fca008c1a342deb033b159153d91f7)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:41.048791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7842f-34d9-4e7d-9674-4fa94b0b50d7 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:41.050454 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 586/1191] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:37:40 2022] GET /identity/v3/projects/86fca008c1a342deb033b159153d91f7 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:41.056974 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307ede0-b02c-44b8-b856-e3c851bc7aad None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:41.152126 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307ede0-b02c-44b8-b856-e3c851bc7aad None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:41.193211 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367eb206-55a6-4ee8-87a9-71e2177d5f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:41.194093 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367eb206-55a6-4ee8-87a9-71e2177d5f2f None admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:41.194376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367eb206-55a6-4ee8-87a9-71e2177d5f2f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:41.194650 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367eb206-55a6-4ee8-87a9-71e2177d5f2f None admin] PATH_INFO: `/v3/projects/86fca008c1a342deb033b159153d91f7/users/1b3698f41f3a4e5c98189d3e06c52c4f/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:41.196980 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367eb206-55a6-4ee8-87a9-71e2177d5f2f None admin] RBAC: Authorizing `identity:create_grant(project_id=86fca008c1a342deb033b159153d91f7, user_id=1b3698f41f3a4e5c98189d3e06c52c4f, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:41.198421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367eb206-55a6-4ee8-87a9-71e2177d5f2f None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:41.282598 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 606/1192] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:37:41 2022] PUT /identity/v3/projects/86fca008c1a342deb033b159153d91f7/users/1b3698f41f3a4e5c98189d3e06c52c4f/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:37:43.572987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ada1e-f9a3-4714-8631-9a7547eb9542 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:43.573559 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ada1e-f9a3-4714-8631-9a7547eb9542 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:43.573559 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ada1e-f9a3-4714-8631-9a7547eb9542 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:43.574875 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 587/1193] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:37:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:37:43.579967 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758f179-5484-4276-a8ee-9515fd9bea13 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:43.580385 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758f179-5484-4276-a8ee-9515fd9bea13 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:43.580495 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758f179-5484-4276-a8ee-9515fd9bea13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:43.598109 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-6758f179-5484-4276-a8ee-9515fd9bea13 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:37:43.599267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-6758f179-5484-4276-a8ee-9515fd9bea13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:37:43.662475 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 607/1194] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:37:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:37:43.686969 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ada1e-f9a3-4714-8631-9a7547eb9542 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:43.783442 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ada1e-f9a3-4714-8631-9a7547eb9542 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:43.814708 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84661d-68b1-4e5f-9939-f1d76b16d0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:43.815476 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84661d-68b1-4e5f-9939-f1d76b16d0d9 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:43.815756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84661d-68b1-4e5f-9939-f1d76b16d0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:43.816028 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84661d-68b1-4e5f-9939-f1d76b16d0d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:43.827337 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84661d-68b1-4e5f-9939-f1d76b16d0d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:37:43.834346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-4a84661d-68b1-4e5f-9939-f1d76b16d0d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:37:43.835499 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 588/1195] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:37:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:37:43.841560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758f179-5484-4276-a8ee-9515fd9bea13 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:43.936815 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758f179-5484-4276-a8ee-9515fd9bea13 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:43.971038 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663e0ea-b65e-439b-9347-254be203a1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:43.971716 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663e0ea-b65e-439b-9347-254be203a1c2 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:43.971993 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663e0ea-b65e-439b-9347-254be203a1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:43.972267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663e0ea-b65e-439b-9347-254be203a1c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:43.973048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663e0ea-b65e-439b-9347-254be203a1c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:37:43.973355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663e0ea-b65e-439b-9347-254be203a1c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:43.974732 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663e0ea-b65e-439b-9347-254be203a1c2 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:43.983508 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 608/1196] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:37:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:43.989013 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84661d-68b1-4e5f-9939-f1d76b16d0d9 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:44.086516 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84661d-68b1-4e5f-9939-f1d76b16d0d9 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:44.119536 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fed17-31ae-4651-a720-15ff6d75a785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:44.120396 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fed17-31ae-4651-a720-15ff6d75a785 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:44.120700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fed17-31ae-4651-a720-15ff6d75a785 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:44.120973 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fed17-31ae-4651-a720-15ff6d75a785 None admin] PATH_INFO: `/v3/users/1b3698f41f3a4e5c98189d3e06c52c4f` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:44.122139 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fed17-31ae-4651-a720-15ff6d75a785 None admin] RBAC: Authorizing `identity:get_user(user_id=1b3698f41f3a4e5c98189d3e06c52c4f)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:44.123550 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fed17-31ae-4651-a720-15ff6d75a785 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:44.125196 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 589/1197] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Apr 14 21:37:43 2022] GET /identity/v3/users/1b3698f41f3a4e5c98189d3e06c52c4f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:44.131016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663e0ea-b65e-439b-9347-254be203a1c2 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:44.231563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663e0ea-b65e-439b-9347-254be203a1c2 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:44.264122 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d932c-e762-4f40-9baf-9f6071aba2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:44.264782 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d932c-e762-4f40-9baf-9f6071aba2f9 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:44.265061 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d932c-e762-4f40-9baf-9f6071aba2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:44.265332 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d932c-e762-4f40-9baf-9f6071aba2f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:44.329584 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d932c-e762-4f40-9baf-9f6071aba2f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:44.331018 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d932c-e762-4f40-9baf-9f6071aba2f9 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:44.424627 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 609/1198] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:37:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 14 21:37:44.431556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fed17-31ae-4651-a720-15ff6d75a785 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:44.525761 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fed17-31ae-4651-a720-15ff6d75a785 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:44.557876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3658e-1e3b-440c-9551-454c6f3d4dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:44.558702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3658e-1e3b-440c-9551-454c6f3d4dd7 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:44.558976 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3658e-1e3b-440c-9551-454c6f3d4dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:44.559246 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3658e-1e3b-440c-9551-454c6f3d4dd7 None admin] PATH_INFO: `/v3/projects/86fca008c1a342deb033b159153d91f7` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:44.560387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3658e-1e3b-440c-9551-454c6f3d4dd7 None admin] RBAC: Authorizing `identity:get_project(project_id=86fca008c1a342deb033b159153d91f7)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:44.561827 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3658e-1e3b-440c-9551-454c6f3d4dd7 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:44.563465 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 590/1199] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Apr 14 21:37:44 2022] GET /identity/v3/projects/86fca008c1a342deb033b159153d91f7 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:37:44.569569 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d932c-e762-4f40-9baf-9f6071aba2f9 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:37:44.663172 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d932c-e762-4f40-9baf-9f6071aba2f9 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:37:44.695254 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b84d5-6167-48a0-8437-72109a561e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:37:44.695841 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b84d5-6167-48a0-8437-72109a561e4b None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:37:44.696153 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b84d5-6167-48a0-8437-72109a561e4b None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:37:44.696471 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b84d5-6167-48a0-8437-72109a561e4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:37:44.697357 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b84d5-6167-48a0-8437-72109a561e4b None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=86fca008c1a342deb033b159153d91f7, user.id=1b3698f41f3a4e5c98189d3e06c52c4f) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:37:44.697673 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b84d5-6167-48a0-8437-72109a561e4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:37:44.699100 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b84d5-6167-48a0-8437-72109a561e4b None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:37:44.704736 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 610/1200] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:37:44 2022] GET /identity/v3/role_assignments?user.id=1b3698f41f3a4e5c98189d3e06c52c4f&scope.project.id=86fca008c1a342deb033b159153d91f7&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:07.962794 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e55ac-5748-4d3a-8361-bd77e507b4f5 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:07.963428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e55ac-5748-4d3a-8361-bd77e507b4f5 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:07.963428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e55ac-5748-4d3a-8361-bd77e507b4f5 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:07.964717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 591/1201] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:39:07.970338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e6159-b529-4142-9d03-deabc3b19b6c None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:07.975211 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e6159-b529-4142-9d03-deabc3b19b6c None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:07.975211 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e6159-b529-4142-9d03-deabc3b19b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:07.987687 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-020e6159-b529-4142-9d03-deabc3b19b6c None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:39:07.988902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-020e6159-b529-4142-9d03-deabc3b19b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:39:08.054187 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 611/1202] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:39:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:39:08.080783 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e55ac-5748-4d3a-8361-bd77e507b4f5 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:08.178451 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e55ac-5748-4d3a-8361-bd77e507b4f5 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:08.211400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d81d1-b4f5-4d64-acef-f588bc2e2151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:08.212179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d81d1-b4f5-4d64-acef-f588bc2e2151 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:08.212458 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d81d1-b4f5-4d64-acef-f588bc2e2151 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:08.212764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d81d1-b4f5-4d64-acef-f588bc2e2151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:08.227361 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d81d1-b4f5-4d64-acef-f588bc2e2151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:08.227361 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d81d1-b4f5-4d64-acef-f588bc2e2151 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:08.240896 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-237d81d1-b4f5-4d64-acef-f588bc2e2151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:39:08.242053 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 592/1203] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:08.248208 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e6159-b529-4142-9d03-deabc3b19b6c None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:08.343750 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e6159-b529-4142-9d03-deabc3b19b6c None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:08.375418 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2101ef-1d98-4f48-94c6-bdd162a0a70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:08.376076 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2101ef-1d98-4f48-94c6-bdd162a0a70c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:08.376355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2101ef-1d98-4f48-94c6-bdd162a0a70c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:08.376652 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2101ef-1d98-4f48-94c6-bdd162a0a70c None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:08.377372 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2101ef-1d98-4f48-94c6-bdd162a0a70c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:08.377676 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2101ef-1d98-4f48-94c6-bdd162a0a70c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:08.379056 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2101ef-1d98-4f48-94c6-bdd162a0a70c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:08.390406 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 612/1204] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:08.396243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d81d1-b4f5-4d64-acef-f588bc2e2151 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:08.490795 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d81d1-b4f5-4d64-acef-f588bc2e2151 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:08.523235 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be81c8b-cd07-4835-b326-5d237c67d106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:08.523891 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be81c8b-cd07-4835-b326-5d237c67d106 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:08.524168 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be81c8b-cd07-4835-b326-5d237c67d106 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:08.524441 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be81c8b-cd07-4835-b326-5d237c67d106 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:08.525182 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be81c8b-cd07-4835-b326-5d237c67d106 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:08.526596 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be81c8b-cd07-4835-b326-5d237c67d106 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:08.652523 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 593/1205] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Apr 14 21:39:08 2022] POST /identity/v3/users => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:39:10.970798 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b51f9-9146-4202-97f4-d28c55b234e2 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:10.971371 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b51f9-9146-4202-97f4-d28c55b234e2 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:10.971371 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b51f9-9146-4202-97f4-d28c55b234e2 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:10.972973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 613/1206] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:39:10.978307 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cece52b-39bd-4c7d-8c10-827519e342df None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:10.978725 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cece52b-39bd-4c7d-8c10-827519e342df None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:10.978864 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cece52b-39bd-4c7d-8c10-827519e342df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:10.998109 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-8cece52b-39bd-4c7d-8c10-827519e342df None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:39:10.999498 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-8cece52b-39bd-4c7d-8c10-827519e342df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:39:11.080017 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 594/1207] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:39:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:39:11.109170 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b51f9-9146-4202-97f4-d28c55b234e2 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:11.213608 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b51f9-9146-4202-97f4-d28c55b234e2 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:11.252281 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177fd4d-7fdf-4c7b-a283-06ac215f638e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:11.253017 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177fd4d-7fdf-4c7b-a283-06ac215f638e None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:11.253293 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177fd4d-7fdf-4c7b-a283-06ac215f638e None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:11.253557 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177fd4d-7fdf-4c7b-a283-06ac215f638e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:11.264100 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177fd4d-7fdf-4c7b-a283-06ac215f638e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:39:11.271484 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-c177fd4d-7fdf-4c7b-a283-06ac215f638e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:39:11.272749 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 614/1208] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:39:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:11.278918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cece52b-39bd-4c7d-8c10-827519e342df None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:11.376216 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cece52b-39bd-4c7d-8c10-827519e342df None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:11.409249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057cdd0-05a7-497b-82c8-d92f7b2c32f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:11.409910 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057cdd0-05a7-497b-82c8-d92f7b2c32f5 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:11.410187 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057cdd0-05a7-497b-82c8-d92f7b2c32f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:11.410458 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057cdd0-05a7-497b-82c8-d92f7b2c32f5 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:11.411287 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057cdd0-05a7-497b-82c8-d92f7b2c32f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:11.411508 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057cdd0-05a7-497b-82c8-d92f7b2c32f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:11.413072 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057cdd0-05a7-497b-82c8-d92f7b2c32f5 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:11.421164 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 595/1209] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:39:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:11.426975 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177fd4d-7fdf-4c7b-a283-06ac215f638e None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:11.540118 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177fd4d-7fdf-4c7b-a283-06ac215f638e None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:11.566984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08a1bd-e856-42a6-aa90-a5d40a50d7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:11.568009 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08a1bd-e856-42a6-aa90-a5d40a50d7bb None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:11.568171 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08a1bd-e856-42a6-aa90-a5d40a50d7bb None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:11.568448 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08a1bd-e856-42a6-aa90-a5d40a50d7bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:11.578983 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08a1bd-e856-42a6-aa90-a5d40a50d7bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:11.580460 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08a1bd-e856-42a6-aa90-a5d40a50d7bb None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:11.597665 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-da08a1bd-e856-42a6-aa90-a5d40a50d7bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:39:11.598864 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 615/1210] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:11.604641 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057cdd0-05a7-497b-82c8-d92f7b2c32f5 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:11.700440 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057cdd0-05a7-497b-82c8-d92f7b2c32f5 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:11.733843 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92baaf7-bac3-4639-8d98-b5e9219c9138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:11.734503 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92baaf7-bac3-4639-8d98-b5e9219c9138 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:11.734781 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92baaf7-bac3-4639-8d98-b5e9219c9138 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:11.735051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92baaf7-bac3-4639-8d98-b5e9219c9138 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:11.735772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92baaf7-bac3-4639-8d98-b5e9219c9138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:11.736077 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92baaf7-bac3-4639-8d98-b5e9219c9138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:11.737528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92baaf7-bac3-4639-8d98-b5e9219c9138 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:11.748992 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 596/1211] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:11.754727 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08a1bd-e856-42a6-aa90-a5d40a50d7bb None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:11.851674 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08a1bd-e856-42a6-aa90-a5d40a50d7bb None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:11.886134 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d87f5-7522-4784-a743-590e5abff57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:11.886928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d87f5-7522-4784-a743-590e5abff57c None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:11.887211 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d87f5-7522-4784-a743-590e5abff57c None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:11.887485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d87f5-7522-4784-a743-590e5abff57c None admin] PATH_INFO: `/v3/users/placement` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:11.895554 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d87f5-7522-4784-a743-590e5abff57c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:11.897131 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d87f5-7522-4784-a743-590e5abff57c None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:11.911465 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-a60d87f5-7522-4784-a743-590e5abff57c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 14 21:39:11.913036 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 616/1212] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:11.918601 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92baaf7-bac3-4639-8d98-b5e9219c9138 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:12.016958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92baaf7-bac3-4639-8d98-b5e9219c9138 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:12.050062 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe44da-b833-4b9e-b19a-59aecc1e2928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:12.050727 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe44da-b833-4b9e-b19a-59aecc1e2928 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:12.051008 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe44da-b833-4b9e-b19a-59aecc1e2928 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:12.051283 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe44da-b833-4b9e-b19a-59aecc1e2928 None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:12.052111 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe44da-b833-4b9e-b19a-59aecc1e2928 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:12.052415 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe44da-b833-4b9e-b19a-59aecc1e2928 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:12.053852 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe44da-b833-4b9e-b19a-59aecc1e2928 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:12.070206 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 597/1213] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Apr 14 21:39:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:12.077144 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d87f5-7522-4784-a743-590e5abff57c None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:12.178049 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d87f5-7522-4784-a743-590e5abff57c None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:12.211707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6741aa-b6c8-4310-a017-e491a12ff7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:12.212345 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6741aa-b6c8-4310-a017-e491a12ff7e1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:12.212829 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6741aa-b6c8-4310-a017-e491a12ff7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:12.213102 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6741aa-b6c8-4310-a017-e491a12ff7e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:12.277410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6741aa-b6c8-4310-a017-e491a12ff7e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:12.279558 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6741aa-b6c8-4310-a017-e491a12ff7e1 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:12.374398 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 617/1214] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:39:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 14 21:39:12.380491 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe44da-b833-4b9e-b19a-59aecc1e2928 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:12.477352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe44da-b833-4b9e-b19a-59aecc1e2928 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:12.509834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdc700-1cf7-4031-ba9d-4602a5186776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:12.514012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdc700-1cf7-4031-ba9d-4602a5186776 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:12.514012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdc700-1cf7-4031-ba9d-4602a5186776 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:12.514012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdc700-1cf7-4031-ba9d-4602a5186776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:12.521513 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdc700-1cf7-4031-ba9d-4602a5186776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:12.522979 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdc700-1cf7-4031-ba9d-4602a5186776 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:12.539317 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-fbcdc700-1cf7-4031-ba9d-4602a5186776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:39:12.540509 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 598/1215] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:12.546947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6741aa-b6c8-4310-a017-e491a12ff7e1 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:12.642833 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6741aa-b6c8-4310-a017-e491a12ff7e1 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:12.676203 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ea305-0d96-4fd6-8504-b22eac6b1820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:12.676899 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ea305-0d96-4fd6-8504-b22eac6b1820 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:12.677180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ea305-0d96-4fd6-8504-b22eac6b1820 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:12.677454 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ea305-0d96-4fd6-8504-b22eac6b1820 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:12.678171 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ea305-0d96-4fd6-8504-b22eac6b1820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:12.678479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ea305-0d96-4fd6-8504-b22eac6b1820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:12.679875 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ea305-0d96-4fd6-8504-b22eac6b1820 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:12.691486 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 618/1216] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:12.697266 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdc700-1cf7-4031-ba9d-4602a5186776 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:12.792314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdc700-1cf7-4031-ba9d-4602a5186776 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:12.826503 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3589f0-6bdd-4037-9cbd-c268763d29d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:12.827279 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3589f0-6bdd-4037-9cbd-c268763d29d0 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:12.827559 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3589f0-6bdd-4037-9cbd-c268763d29d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:12.827831 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3589f0-6bdd-4037-9cbd-c268763d29d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:12.834334 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3589f0-6bdd-4037-9cbd-c268763d29d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:12.836014 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3589f0-6bdd-4037-9cbd-c268763d29d0 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:12.848760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-7b3589f0-6bdd-4037-9cbd-c268763d29d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:39:12.849917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 599/1217] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:39:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:39:12.855778 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ea305-0d96-4fd6-8504-b22eac6b1820 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:12.952357 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ea305-0d96-4fd6-8504-b22eac6b1820 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:12.990560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b757d-ad9f-46c8-ba8e-727182d53d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:12.990560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b757d-ad9f-46c8-ba8e-727182d53d3f None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:12.990560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b757d-ad9f-46c8-ba8e-727182d53d3f None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:12.990560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b757d-ad9f-46c8-ba8e-727182d53d3f None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:12.991008 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b757d-ad9f-46c8-ba8e-727182d53d3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:12.991008 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b757d-ad9f-46c8-ba8e-727182d53d3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:12.991008 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b757d-ad9f-46c8-ba8e-727182d53d3f None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:13.001532 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 619/1218] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:39:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:13.007567 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3589f0-6bdd-4037-9cbd-c268763d29d0 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:13.101959 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3589f0-6bdd-4037-9cbd-c268763d29d0 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:13.133982 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099b4e7-cee7-444d-a56c-9da55ad54d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:13.143991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099b4e7-cee7-444d-a56c-9da55ad54d0c None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:13.143991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099b4e7-cee7-444d-a56c-9da55ad54d0c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:13.143991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099b4e7-cee7-444d-a56c-9da55ad54d0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:13.143991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9099b4e7-cee7-444d-a56c-9da55ad54d0c None admin] RBAC: Adding query filter params (role.id=44e1b9c3f51e473a8af9b883e80a74d2, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=9e166c6b0e5542f7b912cbefa88bb5f4) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:13.143991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9099b4e7-cee7-444d-a56c-9da55ad54d0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:13.143991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9099b4e7-cee7-444d-a56c-9da55ad54d0c None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:13.144482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 600/1219] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:39:13 2022] GET /identity/v3/role_assignments?user.id=9e166c6b0e5542f7b912cbefa88bb5f4&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=44e1b9c3f51e473a8af9b883e80a74d2 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:39:15.440399 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c972647-17dd-4e1f-8c75-6396ec155122 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:15.441107 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c972647-17dd-4e1f-8c75-6396ec155122 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:15.441107 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c972647-17dd-4e1f-8c75-6396ec155122 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:15.442323 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 620/1220] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:39:15.447559 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad54688-0881-4b52-aa9a-067f34a92bb2 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:15.447979 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad54688-0881-4b52-aa9a-067f34a92bb2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:15.448088 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad54688-0881-4b52-aa9a-067f34a92bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:15.465632 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-3ad54688-0881-4b52-aa9a-067f34a92bb2 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:39:15.467133 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-3ad54688-0881-4b52-aa9a-067f34a92bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:39:15.530404 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 601/1221] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:39:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:39:15.553751 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c972647-17dd-4e1f-8c75-6396ec155122 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:15.663217 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c972647-17dd-4e1f-8c75-6396ec155122 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:15.697011 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa25b15-e504-4fab-8b7b-d507a1b8cef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:15.697805 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa25b15-e504-4fab-8b7b-d507a1b8cef1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:15.698115 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa25b15-e504-4fab-8b7b-d507a1b8cef1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:15.698354 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa25b15-e504-4fab-8b7b-d507a1b8cef1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:15.709448 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa25b15-e504-4fab-8b7b-d507a1b8cef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:39:15.717595 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-5aa25b15-e504-4fab-8b7b-d507a1b8cef1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:39:15.718802 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 621/1222] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:39:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:15.726298 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad54688-0881-4b52-aa9a-067f34a92bb2 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:15.819313 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad54688-0881-4b52-aa9a-067f34a92bb2 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:15.852585 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98271a84-28ee-4bed-b12a-c49f9ad6b7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:15.853269 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271a84-28ee-4bed-b12a-c49f9ad6b7f8 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:15.853550 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271a84-28ee-4bed-b12a-c49f9ad6b7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:15.853822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271a84-28ee-4bed-b12a-c49f9ad6b7f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:15.854565 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98271a84-28ee-4bed-b12a-c49f9ad6b7f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:15.854867 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98271a84-28ee-4bed-b12a-c49f9ad6b7f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:15.856212 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98271a84-28ee-4bed-b12a-c49f9ad6b7f8 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:15.863865 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 602/1223] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:39:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:15.869819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa25b15-e504-4fab-8b7b-d507a1b8cef1 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:15.966633 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa25b15-e504-4fab-8b7b-d507a1b8cef1 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:15.999599 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12624f67-892f-4298-816a-b9cdf5fec855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:16.003676 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12624f67-892f-4298-816a-b9cdf5fec855 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:16.003676 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12624f67-892f-4298-816a-b9cdf5fec855 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:16.003676 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12624f67-892f-4298-816a-b9cdf5fec855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:16.011274 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12624f67-892f-4298-816a-b9cdf5fec855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:16.012746 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12624f67-892f-4298-816a-b9cdf5fec855 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:16.029367 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-12624f67-892f-4298-816a-b9cdf5fec855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:39:16.030515 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 622/1224] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:16.036376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98271a84-28ee-4bed-b12a-c49f9ad6b7f8 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:16.131535 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98271a84-28ee-4bed-b12a-c49f9ad6b7f8 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:16.164001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef15e7-f00d-4d8e-ae90-98a1d595f684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:16.164677 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef15e7-f00d-4d8e-ae90-98a1d595f684 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:16.164956 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef15e7-f00d-4d8e-ae90-98a1d595f684 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:16.165225 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef15e7-f00d-4d8e-ae90-98a1d595f684 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:16.165937 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef15e7-f00d-4d8e-ae90-98a1d595f684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:16.166238 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef15e7-f00d-4d8e-ae90-98a1d595f684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:16.167585 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef15e7-f00d-4d8e-ae90-98a1d595f684 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:16.178838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 603/1225] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:16.184446 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12624f67-892f-4298-816a-b9cdf5fec855 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:16.281985 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12624f67-892f-4298-816a-b9cdf5fec855 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:16.314395 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b4f41-baee-4808-8f89-c2e6869071d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:16.315180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b4f41-baee-4808-8f89-c2e6869071d6 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:16.315460 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b4f41-baee-4808-8f89-c2e6869071d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:16.315730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b4f41-baee-4808-8f89-c2e6869071d6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:16.322888 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b4f41-baee-4808-8f89-c2e6869071d6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:16.324325 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b4f41-baee-4808-8f89-c2e6869071d6 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:16.337916 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-999b4f41-baee-4808-8f89-c2e6869071d6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 14 21:39:16.339073 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 623/1226] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:16.345300 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef15e7-f00d-4d8e-ae90-98a1d595f684 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:16.441719 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef15e7-f00d-4d8e-ae90-98a1d595f684 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:16.473242 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9227f3-9560-4a40-86fa-6a5eb20d13ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:16.473904 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9227f3-9560-4a40-86fa-6a5eb20d13ab None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:16.474179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9227f3-9560-4a40-86fa-6a5eb20d13ab None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:16.474448 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9227f3-9560-4a40-86fa-6a5eb20d13ab None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:16.475281 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9227f3-9560-4a40-86fa-6a5eb20d13ab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:16.475586 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9227f3-9560-4a40-86fa-6a5eb20d13ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:16.477034 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9227f3-9560-4a40-86fa-6a5eb20d13ab None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:16.494241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 604/1227] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Apr 14 21:39:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:16.501218 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b4f41-baee-4808-8f89-c2e6869071d6 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:16.596616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b4f41-baee-4808-8f89-c2e6869071d6 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:16.629467 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9d82e-d27f-4fc9-b310-b5d4e98764a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:16.630249 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9d82e-d27f-4fc9-b310-b5d4e98764a6 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:16.630531 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9d82e-d27f-4fc9-b310-b5d4e98764a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:16.630807 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9d82e-d27f-4fc9-b310-b5d4e98764a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:16.641221 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9d82e-d27f-4fc9-b310-b5d4e98764a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:16.642937 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9d82e-d27f-4fc9-b310-b5d4e98764a6 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:16.660986 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-d5b9d82e-d27f-4fc9-b310-b5d4e98764a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:39:16.662228 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 624/1228] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:16.667903 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9227f3-9560-4a40-86fa-6a5eb20d13ab None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:16.765884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9227f3-9560-4a40-86fa-6a5eb20d13ab None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:16.798052 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770af8e-e550-4194-9b8b-f5fba9e5b6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:16.798704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770af8e-e550-4194-9b8b-f5fba9e5b6f7 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:16.798980 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770af8e-e550-4194-9b8b-f5fba9e5b6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:16.799246 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770af8e-e550-4194-9b8b-f5fba9e5b6f7 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:16.799956 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770af8e-e550-4194-9b8b-f5fba9e5b6f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:16.800255 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770af8e-e550-4194-9b8b-f5fba9e5b6f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:16.801662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770af8e-e550-4194-9b8b-f5fba9e5b6f7 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:16.813149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 605/1229] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:16.818819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9d82e-d27f-4fc9-b310-b5d4e98764a6 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:16.913744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9d82e-d27f-4fc9-b310-b5d4e98764a6 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:16.945694 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b72ae-1830-47df-8317-3af31e1ba5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:16.946479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b72ae-1830-47df-8317-3af31e1ba5d0 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:16.946760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b72ae-1830-47df-8317-3af31e1ba5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:16.947034 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b72ae-1830-47df-8317-3af31e1ba5d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:16.954155 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b72ae-1830-47df-8317-3af31e1ba5d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:16.955623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b72ae-1830-47df-8317-3af31e1ba5d0 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:16.969368 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-c55b72ae-1830-47df-8317-3af31e1ba5d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:39:16.970578 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 625/1230] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:39:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:16.976616 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770af8e-e550-4194-9b8b-f5fba9e5b6f7 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:17.073533 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770af8e-e550-4194-9b8b-f5fba9e5b6f7 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:17.105152 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd4d50-7396-4de9-914d-57639b05f287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:17.105831 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd4d50-7396-4de9-914d-57639b05f287 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:17.106109 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd4d50-7396-4de9-914d-57639b05f287 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:17.106379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd4d50-7396-4de9-914d-57639b05f287 None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:17.107860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd4d50-7396-4de9-914d-57639b05f287 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:17.108397 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd4d50-7396-4de9-914d-57639b05f287 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:17.109860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd4d50-7396-4de9-914d-57639b05f287 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:17.121411 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 606/1231] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:39:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:17.127851 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b72ae-1830-47df-8317-3af31e1ba5d0 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:17.223484 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b72ae-1830-47df-8317-3af31e1ba5d0 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:17.256690 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2c021-7db1-41ae-874a-a84ce22371e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:17.257557 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c021-7db1-41ae-874a-a84ce22371e5 None admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:17.257834 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c021-7db1-41ae-874a-a84ce22371e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:17.258102 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c021-7db1-41ae-874a-a84ce22371e5 None admin] PATH_INFO: `/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/9e166c6b0e5542f7b912cbefa88bb5f4/roles/44e1b9c3f51e473a8af9b883e80a74d2` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:17.271964 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2c021-7db1-41ae-874a-a84ce22371e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3c1bb37aa1c407782b2f5501ae1f10a, user_id=9e166c6b0e5542f7b912cbefa88bb5f4, role_id=44e1b9c3f51e473a8af9b883e80a74d2)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:17.273436 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2c021-7db1-41ae-874a-a84ce22371e5 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:17.379094 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 626/1232] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:39:17 2022] PUT /identity/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/9e166c6b0e5542f7b912cbefa88bb5f4/roles/44e1b9c3f51e473a8af9b883e80a74d2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:39:19.669131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83b192-db10-473e-93e1-2bffe4385ff0 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:19.669671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83b192-db10-473e-93e1-2bffe4385ff0 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:19.669671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83b192-db10-473e-93e1-2bffe4385ff0 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:19.671094 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 607/1233] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:39:19.676533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6cd63-5cf8-4070-bcd9-37c0ca7dc2a7 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:19.676974 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6cd63-5cf8-4070-bcd9-37c0ca7dc2a7 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:19.677232 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6cd63-5cf8-4070-bcd9-37c0ca7dc2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:19.694154 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-e2d6cd63-5cf8-4070-bcd9-37c0ca7dc2a7 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:39:19.695335 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e2d6cd63-5cf8-4070-bcd9-37c0ca7dc2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:39:19.761253 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 627/1234] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:39:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:39:19.788503 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83b192-db10-473e-93e1-2bffe4385ff0 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:19.887581 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83b192-db10-473e-93e1-2bffe4385ff0 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:19.920186 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cddbcc-7da0-470e-a63d-1cbffe94ee0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:19.920939 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cddbcc-7da0-470e-a63d-1cbffe94ee0d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:19.921218 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cddbcc-7da0-470e-a63d-1cbffe94ee0d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:19.921485 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cddbcc-7da0-470e-a63d-1cbffe94ee0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:19.931030 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cddbcc-7da0-470e-a63d-1cbffe94ee0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:39:19.938835 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-74cddbcc-7da0-470e-a63d-1cbffe94ee0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 14 21:39:19.939999 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 608/1235] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Apr 14 21:39:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:19.946066 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6cd63-5cf8-4070-bcd9-37c0ca7dc2a7 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:20.041707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6cd63-5cf8-4070-bcd9-37c0ca7dc2a7 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:20.074872 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea89245-d1a1-4877-bbe8-9e0314dd0b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:20.075533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea89245-d1a1-4877-bbe8-9e0314dd0b41 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:20.075933 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea89245-d1a1-4877-bbe8-9e0314dd0b41 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:20.076207 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea89245-d1a1-4877-bbe8-9e0314dd0b41 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:20.076984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea89245-d1a1-4877-bbe8-9e0314dd0b41 None admin] RBAC: Adding query filter params (name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:20.077292 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea89245-d1a1-4877-bbe8-9e0314dd0b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:20.078655 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea89245-d1a1-4877-bbe8-9e0314dd0b41 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:20.086527 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 628/1236] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Apr 14 21:39:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:20.092910 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cddbcc-7da0-470e-a63d-1cbffe94ee0d None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:20.187505 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cddbcc-7da0-470e-a63d-1cbffe94ee0d None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:20.219064 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca155d-6ee2-48e0-ac5b-a9622d17e3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:20.219843 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca155d-6ee2-48e0-ac5b-a9622d17e3fb None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:20.220126 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca155d-6ee2-48e0-ac5b-a9622d17e3fb None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:20.220401 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca155d-6ee2-48e0-ac5b-a9622d17e3fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:20.230704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca155d-6ee2-48e0-ac5b-a9622d17e3fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:20.233140 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca155d-6ee2-48e0-ac5b-a9622d17e3fb None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:20.250000 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-41ca155d-6ee2-48e0-ac5b-a9622d17e3fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:39:20.251158 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 609/1237] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:39:20.256998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea89245-d1a1-4877-bbe8-9e0314dd0b41 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:20.352407 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea89245-d1a1-4877-bbe8-9e0314dd0b41 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:20.384287 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fec78-f491-4fe8-bd23-e158e965fc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:20.384962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fec78-f491-4fe8-bd23-e158e965fc37 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:20.385239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fec78-f491-4fe8-bd23-e158e965fc37 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:20.385510 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fec78-f491-4fe8-bd23-e158e965fc37 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:20.386219 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fec78-f491-4fe8-bd23-e158e965fc37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:20.386522 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fec78-f491-4fe8-bd23-e158e965fc37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:20.387868 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fec78-f491-4fe8-bd23-e158e965fc37 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:20.399042 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 629/1238] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:20.405586 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca155d-6ee2-48e0-ac5b-a9622d17e3fb None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:20.502641 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca155d-6ee2-48e0-ac5b-a9622d17e3fb None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:20.534021 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf2714-8bf7-4ab5-8db0-547620cb605a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:20.534805 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf2714-8bf7-4ab5-8db0-547620cb605a None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:20.535081 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf2714-8bf7-4ab5-8db0-547620cb605a None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:20.535349 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf2714-8bf7-4ab5-8db0-547620cb605a None admin] PATH_INFO: `/v3/users/placement` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:20.543544 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf2714-8bf7-4ab5-8db0-547620cb605a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:20.545703 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf2714-8bf7-4ab5-8db0-547620cb605a None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:20.558986 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-b4bf2714-8bf7-4ab5-8db0-547620cb605a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 14 21:39:20.560244 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 610/1239] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:20.566890 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fec78-f491-4fe8-bd23-e158e965fc37 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:20.662490 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fec78-f491-4fe8-bd23-e158e965fc37 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:20.694906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c13df-952d-46e0-8599-57c562cae1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:20.695566 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c13df-952d-46e0-8599-57c562cae1ec None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:20.695846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c13df-952d-46e0-8599-57c562cae1ec None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:20.696120 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c13df-952d-46e0-8599-57c562cae1ec None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:20.696970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c13df-952d-46e0-8599-57c562cae1ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:20.697321 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c13df-952d-46e0-8599-57c562cae1ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:20.698739 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c13df-952d-46e0-8599-57c562cae1ec None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:20.716758 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 630/1240] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Apr 14 21:39:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:20.723146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf2714-8bf7-4ab5-8db0-547620cb605a None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:20.819171 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf2714-8bf7-4ab5-8db0-547620cb605a None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:20.852452 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f4a26-ced2-4708-b5d1-30645708deb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:20.853113 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f4a26-ced2-4708-b5d1-30645708deb1 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:20.853393 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f4a26-ced2-4708-b5d1-30645708deb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:20.853664 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f4a26-ced2-4708-b5d1-30645708deb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:20.917797 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f4a26-ced2-4708-b5d1-30645708deb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:20.919231 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f4a26-ced2-4708-b5d1-30645708deb1 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:21.014928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 611/1241] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:39:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 14 21:39:21.020896 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c13df-952d-46e0-8599-57c562cae1ec None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:21.115261 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c13df-952d-46e0-8599-57c562cae1ec None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:21.147788 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2905b-d13d-48ac-9e5a-3ef504cbb883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:21.148570 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2905b-d13d-48ac-9e5a-3ef504cbb883 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:21.148877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2905b-d13d-48ac-9e5a-3ef504cbb883 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:21.149148 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2905b-d13d-48ac-9e5a-3ef504cbb883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:21.158710 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2905b-d13d-48ac-9e5a-3ef504cbb883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:21.160149 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2905b-d13d-48ac-9e5a-3ef504cbb883 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:21.177050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-5cc2905b-d13d-48ac-9e5a-3ef504cbb883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:39:21.178215 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 631/1242] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:21.184140 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f4a26-ced2-4708-b5d1-30645708deb1 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:21.280430 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f4a26-ced2-4708-b5d1-30645708deb1 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:21.313145 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35c801-2502-4234-aa96-a4b25095f218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:21.313802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35c801-2502-4234-aa96-a4b25095f218 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:21.314082 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35c801-2502-4234-aa96-a4b25095f218 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:21.314359 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35c801-2502-4234-aa96-a4b25095f218 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:21.315079 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35c801-2502-4234-aa96-a4b25095f218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:21.315382 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35c801-2502-4234-aa96-a4b25095f218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:21.316760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35c801-2502-4234-aa96-a4b25095f218 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:21.327543 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 612/1243] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:21.333615 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2905b-d13d-48ac-9e5a-3ef504cbb883 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:21.430385 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2905b-d13d-48ac-9e5a-3ef504cbb883 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:21.462635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9be524-ee66-4636-81bd-e059927fcd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:21.463417 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9be524-ee66-4636-81bd-e059927fcd2a None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:21.463698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9be524-ee66-4636-81bd-e059927fcd2a None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:21.463974 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9be524-ee66-4636-81bd-e059927fcd2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:21.470989 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9be524-ee66-4636-81bd-e059927fcd2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:21.472433 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9be524-ee66-4636-81bd-e059927fcd2a None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:21.485839 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-dd9be524-ee66-4636-81bd-e059927fcd2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:39:21.490617 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 632/1244] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:21.493032 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35c801-2502-4234-aa96-a4b25095f218 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:21.588914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35c801-2502-4234-aa96-a4b25095f218 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:21.628146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51748ef-d892-4865-be51-6a670192f44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:21.628821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51748ef-d892-4865-be51-6a670192f44f None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:21.629142 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51748ef-d892-4865-be51-6a670192f44f None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:21.629414 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51748ef-d892-4865-be51-6a670192f44f None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:21.630193 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51748ef-d892-4865-be51-6a670192f44f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:21.630497 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51748ef-d892-4865-be51-6a670192f44f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:21.631967 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51748ef-d892-4865-be51-6a670192f44f None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:21.643998 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 613/1245] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:21.650121 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9be524-ee66-4636-81bd-e059927fcd2a None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:21.747168 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9be524-ee66-4636-81bd-e059927fcd2a None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:21.782846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1a367-baa8-4715-a410-c81eeba909a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:21.783529 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1a367-baa8-4715-a410-c81eeba909a4 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:21.783833 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1a367-baa8-4715-a410-c81eeba909a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:21.784105 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1a367-baa8-4715-a410-c81eeba909a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:21.785044 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1a367-baa8-4715-a410-c81eeba909a4 None admin] RBAC: Adding query filter params (role.id=44e1b9c3f51e473a8af9b883e80a74d2, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=9e166c6b0e5542f7b912cbefa88bb5f4) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:21.785376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1a367-baa8-4715-a410-c81eeba909a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:21.786858 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1a367-baa8-4715-a410-c81eeba909a4 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:21.792910 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 633/1246] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:39:21 2022] GET /identity/v3/role_assignments?user.id=9e166c6b0e5542f7b912cbefa88bb5f4&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=44e1b9c3f51e473a8af9b883e80a74d2 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:24.137930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536bf55-652b-4375-b79f-eada4808e6b4 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:24.139283 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536bf55-652b-4375-b79f-eada4808e6b4 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:24.139283 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536bf55-652b-4375-b79f-eada4808e6b4 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:24.140498 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 614/1247] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:39:24.145567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb082ea-49cd-4316-89ac-7394c4dd4d25 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:24.145959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb082ea-49cd-4316-89ac-7394c4dd4d25 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:24.146111 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb082ea-49cd-4316-89ac-7394c4dd4d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:24.163090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-1bb082ea-49cd-4316-89ac-7394c4dd4d25 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:39:24.164257 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-1bb082ea-49cd-4316-89ac-7394c4dd4d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:39:24.227935 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 634/1248] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:39:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:39:24.257214 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536bf55-652b-4375-b79f-eada4808e6b4 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:24.351016 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536bf55-652b-4375-b79f-eada4808e6b4 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:24.383640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d698c-810d-4c8e-bd09-2f68caff260e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:24.384410 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d698c-810d-4c8e-bd09-2f68caff260e None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:24.384717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d698c-810d-4c8e-bd09-2f68caff260e None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:24.384989 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d698c-810d-4c8e-bd09-2f68caff260e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:24.394901 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d698c-810d-4c8e-bd09-2f68caff260e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:39:24.401875 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-e60d698c-810d-4c8e-bd09-2f68caff260e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:39:24.403096 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 615/1249] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:39:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:24.409692 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb082ea-49cd-4316-89ac-7394c4dd4d25 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:24.503898 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb082ea-49cd-4316-89ac-7394c4dd4d25 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:24.537667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5306b-2757-4192-bb0d-de038e6761d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:24.538264 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5306b-2757-4192-bb0d-de038e6761d1 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:24.538542 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5306b-2757-4192-bb0d-de038e6761d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:24.538813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5306b-2757-4192-bb0d-de038e6761d1 None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:24.539553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5306b-2757-4192-bb0d-de038e6761d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:24.539858 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5306b-2757-4192-bb0d-de038e6761d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:24.541311 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5306b-2757-4192-bb0d-de038e6761d1 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:24.549243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 635/1250] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:39:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:24.555103 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d698c-810d-4c8e-bd09-2f68caff260e None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:24.652228 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d698c-810d-4c8e-bd09-2f68caff260e None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:24.684061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb00650-ead0-490d-af10-4bf876522c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:24.684865 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb00650-ead0-490d-af10-4bf876522c45 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:24.685200 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb00650-ead0-490d-af10-4bf876522c45 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:24.685474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb00650-ead0-490d-af10-4bf876522c45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:24.695456 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb00650-ead0-490d-af10-4bf876522c45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:24.699041 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb00650-ead0-490d-af10-4bf876522c45 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:24.713442 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-7bb00650-ead0-490d-af10-4bf876522c45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:39:24.714600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 616/1251] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:39:24.721077 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5306b-2757-4192-bb0d-de038e6761d1 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:24.815802 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5306b-2757-4192-bb0d-de038e6761d1 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:24.849397 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302ad7d-67c5-48f1-9933-1afa19f47af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:24.850048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302ad7d-67c5-48f1-9933-1afa19f47af6 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:24.850325 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302ad7d-67c5-48f1-9933-1afa19f47af6 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:24.850594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302ad7d-67c5-48f1-9933-1afa19f47af6 None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:24.851307 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302ad7d-67c5-48f1-9933-1afa19f47af6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:24.851608 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302ad7d-67c5-48f1-9933-1afa19f47af6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:24.853054 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302ad7d-67c5-48f1-9933-1afa19f47af6 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:24.864403 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 636/1252] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:24.870213 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb00650-ead0-490d-af10-4bf876522c45 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:24.970447 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb00650-ead0-490d-af10-4bf876522c45 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:25.008257 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e06d19-e092-418d-9bd4-a7143c5a832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:25.009093 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e06d19-e092-418d-9bd4-a7143c5a832b None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:25.009375 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e06d19-e092-418d-9bd4-a7143c5a832b None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:25.013756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e06d19-e092-418d-9bd4-a7143c5a832b None admin] PATH_INFO: `/v3/users/placement` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:25.018175 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e06d19-e092-418d-9bd4-a7143c5a832b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:25.019406 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e06d19-e092-418d-9bd4-a7143c5a832b None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:25.033519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-d1e06d19-e092-418d-9bd4-a7143c5a832b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 14 21:39:25.034684 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 617/1253] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:25.040797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302ad7d-67c5-48f1-9933-1afa19f47af6 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:25.137175 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302ad7d-67c5-48f1-9933-1afa19f47af6 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:25.169992 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bac28a-7d4b-49cb-ac7f-d624cb8c0f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:25.170930 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac28a-7d4b-49cb-ac7f-d624cb8c0f6d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:25.171209 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac28a-7d4b-49cb-ac7f-d624cb8c0f6d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:25.171531 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac28a-7d4b-49cb-ac7f-d624cb8c0f6d None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:25.172360 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bac28a-7d4b-49cb-ac7f-d624cb8c0f6d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:25.172694 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bac28a-7d4b-49cb-ac7f-d624cb8c0f6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:25.174111 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bac28a-7d4b-49cb-ac7f-d624cb8c0f6d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:25.191100 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 637/1254] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Apr 14 21:39:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:25.196900 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e06d19-e092-418d-9bd4-a7143c5a832b None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:25.295938 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e06d19-e092-418d-9bd4-a7143c5a832b None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:25.327874 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff573b8-589d-4861-bd3c-295f66dc2069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:25.328521 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff573b8-589d-4861-bd3c-295f66dc2069 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:25.328829 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff573b8-589d-4861-bd3c-295f66dc2069 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:25.329105 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff573b8-589d-4861-bd3c-295f66dc2069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:25.396015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff573b8-589d-4861-bd3c-295f66dc2069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:25.397403 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff573b8-589d-4861-bd3c-295f66dc2069 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:25.491861 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 618/1255] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:39:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 14 21:39:25.497880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bac28a-7d4b-49cb-ac7f-d624cb8c0f6d None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:25.592914 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bac28a-7d4b-49cb-ac7f-d624cb8c0f6d None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:25.625737 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147125da-4648-49f6-ad8f-6712dc3bd873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:25.626520 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147125da-4648-49f6-ad8f-6712dc3bd873 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:25.626798 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147125da-4648-49f6-ad8f-6712dc3bd873 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:25.627069 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147125da-4648-49f6-ad8f-6712dc3bd873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:25.636724 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147125da-4648-49f6-ad8f-6712dc3bd873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:25.638841 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147125da-4648-49f6-ad8f-6712dc3bd873 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:25.654919 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-147125da-4648-49f6-ad8f-6712dc3bd873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:39:25.656034 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 638/1256] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:25.661800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff573b8-589d-4861-bd3c-295f66dc2069 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:25.754605 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff573b8-589d-4861-bd3c-295f66dc2069 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:25.786310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031c4a5-a09a-4cf7-89ad-f16245cd5840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:25.786955 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031c4a5-a09a-4cf7-89ad-f16245cd5840 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:25.787230 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031c4a5-a09a-4cf7-89ad-f16245cd5840 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:25.787496 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031c4a5-a09a-4cf7-89ad-f16245cd5840 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:25.788201 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031c4a5-a09a-4cf7-89ad-f16245cd5840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:25.788498 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031c4a5-a09a-4cf7-89ad-f16245cd5840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:25.789871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031c4a5-a09a-4cf7-89ad-f16245cd5840 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:25.800339 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 619/1257] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:25.805915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147125da-4648-49f6-ad8f-6712dc3bd873 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:25.900006 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147125da-4648-49f6-ad8f-6712dc3bd873 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:25.933940 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b26dc-118a-4148-adfe-e831041314b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:25.933940 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b26dc-118a-4148-adfe-e831041314b8 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:25.933940 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b26dc-118a-4148-adfe-e831041314b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:25.933940 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b26dc-118a-4148-adfe-e831041314b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:25.939573 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b26dc-118a-4148-adfe-e831041314b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:25.941049 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b26dc-118a-4148-adfe-e831041314b8 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:25.954361 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-903b26dc-118a-4148-adfe-e831041314b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:39:25.955507 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 639/1258] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:39:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:25.961656 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031c4a5-a09a-4cf7-89ad-f16245cd5840 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:26.057363 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031c4a5-a09a-4cf7-89ad-f16245cd5840 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:26.089711 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b276d32-dee2-430f-835b-8f909914b09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:26.090364 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b276d32-dee2-430f-835b-8f909914b09c None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:26.090645 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b276d32-dee2-430f-835b-8f909914b09c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:26.090921 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b276d32-dee2-430f-835b-8f909914b09c None admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:26.091952 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b276d32-dee2-430f-835b-8f909914b09c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:26.092258 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b276d32-dee2-430f-835b-8f909914b09c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:26.093723 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b276d32-dee2-430f-835b-8f909914b09c None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:26.105283 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 620/1259] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:26.112021 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b26dc-118a-4148-adfe-e831041314b8 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:26.208102 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b26dc-118a-4148-adfe-e831041314b8 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:26.240979 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdea143-1964-4568-8b9c-a40290411a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:26.241621 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdea143-1964-4568-8b9c-a40290411a2d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:26.241901 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdea143-1964-4568-8b9c-a40290411a2d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:26.242170 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdea143-1964-4568-8b9c-a40290411a2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:26.242991 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdea143-1964-4568-8b9c-a40290411a2d None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=9e166c6b0e5542f7b912cbefa88bb5f4) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:26.243295 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdea143-1964-4568-8b9c-a40290411a2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:26.244749 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdea143-1964-4568-8b9c-a40290411a2d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:26.250879 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 640/1260] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:39:26 2022] GET /identity/v3/role_assignments?user.id=9e166c6b0e5542f7b912cbefa88bb5f4&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:28.518985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7e29a-f47c-4e93-86cd-a9b97a27331f None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:28.519522 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7e29a-f47c-4e93-86cd-a9b97a27331f None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:28.519522 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7e29a-f47c-4e93-86cd-a9b97a27331f None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:28.520923 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 621/1261] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:39:28.526078 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b6b29-20e6-47df-a0c0-c93b60da3d77 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:28.526516 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b6b29-20e6-47df-a0c0-c93b60da3d77 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:28.526633 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b6b29-20e6-47df-a0c0-c93b60da3d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:28.542810 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-d56b6b29-20e6-47df-a0c0-c93b60da3d77 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:39:28.544051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d56b6b29-20e6-47df-a0c0-c93b60da3d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:39:28.612024 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 641/1262] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:39:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:39:28.635528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7e29a-f47c-4e93-86cd-a9b97a27331f None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:28.731172 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7e29a-f47c-4e93-86cd-a9b97a27331f None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:28.764216 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a23c7-5444-4506-9a08-ea579979d00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:28.765033 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a23c7-5444-4506-9a08-ea579979d00d None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:28.765308 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a23c7-5444-4506-9a08-ea579979d00d None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:28.765575 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a23c7-5444-4506-9a08-ea579979d00d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:28.775187 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a23c7-5444-4506-9a08-ea579979d00d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:39:28.782036 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-762a23c7-5444-4506-9a08-ea579979d00d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:39:28.783204 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 622/1263] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:39:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:28.790553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b6b29-20e6-47df-a0c0-c93b60da3d77 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:28.885925 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b6b29-20e6-47df-a0c0-c93b60da3d77 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:28.919489 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2f700-e2e2-4814-815f-02e2698ef55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:28.920154 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2f700-e2e2-4814-815f-02e2698ef55d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:28.920435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2f700-e2e2-4814-815f-02e2698ef55d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:28.920740 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2f700-e2e2-4814-815f-02e2698ef55d None admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:28.921566 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2f700-e2e2-4814-815f-02e2698ef55d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:28.921872 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2f700-e2e2-4814-815f-02e2698ef55d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:28.923239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2f700-e2e2-4814-815f-02e2698ef55d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:28.931136 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 642/1264] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:39:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:28.937672 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a23c7-5444-4506-9a08-ea579979d00d None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:29.035294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a23c7-5444-4506-9a08-ea579979d00d None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:29.068193 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c0590-cabf-4ce2-bfad-b4098de9d30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:29.069002 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c0590-cabf-4ce2-bfad-b4098de9d30b None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:29.069277 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c0590-cabf-4ce2-bfad-b4098de9d30b None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:29.069547 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c0590-cabf-4ce2-bfad-b4098de9d30b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:29.080073 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c0590-cabf-4ce2-bfad-b4098de9d30b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:29.081563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c0590-cabf-4ce2-bfad-b4098de9d30b None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:29.097933 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-b47c0590-cabf-4ce2-bfad-b4098de9d30b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:39:29.099095 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 623/1265] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:29.105007 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2f700-e2e2-4814-815f-02e2698ef55d None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:29.203569 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2f700-e2e2-4814-815f-02e2698ef55d None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:29.236979 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8cca8-5c34-416e-9098-4185d56c55cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:29.237627 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8cca8-5c34-416e-9098-4185d56c55cf None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:29.237906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8cca8-5c34-416e-9098-4185d56c55cf None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:29.238177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8cca8-5c34-416e-9098-4185d56c55cf None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:29.238889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8cca8-5c34-416e-9098-4185d56c55cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:29.239193 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8cca8-5c34-416e-9098-4185d56c55cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:29.240556 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8cca8-5c34-416e-9098-4185d56c55cf None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:29.252444 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 643/1266] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:29.258276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c0590-cabf-4ce2-bfad-b4098de9d30b None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:29.354313 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c0590-cabf-4ce2-bfad-b4098de9d30b None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:29.386894 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e687e0-f168-4952-a253-d2284c12b22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:29.387681 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e687e0-f168-4952-a253-d2284c12b22b None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:29.387957 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e687e0-f168-4952-a253-d2284c12b22b None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:29.388290 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e687e0-f168-4952-a253-d2284c12b22b None admin] PATH_INFO: `/v3/users/placement` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:29.395696 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e687e0-f168-4952-a253-d2284c12b22b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:29.397145 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e687e0-f168-4952-a253-d2284c12b22b None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:29.411060 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-91e687e0-f168-4952-a253-d2284c12b22b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 14 21:39:29.412240 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 624/1267] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:29.418237 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8cca8-5c34-416e-9098-4185d56c55cf None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:29.513803 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8cca8-5c34-416e-9098-4185d56c55cf None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:29.546948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6ac11-ec3c-42c3-b9eb-386902767cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:29.547600 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6ac11-ec3c-42c3-b9eb-386902767cda None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:29.547878 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6ac11-ec3c-42c3-b9eb-386902767cda None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:29.548187 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6ac11-ec3c-42c3-b9eb-386902767cda None admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:29.549046 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6ac11-ec3c-42c3-b9eb-386902767cda None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:29.549347 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6ac11-ec3c-42c3-b9eb-386902767cda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:29.550760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6ac11-ec3c-42c3-b9eb-386902767cda None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:29.567267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 644/1268] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Apr 14 21:39:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:29.572962 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e687e0-f168-4952-a253-d2284c12b22b None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:29.671542 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e687e0-f168-4952-a253-d2284c12b22b None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:29.704783 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af30333-0975-4c04-bcdf-175831e199cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:29.705573 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af30333-0975-4c04-bcdf-175831e199cb None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:29.705844 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af30333-0975-4c04-bcdf-175831e199cb None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:29.706108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af30333-0975-4c04-bcdf-175831e199cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:29.717078 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af30333-0975-4c04-bcdf-175831e199cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:29.718687 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af30333-0975-4c04-bcdf-175831e199cb None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:29.735215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-2af30333-0975-4c04-bcdf-175831e199cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:39:29.736388 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 625/1269] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:29.742222 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6ac11-ec3c-42c3-b9eb-386902767cda None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:29.840135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6ac11-ec3c-42c3-b9eb-386902767cda None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:29.873279 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3528d-717a-4fed-b5f2-d8aee929d8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:29.873940 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3528d-717a-4fed-b5f2-d8aee929d8ef None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:29.874220 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3528d-717a-4fed-b5f2-d8aee929d8ef None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:29.874510 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3528d-717a-4fed-b5f2-d8aee929d8ef None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:29.875233 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3528d-717a-4fed-b5f2-d8aee929d8ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:29.875540 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3528d-717a-4fed-b5f2-d8aee929d8ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:29.876997 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3528d-717a-4fed-b5f2-d8aee929d8ef None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:29.887737 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 645/1270] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:29.893959 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af30333-0975-4c04-bcdf-175831e199cb None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:29.993624 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af30333-0975-4c04-bcdf-175831e199cb None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:30.025988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67dba9-b48b-493a-a0b9-39fd39783a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:30.026767 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67dba9-b48b-493a-a0b9-39fd39783a35 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:30.027049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67dba9-b48b-493a-a0b9-39fd39783a35 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:30.027319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67dba9-b48b-493a-a0b9-39fd39783a35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:30.034537 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67dba9-b48b-493a-a0b9-39fd39783a35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:30.035995 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67dba9-b48b-493a-a0b9-39fd39783a35 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:30.049336 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-0d67dba9-b48b-493a-a0b9-39fd39783a35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:39:30.050502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 626/1271] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:39:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:30.056328 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3528d-717a-4fed-b5f2-d8aee929d8ef None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:30.153116 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3528d-717a-4fed-b5f2-d8aee929d8ef None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:30.185852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c43e7-0ea8-4942-9103-914cdc2a6320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:30.186499 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c43e7-0ea8-4942-9103-914cdc2a6320 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:30.186780 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c43e7-0ea8-4942-9103-914cdc2a6320 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:30.187049 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c43e7-0ea8-4942-9103-914cdc2a6320 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:30.187826 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c43e7-0ea8-4942-9103-914cdc2a6320 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:30.188132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c43e7-0ea8-4942-9103-914cdc2a6320 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:30.189626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c43e7-0ea8-4942-9103-914cdc2a6320 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:30.201039 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 646/1272] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:30.206983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67dba9-b48b-493a-a0b9-39fd39783a35 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:30.307269 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67dba9-b48b-493a-a0b9-39fd39783a35 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:30.339713 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2ff67-13e4-4467-8f00-db2744abf5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:30.340606 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2ff67-13e4-4467-8f00-db2744abf5a1 None admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:30.340895 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2ff67-13e4-4467-8f00-db2744abf5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:30.341662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2ff67-13e4-4467-8f00-db2744abf5a1 None admin] PATH_INFO: `/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/9e166c6b0e5542f7b912cbefa88bb5f4/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:30.343618 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2ff67-13e4-4467-8f00-db2744abf5a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3c1bb37aa1c407782b2f5501ae1f10a, user_id=9e166c6b0e5542f7b912cbefa88bb5f4, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:30.345093 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2ff67-13e4-4467-8f00-db2744abf5a1 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:30.430461 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 627/1273] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Apr 14 21:39:30 2022] PUT /identity/v3/projects/a3c1bb37aa1c407782b2f5501ae1f10a/users/9e166c6b0e5542f7b912cbefa88bb5f4/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:39:32.731389 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a467cb-4a23-4c41-9bc3-987673599840 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:32.731939 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a467cb-4a23-4c41-9bc3-987673599840 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:32.731939 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a467cb-4a23-4c41-9bc3-987673599840 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:32.733702 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 647/1274] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:39:32.738790 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5b6a5-94ea-4e99-b539-178f7c2a77f0 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:32.739299 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5b6a5-94ea-4e99-b539-178f7c2a77f0 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:32.739407 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5b6a5-94ea-4e99-b539-178f7c2a77f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:32.755559 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-9fc5b6a5-94ea-4e99-b539-178f7c2a77f0 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:39:32.756756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9fc5b6a5-94ea-4e99-b539-178f7c2a77f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:39:32.819150 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 628/1275] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:39:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:39:32.845224 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a467cb-4a23-4c41-9bc3-987673599840 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:32.942703 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a467cb-4a23-4c41-9bc3-987673599840 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:32.976298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa340339-3296-41ad-898e-b7bc88fb9177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:32.977116 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340339-3296-41ad-898e-b7bc88fb9177 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:32.977396 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340339-3296-41ad-898e-b7bc88fb9177 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:32.977667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340339-3296-41ad-898e-b7bc88fb9177 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:32.988719 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa340339-3296-41ad-898e-b7bc88fb9177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 14 21:39:32.995562 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-aa340339-3296-41ad-898e-b7bc88fb9177 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 14 21:39:32.996804 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 648/1276] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Apr 14 21:39:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:33.002984 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5b6a5-94ea-4e99-b539-178f7c2a77f0 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:33.098346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5b6a5-94ea-4e99-b539-178f7c2a77f0 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:33.131317 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89c433-52f9-46ab-a46a-278d0ab9d097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:33.131978 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89c433-52f9-46ab-a46a-278d0ab9d097 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:33.132251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89c433-52f9-46ab-a46a-278d0ab9d097 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:33.132521 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89c433-52f9-46ab-a46a-278d0ab9d097 None admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:33.133293 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89c433-52f9-46ab-a46a-278d0ab9d097 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:33.133651 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89c433-52f9-46ab-a46a-278d0ab9d097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:33.135011 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89c433-52f9-46ab-a46a-278d0ab9d097 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:33.143571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 629/1277] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Apr 14 21:39:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:33.149490 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa340339-3296-41ad-898e-b7bc88fb9177 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:33.245455 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa340339-3296-41ad-898e-b7bc88fb9177 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:33.285139 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d657b-194e-478b-968d-217fe2c5046b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:33.285971 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d657b-194e-478b-968d-217fe2c5046b None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:33.286261 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d657b-194e-478b-968d-217fe2c5046b None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:33.286550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d657b-194e-478b-968d-217fe2c5046b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:33.297127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d657b-194e-478b-968d-217fe2c5046b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:33.298637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d657b-194e-478b-968d-217fe2c5046b None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:33.315461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-501d657b-194e-478b-968d-217fe2c5046b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:39:33.318665 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 649/1278] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:33.324387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89c433-52f9-46ab-a46a-278d0ab9d097 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:33.420219 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89c433-52f9-46ab-a46a-278d0ab9d097 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:33.453167 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dc54c-3cc5-4b1a-9431-79703c2c2165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:33.453843 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dc54c-3cc5-4b1a-9431-79703c2c2165 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:33.454126 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dc54c-3cc5-4b1a-9431-79703c2c2165 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:33.454398 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dc54c-3cc5-4b1a-9431-79703c2c2165 None admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:33.455116 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dc54c-3cc5-4b1a-9431-79703c2c2165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:33.455417 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dc54c-3cc5-4b1a-9431-79703c2c2165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:33.456802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dc54c-3cc5-4b1a-9431-79703c2c2165 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:33.468675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 630/1279] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:33.474645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d657b-194e-478b-968d-217fe2c5046b None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:33.569691 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d657b-194e-478b-968d-217fe2c5046b None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:33.601006 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc73a0b-ee91-4b63-b37d-2b936f8eb177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:33.601786 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc73a0b-ee91-4b63-b37d-2b936f8eb177 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:33.602064 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc73a0b-ee91-4b63-b37d-2b936f8eb177 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:33.602336 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc73a0b-ee91-4b63-b37d-2b936f8eb177 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:33.610817 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc73a0b-ee91-4b63-b37d-2b936f8eb177 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:33.612245 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc73a0b-ee91-4b63-b37d-2b936f8eb177 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:33.625867 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-cbc73a0b-ee91-4b63-b37d-2b936f8eb177 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 14 21:39:33.629362 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 650/1280] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 14 21:39:33.633250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dc54c-3cc5-4b1a-9431-79703c2c2165 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:33.729178 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dc54c-3cc5-4b1a-9431-79703c2c2165 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:33.761660 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f80145-2f6c-4492-9a99-2fc6a66966bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:33.762318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f80145-2f6c-4492-9a99-2fc6a66966bc None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:33.762596 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f80145-2f6c-4492-9a99-2fc6a66966bc None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:33.762868 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f80145-2f6c-4492-9a99-2fc6a66966bc None admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:33.763762 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f80145-2f6c-4492-9a99-2fc6a66966bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:33.764065 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f80145-2f6c-4492-9a99-2fc6a66966bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:33.765525 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f80145-2f6c-4492-9a99-2fc6a66966bc None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:33.781840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 631/1281] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Apr 14 21:39:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:33.787822 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc73a0b-ee91-4b63-b37d-2b936f8eb177 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:33.883783 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc73a0b-ee91-4b63-b37d-2b936f8eb177 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:33.915623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a207bb-5002-41fd-9059-767462403473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:33.916268 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a207bb-5002-41fd-9059-767462403473 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:33.916549 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a207bb-5002-41fd-9059-767462403473 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:33.916849 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a207bb-5002-41fd-9059-767462403473 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:33.981899 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a207bb-5002-41fd-9059-767462403473 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:33.984269 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a207bb-5002-41fd-9059-767462403473 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:34.078689 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 651/1282] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Apr 14 21:39:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 14 21:39:34.084352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f80145-2f6c-4492-9a99-2fc6a66966bc None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:34.181005 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f80145-2f6c-4492-9a99-2fc6a66966bc None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:34.212912 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823318bf-333d-4a25-8576-d50e10a7b158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:34.213681 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823318bf-333d-4a25-8576-d50e10a7b158 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:34.213957 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823318bf-333d-4a25-8576-d50e10a7b158 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:34.214222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823318bf-333d-4a25-8576-d50e10a7b158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:34.224370 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823318bf-333d-4a25-8576-d50e10a7b158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:34.225823 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823318bf-333d-4a25-8576-d50e10a7b158 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:34.242332 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-823318bf-333d-4a25-8576-d50e10a7b158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 14 21:39:34.243489 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 632/1283] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:34.249593 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a207bb-5002-41fd-9059-767462403473 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:34.344740 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a207bb-5002-41fd-9059-767462403473 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:34.376376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53c876-558e-47a8-bb8e-399809c3c53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:34.377060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53c876-558e-47a8-bb8e-399809c3c53d None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:34.377339 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53c876-558e-47a8-bb8e-399809c3c53d None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:34.377612 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53c876-558e-47a8-bb8e-399809c3c53d None admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:34.381119 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53c876-558e-47a8-bb8e-399809c3c53d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:34.381436 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53c876-558e-47a8-bb8e-399809c3c53d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:34.382803 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53c876-558e-47a8-bb8e-399809c3c53d None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:34.394065 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 652/1284] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Apr 14 21:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:34.399749 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823318bf-333d-4a25-8576-d50e10a7b158 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:34.495677 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823318bf-333d-4a25-8576-d50e10a7b158 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:34.530188 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afedaf-fe95-472c-9d5b-bde7ef8ba8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:34.530958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afedaf-fe95-472c-9d5b-bde7ef8ba8e8 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:34.531236 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afedaf-fe95-472c-9d5b-bde7ef8ba8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:34.531578 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afedaf-fe95-472c-9d5b-bde7ef8ba8e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:34.538205 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afedaf-fe95-472c-9d5b-bde7ef8ba8e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:34.539716 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afedaf-fe95-472c-9d5b-bde7ef8ba8e8 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:34.552616 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING keystone.server.flask.application [None req-49afedaf-fe95-472c-9d5b-bde7ef8ba8e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 14 21:39:34.553773 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 633/1285] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Apr 14 21:39:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:34.559744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53c876-558e-47a8-bb8e-399809c3c53d None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:34.656968 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53c876-558e-47a8-bb8e-399809c3c53d None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:34.689268 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920eb302-5c3c-4e7e-970c-5f5e2e5f77b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:34.689930 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920eb302-5c3c-4e7e-970c-5f5e2e5f77b6 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:34.690214 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920eb302-5c3c-4e7e-970c-5f5e2e5f77b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:34.690492 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920eb302-5c3c-4e7e-970c-5f5e2e5f77b6 None admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:34.691274 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920eb302-5c3c-4e7e-970c-5f5e2e5f77b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:34.691613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920eb302-5c3c-4e7e-970c-5f5e2e5f77b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:34.693077 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920eb302-5c3c-4e7e-970c-5f5e2e5f77b6 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:34.705715 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 653/1286] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Apr 14 21:39:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:34.712177 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afedaf-fe95-472c-9d5b-bde7ef8ba8e8 None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:34.808634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afedaf-fe95-472c-9d5b-bde7ef8ba8e8 None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:34.841060 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93463b-102b-46b6-8a5a-c67a97678716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:34.841727 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93463b-102b-46b6-8a5a-c67a97678716 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:34.842002 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93463b-102b-46b6-8a5a-c67a97678716 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:34.842274 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93463b-102b-46b6-8a5a-c67a97678716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:34.843098 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93463b-102b-46b6-8a5a-c67a97678716 None admin] RBAC: Adding query filter params (role.id=aa032515dce047fbb4cf1651e0d95979, scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a, user.id=9e166c6b0e5542f7b912cbefa88bb5f4) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:34.843404 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93463b-102b-46b6-8a5a-c67a97678716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:34.844857 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93463b-102b-46b6-8a5a-c67a97678716 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:34.850409 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 634/1287] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Apr 14 21:39:34 2022] GET /identity/v3/role_assignments?user.id=9e166c6b0e5542f7b912cbefa88bb5f4&scope.project.id=a3c1bb37aa1c407782b2f5501ae1f10a&role.id=aa032515dce047fbb4cf1651e0d95979 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:37.146980 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbd25e-4d0e-4fcb-ac01-4db4c5e78753 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:37.147526 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbd25e-4d0e-4fcb-ac01-4db4c5e78753 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:37.147526 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbd25e-4d0e-4fcb-ac01-4db4c5e78753 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:37.149000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 654/1288] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:39:37.154878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5841b5-f880-4375-bdc9-01b8da074957 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:37.155328 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5841b5-f880-4375-bdc9-01b8da074957 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:37.155421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5841b5-f880-4375-bdc9-01b8da074957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:37.172328 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-9c5841b5-f880-4375-bdc9-01b8da074957 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:39:37.173570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9c5841b5-f880-4375-bdc9-01b8da074957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:39:37.236659 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 635/1289] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:39:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:39:37.259207 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbd25e-4d0e-4fcb-ac01-4db4c5e78753 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:37.363043 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbd25e-4d0e-4fcb-ac01-4db4c5e78753 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:37.396023 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee9367-5bb1-4962-ac39-57fda8904f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:37.396830 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee9367-5bb1-4962-ac39-57fda8904f38 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:37.397109 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee9367-5bb1-4962-ac39-57fda8904f38 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:37.397383 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee9367-5bb1-4962-ac39-57fda8904f38 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:37.398027 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee9367-5bb1-4962-ac39-57fda8904f38 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:37.399385 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee9367-5bb1-4962-ac39-57fda8904f38 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:37.410857 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-41ee9367-5bb1-4962-ac39-57fda8904f38 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 14 21:39:37.412010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 655/1290] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Apr 14 21:39:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:37.419468 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5841b5-f880-4375-bdc9-01b8da074957 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:37.515567 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5841b5-f880-4375-bdc9-01b8da074957 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:37.548386 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e439e40-396f-4a17-b1a4-01b96554767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:37.549126 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e439e40-396f-4a17-b1a4-01b96554767c None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:37.549411 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e439e40-396f-4a17-b1a4-01b96554767c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:37.549683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e439e40-396f-4a17-b1a4-01b96554767c None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:37.550384 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e439e40-396f-4a17-b1a4-01b96554767c None admin] RBAC: Adding query filter params (name=placement) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:37.550692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e439e40-396f-4a17-b1a4-01b96554767c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:37.552049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e439e40-396f-4a17-b1a4-01b96554767c None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:37.556775 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 636/1291] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Apr 14 21:39:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:37.562659 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee9367-5bb1-4962-ac39-57fda8904f38 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:37.660059 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee9367-5bb1-4962-ac39-57fda8904f38 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:37.692758 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e1c9f-c6b0-475e-b8ef-ef695f7c9197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:37.693445 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e1c9f-c6b0-475e-b8ef-ef695f7c9197 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:37.693724 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e1c9f-c6b0-475e-b8ef-ef695f7c9197 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:37.694000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e1c9f-c6b0-475e-b8ef-ef695f7c9197 None admin] PATH_INFO: `/v3/services` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:37.694706 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e1c9f-c6b0-475e-b8ef-ef695f7c9197 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:37.695027 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e1c9f-c6b0-475e-b8ef-ef695f7c9197 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:37.696514 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e1c9f-c6b0-475e-b8ef-ef695f7c9197 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:37.701727 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 656/1292] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Apr 14 21:39:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:39.961742 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798a1b7-0796-44ac-a7c3-2b4ff31f1e29 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:39.962324 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798a1b7-0796-44ac-a7c3-2b4ff31f1e29 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:39.962324 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798a1b7-0796-44ac-a7c3-2b4ff31f1e29 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:39.963637 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 637/1293] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:39:39.968913 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fdddc-b528-4b9f-bc06-cd472c18ebe5 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:39.969323 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fdddc-b528-4b9f-bc06-cd472c18ebe5 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:39.969553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fdddc-b528-4b9f-bc06-cd472c18ebe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:39.987995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-c84fdddc-b528-4b9f-bc06-cd472c18ebe5 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:39:39.987995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c84fdddc-b528-4b9f-bc06-cd472c18ebe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:39:40.051081 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 657/1294] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:39:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 14 21:39:40.076309 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798a1b7-0796-44ac-a7c3-2b4ff31f1e29 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:40.177039 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798a1b7-0796-44ac-a7c3-2b4ff31f1e29 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:40.214831 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cf617-29b1-43fb-804a-28a970757629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:40.215420 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cf617-29b1-43fb-804a-28a970757629 None admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:40.215696 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cf617-29b1-43fb-804a-28a970757629 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:40.215965 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cf617-29b1-43fb-804a-28a970757629 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:40.217310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0cf617-29b1-43fb-804a-28a970757629 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:40.218667 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0cf617-29b1-43fb-804a-28a970757629 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:40.350754 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 638/1295] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Apr 14 21:39:40 2022] POST /identity/v3/services => generated 246 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:39:42.658001 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ddc0c-dc37-4322-89c0-9ab3a8781a17 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:42.658555 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ddc0c-dc37-4322-89c0-9ab3a8781a17 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:42.658555 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ddc0c-dc37-4322-89c0-9ab3a8781a17 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:42.659914 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 658/1296] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:39:42.665173 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf98f0f-e11c-48f4-9df1-f654d127ecf0 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:42.665563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf98f0f-e11c-48f4-9df1-f654d127ecf0 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:42.665728 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf98f0f-e11c-48f4-9df1-f654d127ecf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:42.682773 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-dcf98f0f-e11c-48f4-9df1-f654d127ecf0 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:39:42.683979 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-dcf98f0f-e11c-48f4-9df1-f654d127ecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:39:42.754354 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 639/1297] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:39:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:39:42.779311 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ddc0c-dc37-4322-89c0-9ab3a8781a17 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:42.875780 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ddc0c-dc37-4322-89c0-9ab3a8781a17 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:42.908273 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17f67a-61de-4b19-8166-029827521b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:42.909036 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17f67a-61de-4b19-8166-029827521b12 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:42.909319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17f67a-61de-4b19-8166-029827521b12 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:42.909594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17f67a-61de-4b19-8166-029827521b12 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:42.910243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17f67a-61de-4b19-8166-029827521b12 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:42.911612 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17f67a-61de-4b19-8166-029827521b12 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:42.922567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-4a17f67a-61de-4b19-8166-029827521b12 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 14 21:39:42.923763 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 659/1298] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Apr 14 21:39:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:42.929807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf98f0f-e11c-48f4-9df1-f654d127ecf0 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:43.027115 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf98f0f-e11c-48f4-9df1-f654d127ecf0 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:43.059409 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7f0fc-28c2-419a-ba5d-2c4f3809d70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:43.060571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7f0fc-28c2-419a-ba5d-2c4f3809d70c None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:43.061026 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7f0fc-28c2-419a-ba5d-2c4f3809d70c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:43.061301 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7f0fc-28c2-419a-ba5d-2c4f3809d70c None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:43.062003 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7f0fc-28c2-419a-ba5d-2c4f3809d70c None admin] RBAC: Adding query filter params (name=placement) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:43.062308 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7f0fc-28c2-419a-ba5d-2c4f3809d70c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:43.063675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7f0fc-28c2-419a-ba5d-2c4f3809d70c None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:43.068643 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 640/1299] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Apr 14 21:39:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:39:43.074906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17f67a-61de-4b19-8166-029827521b12 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:43.170933 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17f67a-61de-4b19-8166-029827521b12 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:43.203512 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d1fec-839e-442f-9a81-135fda9cbd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:43.204165 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d1fec-839e-442f-9a81-135fda9cbd49 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:43.204447 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d1fec-839e-442f-9a81-135fda9cbd49 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:43.204758 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d1fec-839e-442f-9a81-135fda9cbd49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:43.205550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d1fec-839e-442f-9a81-135fda9cbd49 None admin] RBAC: Adding query filter params (interface=public, service_id=66c4b4c28d2c4e9692d4b8647fe40489, region_id=RegionOne) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:43.205861 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d1fec-839e-442f-9a81-135fda9cbd49 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:43.207223 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d1fec-839e-442f-9a81-135fda9cbd49 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:43.212452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 660/1300] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Apr 14 21:39:43 2022] GET /identity/v3/endpoints?service_id=66c4b4c28d2c4e9692d4b8647fe40489&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:43.218327 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7f0fc-28c2-419a-ba5d-2c4f3809d70c None admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:43.313598 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7f0fc-28c2-419a-ba5d-2c4f3809d70c None admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:43.346220 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a73d24-5a0e-4ebe-96f6-7d4cfbef8e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:43.346871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a73d24-5a0e-4ebe-96f6-7d4cfbef8e5c None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:43.347151 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a73d24-5a0e-4ebe-96f6-7d4cfbef8e5c None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:43.347425 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a73d24-5a0e-4ebe-96f6-7d4cfbef8e5c None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:43.348100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a73d24-5a0e-4ebe-96f6-7d4cfbef8e5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:43.349483 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a73d24-5a0e-4ebe-96f6-7d4cfbef8e5c None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:43.355965 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 641/1301] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Apr 14 21:39:43 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:39:45.639964 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c425b3-b795-408a-93d6-9e4a0f459305 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:45.640539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c425b3-b795-408a-93d6-9e4a0f459305 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:45.640539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c425b3-b795-408a-93d6-9e4a0f459305 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:45.641951 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 661/1302] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:39:45.647251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e2519-507c-4eb7-84c8-abf290941796 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:45.647716 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e2519-507c-4eb7-84c8-abf290941796 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:45.647891 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e2519-507c-4eb7-84c8-abf290941796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:45.664716 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-7d8e2519-507c-4eb7-84c8-abf290941796 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:39:45.665882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-7d8e2519-507c-4eb7-84c8-abf290941796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:39:45.728482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 642/1303] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:39:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 14 21:39:45.752064 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c425b3-b795-408a-93d6-9e4a0f459305 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:45.851485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c425b3-b795-408a-93d6-9e4a0f459305 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:45.883438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64d100-fc03-4660-b768-b8eb2757f471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:45.884221 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64d100-fc03-4660-b768-b8eb2757f471 None admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:45.884497 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64d100-fc03-4660-b768-b8eb2757f471 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:45.884865 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64d100-fc03-4660-b768-b8eb2757f471 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:45.885514 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64d100-fc03-4660-b768-b8eb2757f471 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:45.886875 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64d100-fc03-4660-b768-b8eb2757f471 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:45.898256 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING keystone.server.flask.application [None req-9c64d100-fc03-4660-b768-b8eb2757f471 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 14 21:39:45.899376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 662/1304] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Apr 14 21:39:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 14 21:39:45.905751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e2519-507c-4eb7-84c8-abf290941796 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:46.002591 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e2519-507c-4eb7-84c8-abf290941796 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:46.035049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d614ba3-f579-4703-875d-2f147aa16b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:46.035721 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d614ba3-f579-4703-875d-2f147aa16b97 None admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:46.035988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d614ba3-f579-4703-875d-2f147aa16b97 None admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:46.036262 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d614ba3-f579-4703-875d-2f147aa16b97 None admin] PATH_INFO: `/v3/services` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:46.036997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d614ba3-f579-4703-875d-2f147aa16b97 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:39:46.037317 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d614ba3-f579-4703-875d-2f147aa16b97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:46.038670 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d614ba3-f579-4703-875d-2f147aa16b97 None admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:46.043721 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 643/1305] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Apr 14 21:39:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:39:46.051095 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64d100-fc03-4660-b768-b8eb2757f471 None admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:39:46.147144 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64d100-fc03-4660-b768-b8eb2757f471 None admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:39:46.180597 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2147df6-0ab0-4844-af50-5b5d8020f070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:39:46.180597 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147df6-0ab0-4844-af50-5b5d8020f070 None admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:39:46.180597 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147df6-0ab0-4844-af50-5b5d8020f070 None admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:39:46.180597 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147df6-0ab0-4844-af50-5b5d8020f070 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:39:46.181201 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2147df6-0ab0-4844-af50-5b5d8020f070 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:39:46.182563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2147df6-0ab0-4844-af50-5b5d8020f070 None admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:39:46.264688 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 663/1306] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Apr 14 21:39:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:47:19.075695 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a3fa0-07dd-4274-99b0-3e6aa053c948 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:19.076645 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a3fa0-07dd-4274-99b0-3e6aa053c948 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:19.077076 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a3fa0-07dd-4274-99b0-3e6aa053c948 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:19.085609 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eca06-58ac-4773-b1fb-72a866cd9ed1 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:19.086491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eca06-58ac-4773-b1fb-72a866cd9ed1 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:19.086923 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eca06-58ac-4773-b1fb-72a866cd9ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:19.088481 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 644/1307] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:47:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:47:19.186048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-f73eca06-58ac-4773-b1fb-72a866cd9ed1 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:47:19.187553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f73eca06-58ac-4773-b1fb-72a866cd9ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:19.385933 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 664/1308] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:47:19.447222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618a7e6-95dc-433b-b68f-31b7a16e78d4 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:19.448608 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618a7e6-95dc-433b-b68f-31b7a16e78d4 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:19.449938 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618a7e6-95dc-433b-b68f-31b7a16e78d4 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:19.452970 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 645/1309] 10.222.0.52 () {54 vars in 964 bytes} [Thu Apr 14 21:47:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:47:19.468603 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a283f1-ca4f-4288-a604-6b1dca4a72fb None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:19.469434 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a283f1-ca4f-4288-a604-6b1dca4a72fb None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:19.470508 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a283f1-ca4f-4288-a604-6b1dca4a72fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:19.588795 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-59a283f1-ca4f-4288-a604-6b1dca4a72fb None None] MFA Rules not processed for user `1bfbd6a387e44037a58e521230783347`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:47:19.590906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-59a283f1-ca4f-4288-a604-6b1dca4a72fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:19.676309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 665/1310] 10.222.0.52 () {58 vars in 1061 bytes} [Thu Apr 14 21:47:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:47:19.685388 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618a7e6-95dc-433b-b68f-31b7a16e78d4 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:47:19.687526 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d618a7e6-95dc-433b-b68f-31b7a16e78d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:19.809597 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618a7e6-95dc-433b-b68f-31b7a16e78d4 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:47:19.895279 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddeefe-82f5-4047-83ad-c150a49f84ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:47:19.896035 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddeefe-82f5-4047-83ad-c150a49f84ae service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:19.896385 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddeefe-82f5-4047-83ad-c150a49f84ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:19.896760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddeefe-82f5-4047-83ad-c150a49f84ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:19.899597 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c1ddeefe-82f5-4047-83ad-c150a49f84ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:20.025871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddeefe-82f5-4047-83ad-c150a49f84ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:47:20.027355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddeefe-82f5-4047-83ad-c150a49f84ae service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:47:20.047260 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 646/1311] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:47:22.662077 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e2699-93f4-4b4b-b5ff-fd3ff73fc4af None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:22.662600 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e2699-93f4-4b4b-b5ff-fd3ff73fc4af None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:22.662600 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e2699-93f4-4b4b-b5ff-fd3ff73fc4af None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:22.663925 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 666/1312] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:47:22.669811 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b934e-d6f4-49e4-8881-99b09b000770 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:22.670244 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b934e-d6f4-49e4-8881-99b09b000770 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:22.670341 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b934e-d6f4-49e4-8881-99b09b000770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:22.754598 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-c66b934e-d6f4-49e4-8881-99b09b000770 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:47:22.755904 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c66b934e-d6f4-49e4-8881-99b09b000770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:22.850267 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 647/1313] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:47:22.890088 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e2699-93f4-4b4b-b5ff-fd3ff73fc4af None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:47:22.891725 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-0e1e2699-93f4-4b4b-b5ff-fd3ff73fc4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:22.993879 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e2699-93f4-4b4b-b5ff-fd3ff73fc4af None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:47:23.066818 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336311ad-a12a-4e45-bc29-dbee05f5b773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:47:23.067467 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336311ad-a12a-4e45-bc29-dbee05f5b773 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:23.067746 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336311ad-a12a-4e45-bc29-dbee05f5b773 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:23.068021 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336311ad-a12a-4e45-bc29-dbee05f5b773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:23.069699 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-336311ad-a12a-4e45-bc29-dbee05f5b773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:23.177127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336311ad-a12a-4e45-bc29-dbee05f5b773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:47:23.178565 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336311ad-a12a-4e45-bc29-dbee05f5b773 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:47:23.196840 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 667/1314] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:47:26.073641 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62961a2f-2006-470d-b5c2-b2961c6a1c57 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:26.074235 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62961a2f-2006-470d-b5c2-b2961c6a1c57 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:26.074475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62961a2f-2006-470d-b5c2-b2961c6a1c57 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:26.076068 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 648/1315] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:47:26.081313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80209a-eed8-49a4-a292-2c9a18152e73 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:26.081742 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80209a-eed8-49a4-a292-2c9a18152e73 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:26.081906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80209a-eed8-49a4-a292-2c9a18152e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:26.151881 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-7f80209a-eed8-49a4-a292-2c9a18152e73 None None] MFA Rules not processed for user `70c226c0c5ea45f29547a5be6433762e`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:47:26.153716 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-7f80209a-eed8-49a4-a292-2c9a18152e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:26.250060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 668/1316] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:47:26 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:47:26.290147 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62961a2f-2006-470d-b5c2-b2961c6a1c57 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:47:26.291652 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-62961a2f-2006-470d-b5c2-b2961c6a1c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:26.392837 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62961a2f-2006-470d-b5c2-b2961c6a1c57 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:47:26.463608 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cbe5a-3836-4215-b6cf-a1b90e581578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:47:26.464251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cbe5a-3836-4215-b6cf-a1b90e581578 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:26.464553 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cbe5a-3836-4215-b6cf-a1b90e581578 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:26.465238 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cbe5a-3836-4215-b6cf-a1b90e581578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:26.467061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5a8cbe5a-3836-4215-b6cf-a1b90e581578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:26.573178 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cbe5a-3836-4215-b6cf-a1b90e581578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:47:26.575509 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cbe5a-3836-4215-b6cf-a1b90e581578 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:47:26.594480 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 649/1317] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:47:26 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:47:29.695365 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb300e-d730-4b4c-b9e7-58d8cceb3401 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:29.695909 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb300e-d730-4b4c-b9e7-58d8cceb3401 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:29.695909 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb300e-d730-4b4c-b9e7-58d8cceb3401 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:29.697327 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 669/1318] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:47:29.703250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44857f6-a143-4952-9265-fd2a6a3e2a17 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:29.703654 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44857f6-a143-4952-9265-fd2a6a3e2a17 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:29.703803 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44857f6-a143-4952-9265-fd2a6a3e2a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:29.767153 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-f44857f6-a143-4952-9265-fd2a6a3e2a17 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:47:29.768355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f44857f6-a143-4952-9265-fd2a6a3e2a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:29.862862 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 650/1319] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:47:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:47:29.919319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d13dc-4e02-447a-ad15-70356c4fe66c None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:29.919595 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d13dc-4e02-447a-ad15-70356c4fe66c None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:29.919867 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d13dc-4e02-447a-ad15-70356c4fe66c None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:29.921275 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 670/1320] 10.222.0.52 () {54 vars in 964 bytes} [Thu Apr 14 21:47:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:47:29.927435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a44ae-da76-4329-a260-3072356f56b7 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:29.927722 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a44ae-da76-4329-a260-3072356f56b7 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:29.928000 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a44ae-da76-4329-a260-3072356f56b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:30.002386 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-7c3a44ae-da76-4329-a260-3072356f56b7 None None] MFA Rules not processed for user `1bfbd6a387e44037a58e521230783347`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:47:30.003596 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-7c3a44ae-da76-4329-a260-3072356f56b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:30.078101 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 651/1321] 10.222.0.52 () {58 vars in 1061 bytes} [Thu Apr 14 21:47:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:47:30.087131 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d13dc-4e02-447a-ad15-70356c4fe66c None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:47:30.088684 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-090d13dc-4e02-447a-ad15-70356c4fe66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:30.188645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d13dc-4e02-447a-ad15-70356c4fe66c None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:47:30.259632 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26267811-62d7-4a18-9969-55b9a1044185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:47:30.260192 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26267811-62d7-4a18-9969-55b9a1044185 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:30.260470 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26267811-62d7-4a18-9969-55b9a1044185 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:30.260772 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26267811-62d7-4a18-9969-55b9a1044185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:30.263061 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-26267811-62d7-4a18-9969-55b9a1044185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:30.366341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26267811-62d7-4a18-9969-55b9a1044185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:47:30.367769 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26267811-62d7-4a18-9969-55b9a1044185 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:47:30.385841 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 671/1322] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:47:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:47:34.161644 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf98db-1fcb-478e-968c-5583bd964624 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:34.162251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf98db-1fcb-478e-968c-5583bd964624 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:34.162251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf98db-1fcb-478e-968c-5583bd964624 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:34.163556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 652/1323] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:47:34.169134 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09d2da-dabc-4c45-b03e-bacb81297f0e None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:34.169559 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09d2da-dabc-4c45-b03e-bacb81297f0e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:34.169666 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09d2da-dabc-4c45-b03e-bacb81297f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:34.233712 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-8c09d2da-dabc-4c45-b03e-bacb81297f0e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:47:34.234976 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8c09d2da-dabc-4c45-b03e-bacb81297f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:34.331373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 672/1324] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:47:34.369001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf98db-1fcb-478e-968c-5583bd964624 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:47:34.370539 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e4bf98db-1fcb-478e-968c-5583bd964624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:34.470320 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf98db-1fcb-478e-968c-5583bd964624 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:47:34.540807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9f555-585d-49e0-8f0f-e57a40aa526e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:47:34.541455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9f555-585d-49e0-8f0f-e57a40aa526e service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:34.541731 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9f555-585d-49e0-8f0f-e57a40aa526e service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:34.542001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9f555-585d-49e0-8f0f-e57a40aa526e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:34.543802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a5a9f555-585d-49e0-8f0f-e57a40aa526e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:34.650076 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9f555-585d-49e0-8f0f-e57a40aa526e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:47:34.651541 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9f555-585d-49e0-8f0f-e57a40aa526e service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:47:34.670300 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 653/1325] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:47:37.064490 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7744a20-b8e0-4e27-b4f6-b782c5ab465d None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:37.065068 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7744a20-b8e0-4e27-b4f6-b782c5ab465d None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:37.065184 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7744a20-b8e0-4e27-b4f6-b782c5ab465d None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:37.066539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 673/1326] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:47:37.071810 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b5238-0a7d-4897-9ba2-ac1cef5d57c1 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:37.072262 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b5238-0a7d-4897-9ba2-ac1cef5d57c1 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:37.072495 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b5238-0a7d-4897-9ba2-ac1cef5d57c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:37.138072 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-ce7b5238-0a7d-4897-9ba2-ac1cef5d57c1 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:47:37.139282 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ce7b5238-0a7d-4897-9ba2-ac1cef5d57c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:37.238008 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 654/1327] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:47:37.276056 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7744a20-b8e0-4e27-b4f6-b782c5ab465d None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:47:37.278320 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d7744a20-b8e0-4e27-b4f6-b782c5ab465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:37.379337 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7744a20-b8e0-4e27-b4f6-b782c5ab465d None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:47:37.451624 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebdc8a-d2cb-445c-9f43-25b681d6f4e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:47:37.452273 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebdc8a-d2cb-445c-9f43-25b681d6f4e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:37.452555 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebdc8a-d2cb-445c-9f43-25b681d6f4e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:37.452859 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebdc8a-d2cb-445c-9f43-25b681d6f4e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:37.454495 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-33ebdc8a-d2cb-445c-9f43-25b681d6f4e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:37.560981 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebdc8a-d2cb-445c-9f43-25b681d6f4e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:47:37.562330 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebdc8a-d2cb-445c-9f43-25b681d6f4e2 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:47:37.579984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 674/1328] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:47:39.917177 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de47844-3f36-48ef-9a69-726d5ca9b784 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:39.917753 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de47844-3f36-48ef-9a69-726d5ca9b784 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:39.918044 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de47844-3f36-48ef-9a69-726d5ca9b784 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:39.919459 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 655/1329] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:47:39.924783 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a57eb2-e876-4718-9949-b539a593b2f4 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:39.925211 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a57eb2-e876-4718-9949-b539a593b2f4 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:39.925466 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a57eb2-e876-4718-9949-b539a593b2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:39.989375 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-99a57eb2-e876-4718-9949-b539a593b2f4 None None] MFA Rules not processed for user `70c226c0c5ea45f29547a5be6433762e`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:47:39.990595 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-99a57eb2-e876-4718-9949-b539a593b2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:40.085319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 675/1330] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:47:39 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:47:40.124962 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de47844-3f36-48ef-9a69-726d5ca9b784 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:47:40.126539 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1de47844-3f36-48ef-9a69-726d5ca9b784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:40.227728 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de47844-3f36-48ef-9a69-726d5ca9b784 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:47:40.300891 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17387655-d749-492b-a695-fa6d49b56d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:47:40.301536 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17387655-d749-492b-a695-fa6d49b56d7a service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:40.301816 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17387655-d749-492b-a695-fa6d49b56d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:40.302089 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17387655-d749-492b-a695-fa6d49b56d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:40.303712 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-17387655-d749-492b-a695-fa6d49b56d7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:40.413672 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17387655-d749-492b-a695-fa6d49b56d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:47:40.415110 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17387655-d749-492b-a695-fa6d49b56d7a service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:47:40.442580 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 656/1331] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:47:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:47:43.272000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c820d0-b2ed-4d20-92df-9e8f2af18087 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:43.272479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c820d0-b2ed-4d20-92df-9e8f2af18087 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:43.272479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c820d0-b2ed-4d20-92df-9e8f2af18087 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:43.274148 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 676/1332] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:47:43.282215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e4307-60c2-47a9-ad80-e65ee074dc18 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:43.282660 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e4307-60c2-47a9-ad80-e65ee074dc18 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:43.282765 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e4307-60c2-47a9-ad80-e65ee074dc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:43.348469 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-336e4307-60c2-47a9-ad80-e65ee074dc18 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:47:43.349713 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-336e4307-60c2-47a9-ad80-e65ee074dc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:43.451375 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 657/1333] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:47:43.489403 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c820d0-b2ed-4d20-92df-9e8f2af18087 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:47:43.490984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f3c820d0-b2ed-4d20-92df-9e8f2af18087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:43.594033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c820d0-b2ed-4d20-92df-9e8f2af18087 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:47:43.671088 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91a840-d3e4-4ed5-80ef-c9631e3e0e88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:47:43.671748 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91a840-d3e4-4ed5-80ef-c9631e3e0e88 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:43.672045 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91a840-d3e4-4ed5-80ef-c9631e3e0e88 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:43.672294 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91a840-d3e4-4ed5-80ef-c9631e3e0e88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:43.674016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-5f91a840-d3e4-4ed5-80ef-c9631e3e0e88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:43.790773 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91a840-d3e4-4ed5-80ef-c9631e3e0e88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:47:43.792422 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91a840-d3e4-4ed5-80ef-c9631e3e0e88 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:47:43.813815 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 677/1334] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:47:46.165914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118c6e8-c3e0-4874-bd1e-cd16e99f08b8 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:46.166440 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118c6e8-c3e0-4874-bd1e-cd16e99f08b8 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:46.166440 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118c6e8-c3e0-4874-bd1e-cd16e99f08b8 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:46.167835 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 658/1335] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:47:46.173014 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dcbaa-b86e-427e-a411-8b5a185383b5 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:46.173395 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dcbaa-b86e-427e-a411-8b5a185383b5 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:46.173560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dcbaa-b86e-427e-a411-8b5a185383b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:46.237303 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-c05dcbaa-b86e-427e-a411-8b5a185383b5 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:47:46.238437 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c05dcbaa-b86e-427e-a411-8b5a185383b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:46.331555 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 678/1336] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:47:46.373581 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118c6e8-c3e0-4874-bd1e-cd16e99f08b8 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:47:46.375104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a118c6e8-c3e0-4874-bd1e-cd16e99f08b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:46.475945 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118c6e8-c3e0-4874-bd1e-cd16e99f08b8 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:47:46.550068 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3f1e2-5c4b-441c-8d89-33ad8a2d088e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:47:46.550643 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3f1e2-5c4b-441c-8d89-33ad8a2d088e service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:46.550922 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3f1e2-5c4b-441c-8d89-33ad8a2d088e service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:46.551193 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3f1e2-5c4b-441c-8d89-33ad8a2d088e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:46.552849 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-faf3f1e2-5c4b-441c-8d89-33ad8a2d088e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:46.663676 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3f1e2-5c4b-441c-8d89-33ad8a2d088e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:47:46.665160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3f1e2-5c4b-441c-8d89-33ad8a2d088e service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:47:46.683645 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 659/1337] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:47:49.648881 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacae20-19cd-482e-bdbb-53200a8f31fc None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:49.649418 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacae20-19cd-482e-bdbb-53200a8f31fc None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:49.649418 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacae20-19cd-482e-bdbb-53200a8f31fc None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:49.650840 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 679/1338] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:47:49.656940 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b0ede-4f6f-4ba0-93b7-f557d62fbac2 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:49.657342 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b0ede-4f6f-4ba0-93b7-f557d62fbac2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:49.657486 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b0ede-4f6f-4ba0-93b7-f557d62fbac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:49.723023 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-c53b0ede-4f6f-4ba0-93b7-f557d62fbac2 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:47:49.724225 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c53b0ede-4f6f-4ba0-93b7-f557d62fbac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:49.827292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 660/1339] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:47:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:47:49.863604 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacae20-19cd-482e-bdbb-53200a8f31fc None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:47:49.865794 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-3dacae20-19cd-482e-bdbb-53200a8f31fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:49.973045 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacae20-19cd-482e-bdbb-53200a8f31fc None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:47:49.976802 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f9ccc-bfdd-46b0-bbb3-d53caaca53de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:47:49.977440 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f9ccc-bfdd-46b0-bbb3-d53caaca53de service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:49.977718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f9ccc-bfdd-46b0-bbb3-d53caaca53de service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:49.977989 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f9ccc-bfdd-46b0-bbb3-d53caaca53de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:50.007878 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f9ccc-bfdd-46b0-bbb3-d53caaca53de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:47:50.009471 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f9ccc-bfdd-46b0-bbb3-d53caaca53de service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:47:50.019363 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 680/1340] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:47:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:47:54.508621 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45313b6-1762-4c35-b7b2-2e52bd621ef4 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:54.509148 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45313b6-1762-4c35-b7b2-2e52bd621ef4 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:54.509148 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45313b6-1762-4c35-b7b2-2e52bd621ef4 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:54.511173 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 661/1341] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:47:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:47:54.516376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36883b00-1be4-4f99-9ced-e5117e3b733c None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:54.516821 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36883b00-1be4-4f99-9ced-e5117e3b733c None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:54.517095 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36883b00-1be4-4f99-9ced-e5117e3b733c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:54.574853 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-36883b00-1be4-4f99-9ced-e5117e3b733c None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:47:54.576032 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-36883b00-1be4-4f99-9ced-e5117e3b733c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:54.650333 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 681/1342] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:47:54.690996 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45313b6-1762-4c35-b7b2-2e52bd621ef4 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:47:54.701724 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45313b6-1762-4c35-b7b2-2e52bd621ef4 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:47:54.705207 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964beac-7d8d-499a-a14f-da3926316d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:47:54.705841 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964beac-7d8d-499a-a14f-da3926316d37 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:54.706120 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964beac-7d8d-499a-a14f-da3926316d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:54.706395 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964beac-7d8d-499a-a14f-da3926316d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:54.716289 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964beac-7d8d-499a-a14f-da3926316d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:47:54.717754 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964beac-7d8d-499a-a14f-da3926316d37 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:47:54.727181 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 662/1343] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:47:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:47:57.973702 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7436e4a-8dc7-486d-be0a-8d3acec75dbd None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:57.973702 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7436e4a-8dc7-486d-be0a-8d3acec75dbd None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:57.973702 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7436e4a-8dc7-486d-be0a-8d3acec75dbd None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:57.974398 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 682/1344] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:47:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:47:57.980514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f72064-21c2-41b1-bf18-ef8a9770b3d3 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:57.981296 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f72064-21c2-41b1-bf18-ef8a9770b3d3 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:57.981572 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f72064-21c2-41b1-bf18-ef8a9770b3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:58.009718 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-20f72064-21c2-41b1-bf18-ef8a9770b3d3 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:47:58.011364 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-20f72064-21c2-41b1-bf18-ef8a9770b3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:47:58.032531 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 663/1345] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:47:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:47:58.070014 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7436e4a-8dc7-486d-be0a-8d3acec75dbd None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:47:58.080861 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7436e4a-8dc7-486d-be0a-8d3acec75dbd None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:47:58.084471 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a801337-be77-4554-ae47-386882a0f605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:47:58.085142 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a801337-be77-4554-ae47-386882a0f605 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:47:58.085470 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a801337-be77-4554-ae47-386882a0f605 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:47:58.085752 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a801337-be77-4554-ae47-386882a0f605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:47:58.096350 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a801337-be77-4554-ae47-386882a0f605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:47:58.097866 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a801337-be77-4554-ae47-386882a0f605 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:47:58.108495 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 683/1346] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:47:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:48:02.749663 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646f9ee-44a8-44d0-afa7-163ad92ceb7b None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:02.750199 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646f9ee-44a8-44d0-afa7-163ad92ceb7b None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:02.750199 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646f9ee-44a8-44d0-afa7-163ad92ceb7b None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:02.751642 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 664/1347] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:02.756757 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb864a3-85bf-4c90-a74c-7c8906a05d54 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:02.757149 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb864a3-85bf-4c90-a74c-7c8906a05d54 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:02.757429 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb864a3-85bf-4c90-a74c-7c8906a05d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:02.777096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-7cb864a3-85bf-4c90-a74c-7c8906a05d54 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:02.778283 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-7cb864a3-85bf-4c90-a74c-7c8906a05d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:02.786186 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 684/1348] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:02.825778 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646f9ee-44a8-44d0-afa7-163ad92ceb7b None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:48:02.836277 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646f9ee-44a8-44d0-afa7-163ad92ceb7b None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:48:02.840906 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba4a4a-d290-4841-9cb5-d941188a39ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:48:02.841543 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba4a4a-d290-4841-9cb5-d941188a39ba service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:02.841816 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba4a4a-d290-4841-9cb5-d941188a39ba service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:02.842091 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba4a4a-d290-4841-9cb5-d941188a39ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:02.851111 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba4a4a-d290-4841-9cb5-d941188a39ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:48:02.852538 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba4a4a-d290-4841-9cb5-d941188a39ba service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:48:02.862104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 665/1349] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:48:08.351139 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a2176-4197-4def-a547-d5cb5f499d99 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:08.351703 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a2176-4197-4def-a547-d5cb5f499d99 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:08.351919 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a2176-4197-4def-a547-d5cb5f499d99 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:08.353775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 685/1350] 10.222.0.52 () {54 vars in 921 bytes} [Thu Apr 14 21:48:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:08.358765 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513acd2-89b4-49f6-96f7-0fabd0f68c55 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:08.359598 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513acd2-89b4-49f6-96f7-0fabd0f68c55 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:08.360090 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513acd2-89b4-49f6-96f7-0fabd0f68c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:08.431112 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-4513acd2-89b4-49f6-96f7-0fabd0f68c55 None None] MFA Rules not processed for user `9e166c6b0e5542f7b912cbefa88bb5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:08.433322 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-4513acd2-89b4-49f6-96f7-0fabd0f68c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:08.511591 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 666/1351] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Apr 14 21:48:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:12.970452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2915b2-9422-4a24-be26-3703af3c970e None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:12.971299 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2915b2-9422-4a24-be26-3703af3c970e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:12.971754 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2915b2-9422-4a24-be26-3703af3c970e None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:12.973629 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 686/1352] 10.222.0.52 () {54 vars in 921 bytes} [Thu Apr 14 21:48:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:12.979023 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9de9e-a241-45b4-a716-19ef58c68d9e None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:12.979528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9de9e-a241-45b4-a716-19ef58c68d9e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:12.979641 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9de9e-a241-45b4-a716-19ef58c68d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:12.999020 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-44a9de9e-a241-45b4-a716-19ef58c68d9e None None] MFA Rules not processed for user `9e166c6b0e5542f7b912cbefa88bb5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:13.000237 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-44a9de9e-a241-45b4-a716-19ef58c68d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:13.010050 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 667/1353] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Apr 14 21:48:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:14.524010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e69f-734a-4187-bf7f-3cd34844f0ac None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:14.524549 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e69f-734a-4187-bf7f-3cd34844f0ac None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:14.524549 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e69f-734a-4187-bf7f-3cd34844f0ac None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:14.527983 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 687/1354] 10.222.0.52 () {54 vars in 921 bytes} [Thu Apr 14 21:48:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:14.533591 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec420922-8f26-47ee-a802-66369c0a1164 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:14.534075 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec420922-8f26-47ee-a802-66369c0a1164 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:14.534164 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec420922-8f26-47ee-a802-66369c0a1164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:14.552061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-ec420922-8f26-47ee-a802-66369c0a1164 None None] MFA Rules not processed for user `9e166c6b0e5542f7b912cbefa88bb5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:14.553302 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ec420922-8f26-47ee-a802-66369c0a1164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:14.562503 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 668/1355] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Apr 14 21:48:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:48:18.444490 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d44b0-d68f-48f4-892a-d4f5b427beda None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:18.447205 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d44b0-d68f-48f4-892a-d4f5b427beda None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:18.447205 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d44b0-d68f-48f4-892a-d4f5b427beda None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:18.452386 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 688/1356] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:48:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:18.453800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6623b-0d0a-4131-9589-009b96e94148 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:18.454235 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6623b-0d0a-4131-9589-009b96e94148 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:18.454373 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6623b-0d0a-4131-9589-009b96e94148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:18.476350 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-7cd6623b-0d0a-4131-9589-009b96e94148 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:18.478038 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-7cd6623b-0d0a-4131-9589-009b96e94148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:18.488520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 669/1357] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:18.539058 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155d2c2-300f-4b9a-9d33-ee361a009dd4 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:18.539363 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155d2c2-300f-4b9a-9d33-ee361a009dd4 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:18.539668 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155d2c2-300f-4b9a-9d33-ee361a009dd4 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:18.541577 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 689/1358] 10.222.0.52 () {54 vars in 960 bytes} [Thu Apr 14 21:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:18.547062 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ddafa-2540-4f9c-86e9-59de2d1f56e2 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:18.547608 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ddafa-2540-4f9c-86e9-59de2d1f56e2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:18.548087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ddafa-2540-4f9c-86e9-59de2d1f56e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:18.606828 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-c79ddafa-2540-4f9c-86e9-59de2d1f56e2 None None] MFA Rules not processed for user `e7f3ea629181433eb8c6d5dbc354c141`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:18.608173 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c79ddafa-2540-4f9c-86e9-59de2d1f56e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:18.694922 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 670/1359] 10.222.0.52 () {58 vars in 1057 bytes} [Thu Apr 14 21:48:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:48:18.703776 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155d2c2-300f-4b9a-9d33-ee361a009dd4 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:48:18.721882 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155d2c2-300f-4b9a-9d33-ee361a009dd4 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:48:18.728706 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede49763-5b59-4f6d-a822-9fb29c27c573 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:48:18.729775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede49763-5b59-4f6d-a822-9fb29c27c573 service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:18.730293 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede49763-5b59-4f6d-a822-9fb29c27c573 service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:18.730851 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede49763-5b59-4f6d-a822-9fb29c27c573 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:18.745427 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede49763-5b59-4f6d-a822-9fb29c27c573 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:48:18.747158 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede49763-5b59-4f6d-a822-9fb29c27c573 service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:48:18.757742 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 690/1360] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:48:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:48:21.386227 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf82b59-873a-4e22-aaa6-ca9584c726d2 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:21.386763 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf82b59-873a-4e22-aaa6-ca9584c726d2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:21.386763 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf82b59-873a-4e22-aaa6-ca9584c726d2 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:21.388108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 671/1361] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:21.393457 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dcd66-c087-472a-a647-55923b3bacb7 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:21.393932 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dcd66-c087-472a-a647-55923b3bacb7 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:21.394012 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dcd66-c087-472a-a647-55923b3bacb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:21.413595 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-5a5dcd66-c087-472a-a647-55923b3bacb7 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:21.414774 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-5a5dcd66-c087-472a-a647-55923b3bacb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:21.422821 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 691/1362] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:21.469061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf82b59-873a-4e22-aaa6-ca9584c726d2 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:48:21.483394 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf82b59-873a-4e22-aaa6-ca9584c726d2 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:48:21.489102 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7eaf1a-e248-4866-81a9-31425f9fc1d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:48:21.489852 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7eaf1a-e248-4866-81a9-31425f9fc1d3 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:21.490236 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7eaf1a-e248-4866-81a9-31425f9fc1d3 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:21.490633 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7eaf1a-e248-4866-81a9-31425f9fc1d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:21.498961 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7eaf1a-e248-4866-81a9-31425f9fc1d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:48:21.500673 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7eaf1a-e248-4866-81a9-31425f9fc1d3 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:48:21.512299 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 672/1363] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:48:24.307156 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df27e54-bebb-4681-9baf-e291ce47a8c3 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:24.307643 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df27e54-bebb-4681-9baf-e291ce47a8c3 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:24.307643 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df27e54-bebb-4681-9baf-e291ce47a8c3 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:24.309001 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 692/1364] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:24.314381 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c1788-7113-4b2d-ba68-44794669b711 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:24.314825 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c1788-7113-4b2d-ba68-44794669b711 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:24.314960 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c1788-7113-4b2d-ba68-44794669b711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:24.333441 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-937c1788-7113-4b2d-ba68-44794669b711 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:24.334631 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-937c1788-7113-4b2d-ba68-44794669b711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:24.342888 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 673/1365] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:24.390728 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c947e42-e5fc-489d-8114-24fc46ea7c42 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:24.391087 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c947e42-e5fc-489d-8114-24fc46ea7c42 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:24.391431 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c947e42-e5fc-489d-8114-24fc46ea7c42 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:24.392928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 693/1366] 10.222.0.52 () {54 vars in 960 bytes} [Thu Apr 14 21:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:24.398350 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb420087-f677-418c-bb4b-1a8d6639514a None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:24.398638 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb420087-f677-418c-bb4b-1a8d6639514a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:24.398937 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb420087-f677-418c-bb4b-1a8d6639514a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:24.417623 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-eb420087-f677-418c-bb4b-1a8d6639514a None None] MFA Rules not processed for user `e7f3ea629181433eb8c6d5dbc354c141`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:24.418927 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-eb420087-f677-418c-bb4b-1a8d6639514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:24.429668 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 674/1367] 10.222.0.52 () {58 vars in 1057 bytes} [Thu Apr 14 21:48:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:24.438569 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c947e42-e5fc-489d-8114-24fc46ea7c42 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:48:24.459671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c947e42-e5fc-489d-8114-24fc46ea7c42 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:48:24.466714 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512e213-5caf-4c58-8648-4730e7763768 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:48:24.467370 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e213-5caf-4c58-8648-4730e7763768 service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:24.467780 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e213-5caf-4c58-8648-4730e7763768 service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:24.468063 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e213-5caf-4c58-8648-4730e7763768 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:24.477826 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512e213-5caf-4c58-8648-4730e7763768 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:48:24.479668 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512e213-5caf-4c58-8648-4730e7763768 service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:48:24.490208 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 694/1368] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:48:26.903146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379816a-7b4b-4aca-a131-6d50de213c7f None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:26.903674 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379816a-7b4b-4aca-a131-6d50de213c7f None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:26.903674 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379816a-7b4b-4aca-a131-6d50de213c7f None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:26.905063 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 675/1369] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:26.910533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba34635-8fe5-4cdf-b307-3afe0ca1ca6e None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:26.911307 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba34635-8fe5-4cdf-b307-3afe0ca1ca6e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:26.911726 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba34635-8fe5-4cdf-b307-3afe0ca1ca6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:26.929778 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-cba34635-8fe5-4cdf-b307-3afe0ca1ca6e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:26.931610 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-cba34635-8fe5-4cdf-b307-3afe0ca1ca6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:26.939679 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 695/1370] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:48:27.044550 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f98561-6723-47e0-96e8-57355474ba29 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:27.045222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f98561-6723-47e0-96e8-57355474ba29 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:27.045719 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f98561-6723-47e0-96e8-57355474ba29 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:27.048108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 676/1371] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:48:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:27.052711 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10620d2-63fe-4bdf-a827-6ebeefcdd148 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:27.053254 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10620d2-63fe-4bdf-a827-6ebeefcdd148 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:27.053722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10620d2-63fe-4bdf-a827-6ebeefcdd148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:27.075091 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-f10620d2-63fe-4bdf-a827-6ebeefcdd148 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:27.076634 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f10620d2-63fe-4bdf-a827-6ebeefcdd148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:27.086309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 696/1372] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:27.134467 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f98561-6723-47e0-96e8-57355474ba29 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:48:27.149521 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f98561-6723-47e0-96e8-57355474ba29 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:48:27.155181 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b20900-d1c5-4fe2-adbc-0f689cbdb232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:48:27.155769 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b20900-d1c5-4fe2-adbc-0f689cbdb232 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:27.156049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b20900-d1c5-4fe2-adbc-0f689cbdb232 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:27.156325 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b20900-d1c5-4fe2-adbc-0f689cbdb232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:27.165772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b20900-d1c5-4fe2-adbc-0f689cbdb232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:48:27.167407 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b20900-d1c5-4fe2-adbc-0f689cbdb232 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:48:27.177683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 677/1373] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:48:27.234382 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8967dd8-4b31-4fd3-9ea4-67e0aef9335d None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:27.234675 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8967dd8-4b31-4fd3-9ea4-67e0aef9335d None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:27.237994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8967dd8-4b31-4fd3-9ea4-67e0aef9335d None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:27.237994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 697/1374] 10.222.0.52 () {54 vars in 962 bytes} [Thu Apr 14 21:48:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:27.241471 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7616a68-0f64-4c8f-8ca5-8706030b7cf7 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:27.241757 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7616a68-0f64-4c8f-8ca5-8706030b7cf7 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:27.242037 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7616a68-0f64-4c8f-8ca5-8706030b7cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:27.307557 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-c7616a68-0f64-4c8f-8ca5-8706030b7cf7 None None] MFA Rules not processed for user `f7f96ebcce204c729bf8e59d21dcc5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:27.308802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c7616a68-0f64-4c8f-8ca5-8706030b7cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:27.371338 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 678/1375] 10.222.0.52 () {58 vars in 1059 bytes} [Thu Apr 14 21:48:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:27.379264 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8967dd8-4b31-4fd3-9ea4-67e0aef9335d None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:48:27.394064 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8967dd8-4b31-4fd3-9ea4-67e0aef9335d None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:48:27.398042 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7a59a-9860-46e6-806b-d00afdf2eb7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:48:27.398726 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7a59a-9860-46e6-806b-d00afdf2eb7e service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:27.399048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7a59a-9860-46e6-806b-d00afdf2eb7e service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:27.399847 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7a59a-9860-46e6-806b-d00afdf2eb7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:27.410613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7a59a-9860-46e6-806b-d00afdf2eb7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:48:27.412013 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7a59a-9860-46e6-806b-d00afdf2eb7e service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:48:27.423648 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 698/1376] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:48:29.701109 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62e529-5448-41bc-a01b-cc8cd918f3bc None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:29.701661 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62e529-5448-41bc-a01b-cc8cd918f3bc None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:29.701661 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62e529-5448-41bc-a01b-cc8cd918f3bc None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:29.703312 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 679/1377] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:29.708407 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904f5fc-bd6b-42bf-850e-9a537918e467 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:29.708867 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904f5fc-bd6b-42bf-850e-9a537918e467 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:29.708975 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904f5fc-bd6b-42bf-850e-9a537918e467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:29.727710 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-b904f5fc-bd6b-42bf-850e-9a537918e467 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:29.728962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b904f5fc-bd6b-42bf-850e-9a537918e467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:29.737391 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 699/1378] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:29.783304 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62e529-5448-41bc-a01b-cc8cd918f3bc None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:48:29.797970 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62e529-5448-41bc-a01b-cc8cd918f3bc None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:48:29.803955 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e429d4-2668-4b96-8709-59b85fdce969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:48:29.804670 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e429d4-2668-4b96-8709-59b85fdce969 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:29.804949 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e429d4-2668-4b96-8709-59b85fdce969 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:29.805646 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e429d4-2668-4b96-8709-59b85fdce969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:29.814434 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e429d4-2668-4b96-8709-59b85fdce969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:48:29.816031 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e429d4-2668-4b96-8709-59b85fdce969 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:48:29.828121 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 680/1379] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:48:32.425179 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738479b-62fe-4087-8456-3511338f0bb0 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:32.426067 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738479b-62fe-4087-8456-3511338f0bb0 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:32.426501 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738479b-62fe-4087-8456-3511338f0bb0 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:32.428016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 700/1380] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:32.433590 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd6994-1521-4b97-8810-f9ffd3c0d1af None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:32.434020 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd6994-1521-4b97-8810-f9ffd3c0d1af None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:32.434123 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd6994-1521-4b97-8810-f9ffd3c0d1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:32.452005 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-87bd6994-1521-4b97-8810-f9ffd3c0d1af None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:32.453226 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-87bd6994-1521-4b97-8810-f9ffd3c0d1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:32.461973 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 681/1381] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:32.507973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738479b-62fe-4087-8456-3511338f0bb0 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:48:32.523078 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738479b-62fe-4087-8456-3511338f0bb0 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:48:32.529860 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5d574-802f-4f49-89d3-aabdfb98fae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:48:32.530525 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5d574-802f-4f49-89d3-aabdfb98fae7 service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:32.530807 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5d574-802f-4f49-89d3-aabdfb98fae7 service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:32.531082 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5d574-802f-4f49-89d3-aabdfb98fae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:32.540219 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5d574-802f-4f49-89d3-aabdfb98fae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:48:32.542022 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5d574-802f-4f49-89d3-aabdfb98fae7 service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:48:32.551711 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 701/1382] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:48:35.062448 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0ca4d-8ecb-42ce-89b9-bff676d1b202 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:35.063018 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0ca4d-8ecb-42ce-89b9-bff676d1b202 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:35.063018 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0ca4d-8ecb-42ce-89b9-bff676d1b202 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:35.064444 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 682/1383] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:35.070010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec1253-44df-411e-b0cc-675b0183fd5a None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:35.070995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec1253-44df-411e-b0cc-675b0183fd5a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:35.071625 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec1253-44df-411e-b0cc-675b0183fd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:35.091093 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-b0ec1253-44df-411e-b0cc-675b0183fd5a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:35.092279 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b0ec1253-44df-411e-b0cc-675b0183fd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:35.101440 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 702/1384] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:35.144353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0ca4d-8ecb-42ce-89b9-bff676d1b202 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:48:35.160899 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0ca4d-8ecb-42ce-89b9-bff676d1b202 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:48:35.167377 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998887f-4904-472a-9493-01a69ece85f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:48:35.168348 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998887f-4904-472a-9493-01a69ece85f6 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:35.168825 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998887f-4904-472a-9493-01a69ece85f6 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:35.169258 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998887f-4904-472a-9493-01a69ece85f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:35.179526 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998887f-4904-472a-9493-01a69ece85f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:48:35.182271 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998887f-4904-472a-9493-01a69ece85f6 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:48:35.194068 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 683/1385] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:48:37.556553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b51bbd-024d-4fdd-beb2-d1270b01c970 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:37.557332 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b51bbd-024d-4fdd-beb2-d1270b01c970 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:37.557332 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b51bbd-024d-4fdd-beb2-d1270b01c970 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:37.558494 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 703/1386] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:37.563758 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ba7fb-79b5-4f6e-8a9a-2a5ea508247e None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:37.564426 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ba7fb-79b5-4f6e-8a9a-2a5ea508247e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:37.564426 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ba7fb-79b5-4f6e-8a9a-2a5ea508247e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:37.587855 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-399ba7fb-79b5-4f6e-8a9a-2a5ea508247e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:37.590130 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-399ba7fb-79b5-4f6e-8a9a-2a5ea508247e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:37.603169 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 684/1387] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:37.648063 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b51bbd-024d-4fdd-beb2-d1270b01c970 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:48:37.677409 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b51bbd-024d-4fdd-beb2-d1270b01c970 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:48:37.686056 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973f527-31ec-42b0-b0e1-c1795bfb0611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:48:37.687048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973f527-31ec-42b0-b0e1-c1795bfb0611 service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:37.687551 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973f527-31ec-42b0-b0e1-c1795bfb0611 service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:37.687962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973f527-31ec-42b0-b0e1-c1795bfb0611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:37.700625 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973f527-31ec-42b0-b0e1-c1795bfb0611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:48:37.703065 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973f527-31ec-42b0-b0e1-c1795bfb0611 service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:48:37.719059 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 704/1388] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:48:40.628638 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e122f2-f0ab-4357-8871-0942ce71b5a2 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:40.629197 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e122f2-f0ab-4357-8871-0942ce71b5a2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:40.629197 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e122f2-f0ab-4357-8871-0942ce71b5a2 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:40.630575 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 685/1389] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:40.638095 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f045d47-0e2f-4f6c-992f-b1dbae1b4a83 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:40.638544 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f045d47-0e2f-4f6c-992f-b1dbae1b4a83 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:40.638832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f045d47-0e2f-4f6c-992f-b1dbae1b4a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:40.660599 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-0f045d47-0e2f-4f6c-992f-b1dbae1b4a83 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:40.661855 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-0f045d47-0e2f-4f6c-992f-b1dbae1b4a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:40.670455 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 705/1390] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:48:40.716210 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e122f2-f0ab-4357-8871-0942ce71b5a2 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:48:40.731115 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e122f2-f0ab-4357-8871-0942ce71b5a2 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:48:40.737003 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12246da-ada0-47b6-92b0-42a9befe70a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:48:40.737853 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12246da-ada0-47b6-92b0-42a9befe70a1 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:40.738134 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12246da-ada0-47b6-92b0-42a9befe70a1 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:40.738406 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12246da-ada0-47b6-92b0-42a9befe70a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:40.746792 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12246da-ada0-47b6-92b0-42a9befe70a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:48:40.748398 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12246da-ada0-47b6-92b0-42a9befe70a1 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:48:40.758345 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 686/1391] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:48:43.417842 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2549d5-7f2c-46aa-857e-6218fcb19cef None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:43.418452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2549d5-7f2c-46aa-857e-6218fcb19cef None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:43.418576 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2549d5-7f2c-46aa-857e-6218fcb19cef None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:43.419980 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 706/1392] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:43.425369 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d1bba-c356-4d79-b525-eee878bc0106 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:43.425803 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d1bba-c356-4d79-b525-eee878bc0106 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:43.425888 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d1bba-c356-4d79-b525-eee878bc0106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:43.450869 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-7b6d1bba-c356-4d79-b525-eee878bc0106 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:43.452046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-7b6d1bba-c356-4d79-b525-eee878bc0106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:43.459820 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 687/1393] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:43.505311 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2549d5-7f2c-46aa-857e-6218fcb19cef None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:48:43.519627 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2549d5-7f2c-46aa-857e-6218fcb19cef None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:48:43.525781 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd143dc7-8ee0-4dfa-bdd8-cda0657ba7fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:48:43.526416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd143dc7-8ee0-4dfa-bdd8-cda0657ba7fb service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:43.526695 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd143dc7-8ee0-4dfa-bdd8-cda0657ba7fb service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:43.526970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd143dc7-8ee0-4dfa-bdd8-cda0657ba7fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:43.535304 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd143dc7-8ee0-4dfa-bdd8-cda0657ba7fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:48:43.536970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd143dc7-8ee0-4dfa-bdd8-cda0657ba7fb service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:48:43.547587 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 707/1394] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:48:44.034249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bedf29-7a71-4d66-af1a-c505da758bf2 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:44.034450 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bedf29-7a71-4d66-af1a-c505da758bf2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:44.034732 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bedf29-7a71-4d66-af1a-c505da758bf2 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:44.036139 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 688/1395] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:44.044147 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36f1a3-4dc1-4b46-83d9-10b911fa832d None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:44.044443 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36f1a3-4dc1-4b46-83d9-10b911fa832d None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:44.044754 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36f1a3-4dc1-4b46-83d9-10b911fa832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:44.062715 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-7a36f1a3-4dc1-4b46-83d9-10b911fa832d None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:44.063898 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-7a36f1a3-4dc1-4b46-83d9-10b911fa832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:44.072633 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 708/1396] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:44.130692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617f67c-c583-4ced-8c24-01d2a9f11484 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:44.130982 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617f67c-c583-4ced-8c24-01d2a9f11484 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:44.131263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617f67c-c583-4ced-8c24-01d2a9f11484 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:44.133190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 689/1397] 10.222.0.52 () {54 vars in 961 bytes} [Thu Apr 14 21:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:44.138216 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5be06c-e8a7-47b4-886f-98ba7144637d None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:44.138504 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5be06c-e8a7-47b4-886f-98ba7144637d None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:44.138782 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5be06c-e8a7-47b4-886f-98ba7144637d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:44.185701 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-bc5be06c-e8a7-47b4-886f-98ba7144637d None None] MFA Rules not processed for user `3d261ec6e42f4be08c4d584fd3d00850`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:44.186925 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-bc5be06c-e8a7-47b4-886f-98ba7144637d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:44.248050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 709/1398] 10.222.0.52 () {58 vars in 1058 bytes} [Thu Apr 14 21:48:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:44.255658 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617f67c-c583-4ced-8c24-01d2a9f11484 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:48:44.266803 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617f67c-c583-4ced-8c24-01d2a9f11484 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:48:44.270294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34f2fc-2d84-4c17-b806-3e747ae6423b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d261ec6e42f4be08c4d584fd3d00850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:48:44.270915 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34f2fc-2d84-4c17-b806-3e747ae6423b service glance] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:44.271191 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34f2fc-2d84-4c17-b806-3e747ae6423b service glance] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:44.271459 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34f2fc-2d84-4c17-b806-3e747ae6423b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:44.280091 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34f2fc-2d84-4c17-b806-3e747ae6423b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:48:44.281531 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34f2fc-2d84-4c17-b806-3e747ae6423b service glance] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:48:44.290640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 690/1399] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:48:44.858745 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5cdee-7748-4a32-baf6-a319674b767b None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:44.859239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5cdee-7748-4a32-baf6-a319674b767b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:44.859355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5cdee-7748-4a32-baf6-a319674b767b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:44.908884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-bda5cdee-7748-4a32-baf6-a319674b767b None None] MFA Rules not processed for user `1144e9036d0b4bafb30995ff1a8449ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:44.910077 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-bda5cdee-7748-4a32-baf6-a319674b767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:44.973886 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 710/1400] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Apr 14 21:48:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:45.014892 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12ad64-0330-428d-a332-bda28e17ae03 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:45.015345 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12ad64-0330-428d-a332-bda28e17ae03 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:45.019149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12ad64-0330-428d-a332-bda28e17ae03 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:45.019149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 691/1401] 10.222.0.52 () {54 vars in 942 bytes} [Thu Apr 14 21:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:45.022665 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592dd4-f460-45b2-87e6-d4d94ee1e89e None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:45.023469 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592dd4-f460-45b2-87e6-d4d94ee1e89e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:45.023759 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592dd4-f460-45b2-87e6-d4d94ee1e89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:45.072259 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-48592dd4-f460-45b2-87e6-d4d94ee1e89e None None] MFA Rules not processed for user `360bf55488d046c4be98a903d113c0fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:45.073504 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-48592dd4-f460-45b2-87e6-d4d94ee1e89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:45.143954 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 711/1402] 10.222.0.52 () {58 vars in 1039 bytes} [Thu Apr 14 21:48:45 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:45.153440 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12ad64-0330-428d-a332-bda28e17ae03 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:48:45.166966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12ad64-0330-428d-a332-bda28e17ae03 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:48:45.171717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a1832-02a3-49ad-add2-5bd117844685 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bf55488d046c4be98a903d113c0fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:48:45.172352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a1832-02a3-49ad-add2-5bd117844685 service swift] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:45.172662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a1832-02a3-49ad-add2-5bd117844685 service swift] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:45.172936 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a1832-02a3-49ad-add2-5bd117844685 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:45.180937 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a1832-02a3-49ad-add2-5bd117844685 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:48:45.182504 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a1832-02a3-49ad-add2-5bd117844685 service swift] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:48:45.190377 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 692/1403] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Apr 14 21:48:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 14 21:48:46.068936 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca7504-207f-4e02-a86e-eb8701390ab0 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:46.069798 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca7504-207f-4e02-a86e-eb8701390ab0 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:46.070216 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca7504-207f-4e02-a86e-eb8701390ab0 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:46.072188 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 712/1404] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:48:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:46.077312 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b43e9-b4a4-4a28-b86e-3789f60570c2 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:46.077786 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b43e9-b4a4-4a28-b86e-3789f60570c2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:46.077884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b43e9-b4a4-4a28-b86e-3789f60570c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:46.097673 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-bc0b43e9-b4a4-4a28-b86e-3789f60570c2 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:46.098950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-bc0b43e9-b4a4-4a28-b86e-3789f60570c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:46.111055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 693/1405] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:46.157612 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca7504-207f-4e02-a86e-eb8701390ab0 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:48:46.175933 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca7504-207f-4e02-a86e-eb8701390ab0 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:48:46.181630 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bce18-fed3-4848-95ad-1723bb0f61af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:48:46.182359 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bce18-fed3-4848-95ad-1723bb0f61af service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:46.182710 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bce18-fed3-4848-95ad-1723bb0f61af service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:46.183051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bce18-fed3-4848-95ad-1723bb0f61af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:46.191670 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bce18-fed3-4848-95ad-1723bb0f61af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:48:46.193389 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bce18-fed3-4848-95ad-1723bb0f61af service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:48:46.204241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 713/1406] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:48:48.677974 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cc01d-bb18-4c50-9147-a98e8ec6ce02 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:48.678841 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cc01d-bb18-4c50-9147-a98e8ec6ce02 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:48.679953 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cc01d-bb18-4c50-9147-a98e8ec6ce02 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:48.681583 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 694/1407] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:48:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:48:48.686859 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18238415-2f3b-4c82-a727-2aacab468b03 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:48.687320 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18238415-2f3b-4c82-a727-2aacab468b03 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:48.687424 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18238415-2f3b-4c82-a727-2aacab468b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:48.705538 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-18238415-2f3b-4c82-a727-2aacab468b03 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:48:48.706744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-18238415-2f3b-4c82-a727-2aacab468b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:48:48.715859 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 714/1408] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:48:48.762463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cc01d-bb18-4c50-9147-a98e8ec6ce02 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:48:48.777982 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cc01d-bb18-4c50-9147-a98e8ec6ce02 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:48:48.783778 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef49968-878c-45ac-a033-9ee19d9b1c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:48:48.784418 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef49968-878c-45ac-a033-9ee19d9b1c3f service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:48:48.784736 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef49968-878c-45ac-a033-9ee19d9b1c3f service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:48:48.785005 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef49968-878c-45ac-a033-9ee19d9b1c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:48:48.793678 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef49968-878c-45ac-a033-9ee19d9b1c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:48:48.795187 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef49968-878c-45ac-a033-9ee19d9b1c3f service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:48:48.805570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 695/1409] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:48:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:49:09.712760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c85759-781a-4f47-bc86-79fe72a2000f None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:09.713438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c85759-781a-4f47-bc86-79fe72a2000f None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:09.713438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c85759-781a-4f47-bc86-79fe72a2000f None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:09.714927 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 715/1410] 10.222.0.52 () {54 vars in 918 bytes} [Thu Apr 14 21:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:09.720179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847951ef-82e7-4df9-9a57-34ffb2028c4a None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:09.720664 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847951ef-82e7-4df9-9a57-34ffb2028c4a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:09.720774 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847951ef-82e7-4df9-9a57-34ffb2028c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:09.738462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-847951ef-82e7-4df9-9a57-34ffb2028c4a None None] MFA Rules not processed for user `9e166c6b0e5542f7b912cbefa88bb5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:09.739662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-847951ef-82e7-4df9-9a57-34ffb2028c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:09.748971 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 696/1411] 10.222.0.52 () {58 vars in 1015 bytes} [Thu Apr 14 21:49:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:49:09.763768 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd931871-c3da-46e4-9907-e2768eccf0f9 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:09.764050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd931871-c3da-46e4-9907-e2768eccf0f9 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:09.764322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd931871-c3da-46e4-9907-e2768eccf0f9 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:09.765728 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 716/1412] 10.222.0.52 () {54 vars in 918 bytes} [Thu Apr 14 21:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:09.770213 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449710af-76ba-4b85-9f8c-806edaa58f09 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:09.770488 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449710af-76ba-4b85-9f8c-806edaa58f09 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:09.770756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449710af-76ba-4b85-9f8c-806edaa58f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:09.788241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-449710af-76ba-4b85-9f8c-806edaa58f09 None None] MFA Rules not processed for user `e7f3ea629181433eb8c6d5dbc354c141`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:09.789441 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-449710af-76ba-4b85-9f8c-806edaa58f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:09.798355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 697/1413] 10.222.0.52 () {58 vars in 1015 bytes} [Thu Apr 14 21:49:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:49:12.566160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb2464-931e-4e93-937f-2e333052302a None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:12.566735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb2464-931e-4e93-937f-2e333052302a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:12.566735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb2464-931e-4e93-937f-2e333052302a None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:12.568104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 14 21:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:12.573852 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6d0ae-1248-4337-a004-402c6718a8b1 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:12.574314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6d0ae-1248-4337-a004-402c6718a8b1 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:12.574421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6d0ae-1248-4337-a004-402c6718a8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:12.592624 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-03d6d0ae-1248-4337-a004-402c6718a8b1 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:12.593812 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-03d6d0ae-1248-4337-a004-402c6718a8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:12.601712 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 14 21:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:49:12.644518 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb2464-931e-4e93-937f-2e333052302a None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:12.659512 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb2464-931e-4e93-937f-2e333052302a None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:12.665050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bdac6-6d6e-4e0a-a97b-4b8d7775c0e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:12.665675 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bdac6-6d6e-4e0a-a97b-4b8d7775c0e0 service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:12.665955 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bdac6-6d6e-4e0a-a97b-4b8d7775c0e0 service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:12.666248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bdac6-6d6e-4e0a-a97b-4b8d7775c0e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:12.674202 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bdac6-6d6e-4e0a-a97b-4b8d7775c0e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:12.675814 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bdac6-6d6e-4e0a-a97b-4b8d7775c0e0 service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:12.685201 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 718/1416] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:49:14.037997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cb0bd-3702-4e76-9b11-4aff075080a2 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:14.038523 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cb0bd-3702-4e76-9b11-4aff075080a2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:14.038523 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cb0bd-3702-4e76-9b11-4aff075080a2 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:14.039889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 14 21:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:14.044802 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77d808-f4bc-465d-bb00-f07e049fd7be None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:14.045238 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77d808-f4bc-465d-bb00-f07e049fd7be None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:14.045362 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77d808-f4bc-465d-bb00-f07e049fd7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:14.063115 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-9f77d808-f4bc-465d-bb00-f07e049fd7be None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:14.064299 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-9f77d808-f4bc-465d-bb00-f07e049fd7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:14.072610 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 14 21:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:49:14.263921 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cb0bd-3702-4e76-9b11-4aff075080a2 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:14.277928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cb0bd-3702-4e76-9b11-4aff075080a2 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:14.283244 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca243abd-2aa9-4bc4-8312-0a1d729571d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:14.283901 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243abd-2aa9-4bc4-8312-0a1d729571d4 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:14.284178 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243abd-2aa9-4bc4-8312-0a1d729571d4 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:14.284450 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243abd-2aa9-4bc4-8312-0a1d729571d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:14.292384 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca243abd-2aa9-4bc4-8312-0a1d729571d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:14.294000 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca243abd-2aa9-4bc4-8312-0a1d729571d4 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:14.303693 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 700/1419] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:49:15.616611 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4001fe0-09fa-4ae5-855a-f335f67f62f1 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:15.617174 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4001fe0-09fa-4ae5-855a-f335f67f62f1 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:15.617174 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4001fe0-09fa-4ae5-855a-f335f67f62f1 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:15.618531 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 14 21:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:15.623538 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002c284-3f4f-469b-9219-3f7105df27f3 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:15.623963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002c284-3f4f-469b-9219-3f7105df27f3 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:15.624092 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002c284-3f4f-469b-9219-3f7105df27f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:15.642166 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-5002c284-3f4f-469b-9219-3f7105df27f3 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:15.643355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5002c284-3f4f-469b-9219-3f7105df27f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:15.651895 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 14 21:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:49:15.800587 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4001fe0-09fa-4ae5-855a-f335f67f62f1 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:15.815227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4001fe0-09fa-4ae5-855a-f335f67f62f1 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:15.821227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2889a9-f9b0-4c74-ac91-82b7e99bc131 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:15.821854 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2889a9-f9b0-4c74-ac91-82b7e99bc131 service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:15.822134 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2889a9-f9b0-4c74-ac91-82b7e99bc131 service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:15.822410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2889a9-f9b0-4c74-ac91-82b7e99bc131 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:15.830412 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2889a9-f9b0-4c74-ac91-82b7e99bc131 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:15.831988 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2889a9-f9b0-4c74-ac91-82b7e99bc131 service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:15.841838 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 721/1422] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:49:17.139797 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5ea83-629e-4935-a75f-c47fe3c3fa46 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:17.140331 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5ea83-629e-4935-a75f-c47fe3c3fa46 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:17.140331 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5ea83-629e-4935-a75f-c47fe3c3fa46 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:17.141819 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 14 21:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:17.146881 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87634a5e-fbe9-48aa-afe1-2681f3e4c540 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:17.147298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87634a5e-fbe9-48aa-afe1-2681f3e4c540 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:17.147441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87634a5e-fbe9-48aa-afe1-2681f3e4c540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:17.165515 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-87634a5e-fbe9-48aa-afe1-2681f3e4c540 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:17.166707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-87634a5e-fbe9-48aa-afe1-2681f3e4c540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:17.174479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 14 21:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:49:17.325795 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5ea83-629e-4935-a75f-c47fe3c3fa46 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:17.341024 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5ea83-629e-4935-a75f-c47fe3c3fa46 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:17.346339 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d31f26-76a2-4aa6-b1ba-1e8cce259746 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:17.346966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d31f26-76a2-4aa6-b1ba-1e8cce259746 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:17.347246 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d31f26-76a2-4aa6-b1ba-1e8cce259746 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:17.347520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d31f26-76a2-4aa6-b1ba-1e8cce259746 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:17.356431 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d31f26-76a2-4aa6-b1ba-1e8cce259746 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:17.358067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d31f26-76a2-4aa6-b1ba-1e8cce259746 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:17.367741 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 703/1425] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:49:18.704291 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc21c6-c6a8-4951-8474-bdc2f8d01ac4 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:18.704995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc21c6-c6a8-4951-8474-bdc2f8d01ac4 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:18.704995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc21c6-c6a8-4951-8474-bdc2f8d01ac4 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:18.706246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 14 21:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:18.712245 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a571dc-8efd-45be-b285-eb8eb2fe30e4 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:18.712779 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a571dc-8efd-45be-b285-eb8eb2fe30e4 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:18.712875 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a571dc-8efd-45be-b285-eb8eb2fe30e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:18.732394 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-07a571dc-8efd-45be-b285-eb8eb2fe30e4 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:18.733956 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-07a571dc-8efd-45be-b285-eb8eb2fe30e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:18.745469 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 14 21:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:49:18.920606 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc21c6-c6a8-4951-8474-bdc2f8d01ac4 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:18.935621 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc21c6-c6a8-4951-8474-bdc2f8d01ac4 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:18.941111 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb0504-ba4e-4507-913a-da2e1b8ae5ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:18.941745 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb0504-ba4e-4507-913a-da2e1b8ae5ad service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:18.942024 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb0504-ba4e-4507-913a-da2e1b8ae5ad service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:18.942300 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb0504-ba4e-4507-913a-da2e1b8ae5ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:18.951612 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb0504-ba4e-4507-913a-da2e1b8ae5ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:18.953335 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb0504-ba4e-4507-913a-da2e1b8ae5ad service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:18.963574 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 724/1428] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:49:20.437565 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785a76d-0288-433b-a801-a51fae394d87 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:20.438185 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785a76d-0288-433b-a801-a51fae394d87 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:20.438185 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785a76d-0288-433b-a801-a51fae394d87 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:20.439455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 14 21:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:20.444548 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04236121-b3c7-4c7f-81d8-ffbb3b59aee3 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:20.445120 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04236121-b3c7-4c7f-81d8-ffbb3b59aee3 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:20.445120 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04236121-b3c7-4c7f-81d8-ffbb3b59aee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:20.463438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-04236121-b3c7-4c7f-81d8-ffbb3b59aee3 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:20.464920 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-04236121-b3c7-4c7f-81d8-ffbb3b59aee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:20.472644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 14 21:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:49:20.625088 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785a76d-0288-433b-a801-a51fae394d87 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:20.640072 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785a76d-0288-433b-a801-a51fae394d87 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:20.645475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef660d4b-af78-4ff4-8f63-7636df815969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:20.646721 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef660d4b-af78-4ff4-8f63-7636df815969 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:20.647004 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef660d4b-af78-4ff4-8f63-7636df815969 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:20.647279 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef660d4b-af78-4ff4-8f63-7636df815969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:20.655428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef660d4b-af78-4ff4-8f63-7636df815969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:20.657252 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef660d4b-af78-4ff4-8f63-7636df815969 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:20.667048 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 706/1431] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:49:22.000746 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ab12e-a95b-4482-a7e1-b2c9e3885c16 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:22.001209 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ab12e-a95b-4482-a7e1-b2c9e3885c16 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:22.001322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ab12e-a95b-4482-a7e1-b2c9e3885c16 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:22.002743 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 14 21:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:22.008603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bec74-7d39-4aa6-af93-d996802f5a8f None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:22.009038 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bec74-7d39-4aa6-af93-d996802f5a8f None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:22.009165 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bec74-7d39-4aa6-af93-d996802f5a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:22.027042 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-554bec74-7d39-4aa6-af93-d996802f5a8f None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:22.028222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-554bec74-7d39-4aa6-af93-d996802f5a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:22.035859 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 14 21:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:49:22.187816 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ab12e-a95b-4482-a7e1-b2c9e3885c16 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:22.202518 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ab12e-a95b-4482-a7e1-b2c9e3885c16 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:22.207926 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7d271-3e49-4be5-8abc-a63c7b1e19ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:22.208685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7d271-3e49-4be5-8abc-a63c7b1e19ba service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:22.209018 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7d271-3e49-4be5-8abc-a63c7b1e19ba service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:22.209356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7d271-3e49-4be5-8abc-a63c7b1e19ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:22.217501 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7d271-3e49-4be5-8abc-a63c7b1e19ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:22.219078 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7d271-3e49-4be5-8abc-a63c7b1e19ba service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:22.228973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 727/1434] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:49:23.548572 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0df01-6add-43ed-b547-7641dc54926d None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:23.549213 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0df01-6add-43ed-b547-7641dc54926d None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:23.549213 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0df01-6add-43ed-b547-7641dc54926d None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:23.550439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 14 21:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:23.556058 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24504c49-8e02-4b33-b99e-4c6a41f75f76 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:23.556468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24504c49-8e02-4b33-b99e-4c6a41f75f76 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:23.556625 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24504c49-8e02-4b33-b99e-4c6a41f75f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:23.575782 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-24504c49-8e02-4b33-b99e-4c6a41f75f76 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:23.577002 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-24504c49-8e02-4b33-b99e-4c6a41f75f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:23.585989 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 14 21:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:49:23.737079 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0df01-6add-43ed-b547-7641dc54926d None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:23.751467 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0df01-6add-43ed-b547-7641dc54926d None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:23.757764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0274f55-1eae-4f3c-869a-f64003ab1aeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:23.758397 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0274f55-1eae-4f3c-869a-f64003ab1aeb service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:23.758698 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0274f55-1eae-4f3c-869a-f64003ab1aeb service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:23.758956 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0274f55-1eae-4f3c-869a-f64003ab1aeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:23.766945 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0274f55-1eae-4f3c-869a-f64003ab1aeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:23.768518 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0274f55-1eae-4f3c-869a-f64003ab1aeb service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:23.778452 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 709/1437] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:49:25.092287 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199709d9-7bf2-4ade-8a06-6345a45534e4 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:25.092857 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199709d9-7bf2-4ade-8a06-6345a45534e4 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:25.092857 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199709d9-7bf2-4ade-8a06-6345a45534e4 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:25.094350 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 14 21:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:25.100183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfff61-1085-4ba7-b816-12e1d4a6a431 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:25.100628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfff61-1085-4ba7-b816-12e1d4a6a431 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:25.100759 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfff61-1085-4ba7-b816-12e1d4a6a431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:25.118911 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-03cfff61-1085-4ba7-b816-12e1d4a6a431 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:25.120092 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-03cfff61-1085-4ba7-b816-12e1d4a6a431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:25.127835 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 14 21:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:49:25.276914 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199709d9-7bf2-4ade-8a06-6345a45534e4 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:25.292059 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199709d9-7bf2-4ade-8a06-6345a45534e4 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:25.297520 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cd631-75a8-4e64-9b7f-a12ce8879ef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:25.298150 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cd631-75a8-4e64-9b7f-a12ce8879ef5 service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:25.298425 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cd631-75a8-4e64-9b7f-a12ce8879ef5 service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:25.298696 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cd631-75a8-4e64-9b7f-a12ce8879ef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:25.307558 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cd631-75a8-4e64-9b7f-a12ce8879ef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:25.309153 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cd631-75a8-4e64-9b7f-a12ce8879ef5 service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:25.318216 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 730/1440] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:49:27.519931 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f83a9d-d5ac-4676-82db-2c837d149e41 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:27.520462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f83a9d-d5ac-4676-82db-2c837d149e41 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:27.520462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f83a9d-d5ac-4676-82db-2c837d149e41 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:27.521802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 14 21:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:27.527700 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ef165-2673-435f-aa96-60ca57aa032e None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:27.528097 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ef165-2673-435f-aa96-60ca57aa032e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:27.528249 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ef165-2673-435f-aa96-60ca57aa032e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:27.545779 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-994ef165-2673-435f-aa96-60ca57aa032e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:27.546988 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-994ef165-2673-435f-aa96-60ca57aa032e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:27.554877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 14 21:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:49:27.595302 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f83a9d-d5ac-4676-82db-2c837d149e41 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:27.606039 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f83a9d-d5ac-4676-82db-2c837d149e41 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:27.609558 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60a13c-7221-44db-84de-ef40eb2a2746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:27.610192 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60a13c-7221-44db-84de-ef40eb2a2746 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:27.610475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60a13c-7221-44db-84de-ef40eb2a2746 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:27.610748 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60a13c-7221-44db-84de-ef40eb2a2746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:27.619697 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60a13c-7221-44db-84de-ef40eb2a2746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:27.621149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60a13c-7221-44db-84de-ef40eb2a2746 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:27.630369 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 712/1443] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:49:30.090130 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016739cc-bcd7-4575-8774-21e03fb6e8a9 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:30.090738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016739cc-bcd7-4575-8774-21e03fb6e8a9 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:30.090738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016739cc-bcd7-4575-8774-21e03fb6e8a9 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:30.092053 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 14 21:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:30.097409 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082331bb-7a3b-4422-9dbc-5e7ed47e651e None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:30.097854 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082331bb-7a3b-4422-9dbc-5e7ed47e651e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:30.097968 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082331bb-7a3b-4422-9dbc-5e7ed47e651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:30.115890 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-082331bb-7a3b-4422-9dbc-5e7ed47e651e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:30.117323 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-082331bb-7a3b-4422-9dbc-5e7ed47e651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:30.125048 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 14 21:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:49:30.164629 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016739cc-bcd7-4575-8774-21e03fb6e8a9 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:30.175204 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016739cc-bcd7-4575-8774-21e03fb6e8a9 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:30.178728 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29024f93-5b7e-4f24-bb9d-7d7036803ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:30.179355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29024f93-5b7e-4f24-bb9d-7d7036803ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:30.179639 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29024f93-5b7e-4f24-bb9d-7d7036803ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:30.179911 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29024f93-5b7e-4f24-bb9d-7d7036803ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:30.188606 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29024f93-5b7e-4f24-bb9d-7d7036803ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:30.190049 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29024f93-5b7e-4f24-bb9d-7d7036803ad3 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:30.199287 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 733/1446] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:49:32.835662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4c0af-f33c-496d-985f-adfbae35f13a None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:32.836234 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4c0af-f33c-496d-985f-adfbae35f13a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:32.836234 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4c0af-f33c-496d-985f-adfbae35f13a None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:32.837596 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 14 21:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:32.843003 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4ef33-346c-43e5-8fe3-9d4bf71a16e3 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:32.843443 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4ef33-346c-43e5-8fe3-9d4bf71a16e3 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:32.843551 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4ef33-346c-43e5-8fe3-9d4bf71a16e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:32.861458 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-46e4ef33-346c-43e5-8fe3-9d4bf71a16e3 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:32.862653 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-46e4ef33-346c-43e5-8fe3-9d4bf71a16e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:32.871637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 14 21:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:49:32.910857 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4c0af-f33c-496d-985f-adfbae35f13a None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:32.922183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4c0af-f33c-496d-985f-adfbae35f13a None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:32.925618 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfaa60-462b-4238-bfe2-43a808d45bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:32.926243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfaa60-462b-4238-bfe2-43a808d45bfc service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:32.926519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfaa60-462b-4238-bfe2-43a808d45bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:32.926789 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfaa60-462b-4238-bfe2-43a808d45bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:32.936527 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfaa60-462b-4238-bfe2-43a808d45bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:32.937957 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfaa60-462b-4238-bfe2-43a808d45bfc service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:32.947633 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 715/1449] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:49:35.351322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cb9e4-6b1a-4ac3-bc2a-c4247c4f399e None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:35.351872 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cb9e4-6b1a-4ac3-bc2a-c4247c4f399e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:35.351872 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cb9e4-6b1a-4ac3-bc2a-c4247c4f399e None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:35.353246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 14 21:49:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:35.358435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfafdf-59aa-4fa9-abf9-eed6d1dbb392 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:35.358878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfafdf-59aa-4fa9-abf9-eed6d1dbb392 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:35.358981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfafdf-59aa-4fa9-abf9-eed6d1dbb392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:35.376832 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-c0dfafdf-59aa-4fa9-abf9-eed6d1dbb392 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:35.378005 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c0dfafdf-59aa-4fa9-abf9-eed6d1dbb392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:35.386086 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 14 21:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:49:35.426505 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cb9e4-6b1a-4ac3-bc2a-c4247c4f399e None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:35.428406 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-3d2cb9e4-6b1a-4ac3-bc2a-c4247c4f399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:35.441064 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cb9e4-6b1a-4ac3-bc2a-c4247c4f399e None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:35.444600 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d64e6-a334-4d26-9be1-f0d7024f953d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:35.445236 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d64e6-a334-4d26-9be1-f0d7024f953d service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:35.445518 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d64e6-a334-4d26-9be1-f0d7024f953d service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:35.445796 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d64e6-a334-4d26-9be1-f0d7024f953d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:35.454504 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d64e6-a334-4d26-9be1-f0d7024f953d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:35.455929 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d64e6-a334-4d26-9be1-f0d7024f953d service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:35.466248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 736/1452] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:49:37.883586 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4c6fd-84d9-4b50-81d5-0373aec65493 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:37.884156 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4c6fd-84d9-4b50-81d5-0373aec65493 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:37.884156 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4c6fd-84d9-4b50-81d5-0373aec65493 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:37.885843 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 14 21:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:37.890971 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c08a17-8241-4a22-875a-f788f565c86b None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:37.891367 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c08a17-8241-4a22-875a-f788f565c86b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:37.891527 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c08a17-8241-4a22-875a-f788f565c86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:37.909317 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-52c08a17-8241-4a22-875a-f788f565c86b None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:37.910507 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-52c08a17-8241-4a22-875a-f788f565c86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:37.918876 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 14 21:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:49:37.957779 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4c6fd-84d9-4b50-81d5-0373aec65493 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:37.968973 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4c6fd-84d9-4b50-81d5-0373aec65493 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:37.972443 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69750606-123d-48d0-a623-5263dec603e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:37.973104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69750606-123d-48d0-a623-5263dec603e4 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:37.973380 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69750606-123d-48d0-a623-5263dec603e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:37.973649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69750606-123d-48d0-a623-5263dec603e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:37.982896 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69750606-123d-48d0-a623-5263dec603e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:37.984326 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69750606-123d-48d0-a623-5263dec603e4 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:37.993896 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 718/1455] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:49:40.456442 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272cf27-42b9-4856-a776-06bcf9d6e99e None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:40.457037 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272cf27-42b9-4856-a776-06bcf9d6e99e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:40.457144 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272cf27-42b9-4856-a776-06bcf9d6e99e None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:40.458505 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 14 21:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:40.464333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303830a0-a299-40ac-8ced-22699700607e None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:40.464800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303830a0-a299-40ac-8ced-22699700607e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:40.464908 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303830a0-a299-40ac-8ced-22699700607e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:40.482528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-303830a0-a299-40ac-8ced-22699700607e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:40.483723 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-303830a0-a299-40ac-8ced-22699700607e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:40.492265 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 14 21:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:49:40.531152 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272cf27-42b9-4856-a776-06bcf9d6e99e None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:40.541934 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272cf27-42b9-4856-a776-06bcf9d6e99e None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:40.545405 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8b3cd-5cf7-4597-a220-bd72f4cf85a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:40.546026 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8b3cd-5cf7-4597-a220-bd72f4cf85a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:40.546301 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8b3cd-5cf7-4597-a220-bd72f4cf85a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:40.546570 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8b3cd-5cf7-4597-a220-bd72f4cf85a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:40.556734 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8b3cd-5cf7-4597-a220-bd72f4cf85a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:40.558186 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8b3cd-5cf7-4597-a220-bd72f4cf85a4 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:40.567461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 739/1458] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:49:42.928684 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd957e50-d5f3-438c-a605-edf393a4c98a None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:42.929231 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd957e50-d5f3-438c-a605-edf393a4c98a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:42.929353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd957e50-d5f3-438c-a605-edf393a4c98a None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:42.930666 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 14 21:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:42.936101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421ca0c-e48d-4e1a-bf98-b7dc9850e9d6 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:42.936526 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421ca0c-e48d-4e1a-bf98-b7dc9850e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:42.936687 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421ca0c-e48d-4e1a-bf98-b7dc9850e9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:42.955749 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-e421ca0c-e48d-4e1a-bf98-b7dc9850e9d6 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:42.956986 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e421ca0c-e48d-4e1a-bf98-b7dc9850e9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:42.965230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 14 21:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:49:43.003607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd957e50-d5f3-438c-a605-edf393a4c98a None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:43.014589 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd957e50-d5f3-438c-a605-edf393a4c98a None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:43.018163 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cfd09-879f-4bdf-bd60-9d7078b2d1d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:43.018803 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cfd09-879f-4bdf-bd60-9d7078b2d1d4 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:43.019103 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cfd09-879f-4bdf-bd60-9d7078b2d1d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:43.019380 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cfd09-879f-4bdf-bd60-9d7078b2d1d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:43.028464 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938cfd09-879f-4bdf-bd60-9d7078b2d1d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:43.029914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938cfd09-879f-4bdf-bd60-9d7078b2d1d4 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:43.039240 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 721/1461] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:49:45.381146 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a850bd-c8c7-4d32-bdf1-56d653772074 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:45.381689 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a850bd-c8c7-4d32-bdf1-56d653772074 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:45.381689 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a850bd-c8c7-4d32-bdf1-56d653772074 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:45.383080 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 14 21:49:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:45.388550 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd3def-3e1a-4bd8-99fa-99cd1fb1f203 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:45.389001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd3def-3e1a-4bd8-99fa-99cd1fb1f203 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:45.389136 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd3def-3e1a-4bd8-99fa-99cd1fb1f203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:45.407209 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-65fd3def-3e1a-4bd8-99fa-99cd1fb1f203 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:45.408407 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-65fd3def-3e1a-4bd8-99fa-99cd1fb1f203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:45.416401 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 14 21:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:49:45.454218 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a850bd-c8c7-4d32-bdf1-56d653772074 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:45.465583 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a850bd-c8c7-4d32-bdf1-56d653772074 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:45.469001 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1280f-b14b-4fab-bfe9-5c6637b0df83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:45.469624 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1280f-b14b-4fab-bfe9-5c6637b0df83 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:45.469901 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1280f-b14b-4fab-bfe9-5c6637b0df83 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:45.470169 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1280f-b14b-4fab-bfe9-5c6637b0df83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:45.478968 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1280f-b14b-4fab-bfe9-5c6637b0df83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:45.480378 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1280f-b14b-4fab-bfe9-5c6637b0df83 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:45.489630 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 742/1464] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:49:47.810283 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a8c3f-51f3-4402-aa27-860f09923e11 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:47.810851 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a8c3f-51f3-4402-aa27-860f09923e11 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:47.810851 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a8c3f-51f3-4402-aa27-860f09923e11 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:47.812220 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 14 21:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:49:47.817380 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e83096-5f2b-44b4-a486-05be4d2b0b4f None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:47.818334 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e83096-5f2b-44b4-a486-05be4d2b0b4f None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:47.818492 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e83096-5f2b-44b4-a486-05be4d2b0b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:47.836364 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-35e83096-5f2b-44b4-a486-05be4d2b0b4f None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:47.837568 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-35e83096-5f2b-44b4-a486-05be4d2b0b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:47.845511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 14 21:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:49:47.882861 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a8c3f-51f3-4402-aa27-860f09923e11 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:47.893482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a8c3f-51f3-4402-aa27-860f09923e11 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:47.897679 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbea5d-63d3-49fd-a49a-21ef59ac9c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:47.898302 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbea5d-63d3-49fd-a49a-21ef59ac9c27 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:47.898579 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbea5d-63d3-49fd-a49a-21ef59ac9c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:47.898850 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbea5d-63d3-49fd-a49a-21ef59ac9c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:47.907440 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbea5d-63d3-49fd-a49a-21ef59ac9c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:47.908893 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbea5d-63d3-49fd-a49a-21ef59ac9c27 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:47.917955 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 724/1467] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:49:50.379887 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c71421-c4b8-4568-b58b-6903c5c4357f None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:50.380512 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c71421-c4b8-4568-b58b-6903c5c4357f None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:50.380656 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c71421-c4b8-4568-b58b-6903c5c4357f None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:50.382291 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 14 21:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:49:50.387685 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e613a2a-e7ae-489d-9e2c-c0b29c3f5c18 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:50.388118 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e613a2a-e7ae-489d-9e2c-c0b29c3f5c18 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:50.388226 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e613a2a-e7ae-489d-9e2c-c0b29c3f5c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:50.408321 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-7e613a2a-e7ae-489d-9e2c-c0b29c3f5c18 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:49:50.409703 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-7e613a2a-e7ae-489d-9e2c-c0b29c3f5c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:49:50.420110 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 14 21:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:49:50.459872 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c71421-c4b8-4568-b58b-6903c5c4357f None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:49:50.470757 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c71421-c4b8-4568-b58b-6903c5c4357f None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:49:50.475052 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62ee71-2fab-46ff-b64e-17a4cbdb57c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:49:50.475682 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62ee71-2fab-46ff-b64e-17a4cbdb57c4 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:49:50.475961 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62ee71-2fab-46ff-b64e-17a4cbdb57c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:49:50.476235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62ee71-2fab-46ff-b64e-17a4cbdb57c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:49:50.485182 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62ee71-2fab-46ff-b64e-17a4cbdb57c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:49:50.486618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62ee71-2fab-46ff-b64e-17a4cbdb57c4 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:49:50.495910 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 745/1470] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:50:24.335845 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27ddca-caa9-46de-a881-764979b93195 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:24.336416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27ddca-caa9-46de-a881-764979b93195 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:24.336416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27ddca-caa9-46de-a881-764979b93195 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:24.337782 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 726/1471] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:50:24.343334 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ce34-8fc0-4385-a4fc-30050dc3567b None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:24.343781 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ce34-8fc0-4385-a4fc-30050dc3567b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:24.343884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ce34-8fc0-4385-a4fc-30050dc3567b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:24.362241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-b4e2ce34-8fc0-4385-a4fc-30050dc3567b None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:50:24.363444 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b4e2ce34-8fc0-4385-a4fc-30050dc3567b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:50:24.371226 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 746/1472] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:50:24.418237 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d05af-5e67-4e88-afd0-2f22a312f4e0 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:24.418522 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d05af-5e67-4e88-afd0-2f22a312f4e0 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:24.418797 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d05af-5e67-4e88-afd0-2f22a312f4e0 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:24.420140 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 727/1473] 10.222.0.52 () {54 vars in 961 bytes} [Thu Apr 14 21:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:50:24.424914 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cecace-f1e4-4b4d-9f05-bbd372ff4d3e None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:24.425224 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cecace-f1e4-4b4d-9f05-bbd372ff4d3e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:24.425686 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cecace-f1e4-4b4d-9f05-bbd372ff4d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:24.443136 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-b9cecace-f1e4-4b4d-9f05-bbd372ff4d3e None None] MFA Rules not processed for user `3d261ec6e42f4be08c4d584fd3d00850`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:50:24.444306 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b9cecace-f1e4-4b4d-9f05-bbd372ff4d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:50:24.450621 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 747/1474] 10.222.0.52 () {58 vars in 1058 bytes} [Thu Apr 14 21:50:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:50:24.458167 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d05af-5e67-4e88-afd0-2f22a312f4e0 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:50:24.468711 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d05af-5e67-4e88-afd0-2f22a312f4e0 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:50:24.472772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b404ae4-e5f1-4428-9707-916370ca2a3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d261ec6e42f4be08c4d584fd3d00850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:50:24.473454 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b404ae4-e5f1-4428-9707-916370ca2a3d service glance] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:24.473729 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b404ae4-e5f1-4428-9707-916370ca2a3d service glance] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:24.473996 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b404ae4-e5f1-4428-9707-916370ca2a3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:24.482590 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b404ae4-e5f1-4428-9707-916370ca2a3d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:50:24.484003 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b404ae4-e5f1-4428-9707-916370ca2a3d service glance] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:50:24.493232 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 728/1475] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:50:26.882227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d203f-c310-46c5-b02e-9f1c3e6193c1 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:26.882882 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d203f-c310-46c5-b02e-9f1c3e6193c1 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:26.882882 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d203f-c310-46c5-b02e-9f1c3e6193c1 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:26.884157 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 748/1476] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:50:26.890070 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c05fdf-7368-44f9-a83d-09612a3d8004 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:26.890522 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c05fdf-7368-44f9-a83d-09612a3d8004 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:26.890630 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c05fdf-7368-44f9-a83d-09612a3d8004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:26.908679 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-b9c05fdf-7368-44f9-a83d-09612a3d8004 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:50:26.910517 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b9c05fdf-7368-44f9-a83d-09612a3d8004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:50:26.918278 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 729/1477] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:50:26.941669 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d203f-c310-46c5-b02e-9f1c3e6193c1 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:50:26.953967 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d203f-c310-46c5-b02e-9f1c3e6193c1 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:50:26.959197 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6e834-010e-4c30-85a6-f6ec4231cbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:50:26.959834 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6e834-010e-4c30-85a6-f6ec4231cbff admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:26.960113 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6e834-010e-4c30-85a6-f6ec4231cbff admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:26.960388 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6e834-010e-4c30-85a6-f6ec4231cbff admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:26.961155 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6e834-010e-4c30-85a6-f6ec4231cbff admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:50:26.963137 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING py.warnings [None req-9cf6e834-010e-4c30-85a6-f6ec4231cbff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 14 21:50:26.963137 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: warnings.warn(msg) Apr 14 21:50:26.963137 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: Apr 14 21:50:26.964281 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6e834-010e-4c30-85a6-f6ec4231cbff admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:50:26.983973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 749/1478] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Apr 14 21:50:26 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:50:29.317948 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1b5a3-f41a-4e23-8074-6bc1860cf70f None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:29.318405 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1b5a3-f41a-4e23-8074-6bc1860cf70f None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:29.318507 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1b5a3-f41a-4e23-8074-6bc1860cf70f None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:29.319855 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 730/1479] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:50:29.325170 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b3503-fb4f-4069-a467-ffe5ab1c5055 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:29.325604 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b3503-fb4f-4069-a467-ffe5ab1c5055 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:29.325756 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b3503-fb4f-4069-a467-ffe5ab1c5055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:29.344202 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-777b3503-fb4f-4069-a467-ffe5ab1c5055 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:50:29.345414 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-777b3503-fb4f-4069-a467-ffe5ab1c5055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:50:29.353248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 750/1480] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:50:29.394535 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1b5a3-f41a-4e23-8074-6bc1860cf70f None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:50:29.409182 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1b5a3-f41a-4e23-8074-6bc1860cf70f None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:50:29.414683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306962af-2b7b-424e-8faa-8c073c9dfd73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:50:29.415316 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306962af-2b7b-424e-8faa-8c073c9dfd73 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:29.415595 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306962af-2b7b-424e-8faa-8c073c9dfd73 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:29.415870 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306962af-2b7b-424e-8faa-8c073c9dfd73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:29.423760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306962af-2b7b-424e-8faa-8c073c9dfd73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:50:29.425412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306962af-2b7b-424e-8faa-8c073c9dfd73 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:50:29.434538 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 731/1481] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:50:31.910486 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c195c6-2408-4319-9d4e-5133de122565 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:31.911111 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c195c6-2408-4319-9d4e-5133de122565 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:31.911111 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c195c6-2408-4319-9d4e-5133de122565 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:31.912468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 751/1482] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:50:31.918081 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c800-5f9b-4504-8122-2dedd7100637 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:31.918541 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c800-5f9b-4504-8122-2dedd7100637 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:31.918650 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c800-5f9b-4504-8122-2dedd7100637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:31.936747 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-c927c800-5f9b-4504-8122-2dedd7100637 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:50:31.937936 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c927c800-5f9b-4504-8122-2dedd7100637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:50:31.946658 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 732/1483] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:50:31.984061 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c195c6-2408-4319-9d4e-5133de122565 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:50:31.993696 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c195c6-2408-4319-9d4e-5133de122565 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:50:31.997348 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31aeea-cefd-4136-af55-95fffae7ebde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:50:31.997976 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31aeea-cefd-4136-af55-95fffae7ebde service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:31.998255 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31aeea-cefd-4136-af55-95fffae7ebde service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:31.998524 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31aeea-cefd-4136-af55-95fffae7ebde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:32.007961 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31aeea-cefd-4136-af55-95fffae7ebde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:50:32.009432 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31aeea-cefd-4136-af55-95fffae7ebde service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:50:32.018696 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 752/1484] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:50:34.370673 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36590bb-dabf-4fa9-9223-09fa103be834 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:34.371224 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36590bb-dabf-4fa9-9223-09fa103be834 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:34.371224 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36590bb-dabf-4fa9-9223-09fa103be834 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:34.372627 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 733/1485] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:50:34.378560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dde169-cb99-41d2-8028-ed5a2496a28f None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:34.378969 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dde169-cb99-41d2-8028-ed5a2496a28f None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:34.379228 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dde169-cb99-41d2-8028-ed5a2496a28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:34.396495 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-23dde169-cb99-41d2-8028-ed5a2496a28f None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:50:34.397778 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-23dde169-cb99-41d2-8028-ed5a2496a28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:50:34.405616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 753/1486] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:50:34.444125 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36590bb-dabf-4fa9-9223-09fa103be834 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:50:34.454555 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36590bb-dabf-4fa9-9223-09fa103be834 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:50:34.458178 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95005445-a432-475f-bf7e-6ce8d29d2acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:50:34.458801 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95005445-a432-475f-bf7e-6ce8d29d2acf service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:34.459080 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95005445-a432-475f-bf7e-6ce8d29d2acf service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:34.459353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95005445-a432-475f-bf7e-6ce8d29d2acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:34.468279 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95005445-a432-475f-bf7e-6ce8d29d2acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:50:34.469849 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95005445-a432-475f-bf7e-6ce8d29d2acf service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:50:34.479556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 734/1487] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:50:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:50:36.925413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24a88b-1378-470b-a383-f138a9e34e9d None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:36.926014 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24a88b-1378-470b-a383-f138a9e34e9d None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:36.926113 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24a88b-1378-470b-a383-f138a9e34e9d None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:36.927573 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 754/1488] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:50:36.933015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe0da-c93e-4233-b617-9cd2f7c5b54d None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:36.933495 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe0da-c93e-4233-b617-9cd2f7c5b54d None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:36.933614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe0da-c93e-4233-b617-9cd2f7c5b54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:36.951758 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-b7bbe0da-c93e-4233-b617-9cd2f7c5b54d None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:50:36.952997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b7bbe0da-c93e-4233-b617-9cd2f7c5b54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:50:36.961701 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 735/1489] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:50:37.001295 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24a88b-1378-470b-a383-f138a9e34e9d None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:50:37.012673 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24a88b-1378-470b-a383-f138a9e34e9d None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:50:37.016126 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b612b-b878-45ae-bfae-e3c908fa3a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:50:37.016790 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b612b-b878-45ae-bfae-e3c908fa3a1c service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:37.017068 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b612b-b878-45ae-bfae-e3c908fa3a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:37.017360 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b612b-b878-45ae-bfae-e3c908fa3a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:37.027358 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b612b-b878-45ae-bfae-e3c908fa3a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:50:37.028845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b612b-b878-45ae-bfae-e3c908fa3a1c service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:50:37.038202 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 755/1490] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:50:39.769656 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc848b7-b824-474f-9277-5433001b7fd9 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:39.770234 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc848b7-b824-474f-9277-5433001b7fd9 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:39.770234 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc848b7-b824-474f-9277-5433001b7fd9 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:39.771568 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 736/1491] 10.222.0.52 () {54 vars in 926 bytes} [Thu Apr 14 21:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:50:39.776846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50983067-ce6b-4fb4-976d-0cfc2402b579 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:39.777267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50983067-ce6b-4fb4-976d-0cfc2402b579 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:39.777408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50983067-ce6b-4fb4-976d-0cfc2402b579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:39.795375 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-50983067-ce6b-4fb4-976d-0cfc2402b579 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:50:39.796565 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-50983067-ce6b-4fb4-976d-0cfc2402b579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:50:39.805051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 756/1492] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Apr 14 21:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:50:39.843037 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc848b7-b824-474f-9277-5433001b7fd9 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:50:39.854055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc848b7-b824-474f-9277-5433001b7fd9 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:50:39.857584 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741089e-77a0-463d-b6d6-df734623b49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:50:39.858215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741089e-77a0-463d-b6d6-df734623b49a service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:50:39.858496 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741089e-77a0-463d-b6d6-df734623b49a service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:50:39.858768 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741089e-77a0-463d-b6d6-df734623b49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:50:39.868459 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741089e-77a0-463d-b6d6-df734623b49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:50:39.869916 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741089e-77a0-463d-b6d6-df734623b49a service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:50:39.879112 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 737/1493] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:52:19.864620 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be28a48-7e17-4331-9907-56539d0135a2 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:52:19.865203 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be28a48-7e17-4331-9907-56539d0135a2 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:52:19.865203 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be28a48-7e17-4331-9907-56539d0135a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:52:19.884070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-2be28a48-7e17-4331-9907-56539d0135a2 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:52:19.885234 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-2be28a48-7e17-4331-9907-56539d0135a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:52:19.893720 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 757/1494] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:52:19.901740 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23aa47-1a4f-432a-8d04-dce4ff6038c8 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:52:19.902221 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23aa47-1a4f-432a-8d04-dce4ff6038c8 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:52:19.902301 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23aa47-1a4f-432a-8d04-dce4ff6038c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:52:19.920685 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-1c23aa47-1a4f-432a-8d04-dce4ff6038c8 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:52:19.921873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1c23aa47-1a4f-432a-8d04-dce4ff6038c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:52:19.929774 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 738/1495] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:52:19.934437 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be28a48-7e17-4331-9907-56539d0135a2 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:52:19.943985 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be28a48-7e17-4331-9907-56539d0135a2 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:52:19.948542 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02ab98-58d7-4a28-8fff-1a8d91dc1e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:52:19.949226 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02ab98-58d7-4a28-8fff-1a8d91dc1e86 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:52:19.950000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02ab98-58d7-4a28-8fff-1a8d91dc1e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:52:19.951168 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02ab98-58d7-4a28-8fff-1a8d91dc1e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:52:19.952031 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02ab98-58d7-4a28-8fff-1a8d91dc1e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:52:19.952341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02ab98-58d7-4a28-8fff-1a8d91dc1e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:52:19.953408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING py.warnings [None req-5e02ab98-58d7-4a28-8fff-1a8d91dc1e86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 21:52:19.953408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: warnings.warn(msg) Apr 14 21:52:19.953408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: Apr 14 21:52:19.954294 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02ab98-58d7-4a28-8fff-1a8d91dc1e86 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:52:19.966958 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 758/1496] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:52:19.974949 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23aa47-1a4f-432a-8d04-dce4ff6038c8 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:52:19.984335 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23aa47-1a4f-432a-8d04-dce4ff6038c8 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:52:19.989116 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ed3c4-4417-4df0-9a66-e9b247706895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:52:19.989786 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ed3c4-4417-4df0-9a66-e9b247706895 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:52:19.990069 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ed3c4-4417-4df0-9a66-e9b247706895 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:52:19.990342 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ed3c4-4417-4df0-9a66-e9b247706895 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:52:19.991043 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ed3c4-4417-4df0-9a66-e9b247706895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:52:19.992861 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING py.warnings [None req-564ed3c4-4417-4df0-9a66-e9b247706895 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 14 21:52:19.992861 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: warnings.warn(msg) Apr 14 21:52:19.992861 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: Apr 14 21:52:19.994088 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ed3c4-4417-4df0-9a66-e9b247706895 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:52:20.115201 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 739/1497] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:52:19 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:52:20.121830 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02ab98-58d7-4a28-8fff-1a8d91dc1e86 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:52:20.131874 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02ab98-58d7-4a28-8fff-1a8d91dc1e86 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:52:20.186995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be1f68-7e14-4e74-a650-532bc8b59b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:52:20.187580 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be1f68-7e14-4e74-a650-532bc8b59b14 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:52:20.187859 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be1f68-7e14-4e74-a650-532bc8b59b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:52:20.188130 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be1f68-7e14-4e74-a650-532bc8b59b14 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:52:20.188871 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be1f68-7e14-4e74-a650-532bc8b59b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:52:20.189876 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING py.warnings [None req-f1be1f68-7e14-4e74-a650-532bc8b59b14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 14 21:52:20.189876 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: warnings.warn(msg) Apr 14 21:52:20.189876 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: Apr 14 21:52:20.191077 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be1f68-7e14-4e74-a650-532bc8b59b14 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:52:20.273241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 759/1498] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:52:20 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:52:20.277439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ed3c4-4417-4df0-9a66-e9b247706895 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:52:20.287759 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ed3c4-4417-4df0-9a66-e9b247706895 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:52:20.292325 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58a61d-6851-4949-a9e0-ab185f00a4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:52:20.293009 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58a61d-6851-4949-a9e0-ab185f00a4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:52:20.293291 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58a61d-6851-4949-a9e0-ab185f00a4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:52:20.293610 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58a61d-6851-4949-a9e0-ab185f00a4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:52:20.294514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58a61d-6851-4949-a9e0-ab185f00a4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:52:20.295519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING py.warnings [None req-ba58a61d-6851-4949-a9e0-ab185f00a4f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 21:52:20.295519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: warnings.warn(msg) Apr 14 21:52:20.295519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: Apr 14 21:52:20.296398 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58a61d-6851-4949-a9e0-ab185f00a4f0 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:52:20.310018 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 740/1499] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:52:20.313936 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be1f68-7e14-4e74-a650-532bc8b59b14 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:52:20.323667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be1f68-7e14-4e74-a650-532bc8b59b14 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:52:20.328850 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18969326-e218-49cb-9b0f-7f7838066e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:52:20.329496 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18969326-e218-49cb-9b0f-7f7838066e8e admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:52:20.329777 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18969326-e218-49cb-9b0f-7f7838066e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:52:20.330047 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18969326-e218-49cb-9b0f-7f7838066e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:52:20.330873 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18969326-e218-49cb-9b0f-7f7838066e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:52:20.331880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING py.warnings [None req-18969326-e218-49cb-9b0f-7f7838066e8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 21:52:20.331880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: warnings.warn(msg) Apr 14 21:52:20.331880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: Apr 14 21:52:20.332778 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18969326-e218-49cb-9b0f-7f7838066e8e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:52:20.346127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 760/1500] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:52:20.350179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58a61d-6851-4949-a9e0-ab185f00a4f0 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:52:20.359912 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58a61d-6851-4949-a9e0-ab185f00a4f0 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:52:20.364430 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d5249-3ce3-4749-8ea6-bb1cf8f544d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:52:20.365343 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5249-3ce3-4749-8ea6-bb1cf8f544d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:52:20.365624 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5249-3ce3-4749-8ea6-bb1cf8f544d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:52:20.365898 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5249-3ce3-4749-8ea6-bb1cf8f544d0 admin admin] PATH_INFO: `/v3/projects/54cb03b849d04c9090efb94484ece45f/users/744150df971c481b8cfd3a88954ee613/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:52:20.380891 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d5249-3ce3-4749-8ea6-bb1cf8f544d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54cb03b849d04c9090efb94484ece45f, user_id=744150df971c481b8cfd3a88954ee613, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:52:20.381941 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING py.warnings [None req-d09d5249-3ce3-4749-8ea6-bb1cf8f544d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 14 21:52:20.381941 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: warnings.warn(msg) Apr 14 21:52:20.381941 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: Apr 14 21:52:20.383958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d5249-3ce3-4749-8ea6-bb1cf8f544d0 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:52:20.474081 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 741/1501] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:52:20 2022] PUT /identity/v3/projects/54cb03b849d04c9090efb94484ece45f/users/744150df971c481b8cfd3a88954ee613/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:52:20.485382 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5231fe7-2f8e-48c3-85aa-ff4079e51482 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:52:20.485669 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5231fe7-2f8e-48c3-85aa-ff4079e51482 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:52:20.485944 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5231fe7-2f8e-48c3-85aa-ff4079e51482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:52:20.513620 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-a5231fe7-2f8e-48c3-85aa-ff4079e51482 None None] MFA Rules not processed for user `744150df971c481b8cfd3a88954ee613`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:52:20.515554 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-a5231fe7-2f8e-48c3-85aa-ff4079e51482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:52:20.574021 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 761/1502] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:52:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:52:20.585756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d5249-3ce3-4749-8ea6-bb1cf8f544d0 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:52:20.652715 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d5249-3ce3-4749-8ea6-bb1cf8f544d0 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:52:20.658280 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137061c-1f2e-4341-8e29-c861c390a6dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:52:20.658915 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137061c-1f2e-4341-8e29-c861c390a6dc service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:52:20.659196 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137061c-1f2e-4341-8e29-c861c390a6dc service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:52:20.659474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137061c-1f2e-4341-8e29-c861c390a6dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:52:20.666984 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137061c-1f2e-4341-8e29-c861c390a6dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:52:20.669171 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137061c-1f2e-4341-8e29-c861c390a6dc service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:52:20.678040 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 742/1503] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:52:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:52:20.773001 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bfad5-0016-49a6-bdbe-03cf70730bec None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:52:20.773294 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bfad5-0016-49a6-bdbe-03cf70730bec None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:52:20.773572 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bfad5-0016-49a6-bdbe-03cf70730bec None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:52:20.774853 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 762/1504] 10.222.0.52 () {52 vars in 829 bytes} [Thu Apr 14 21:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:52:20.778558 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137061c-1f2e-4341-8e29-c861c390a6dc service nova] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:52:20.839046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137061c-1f2e-4341-8e29-c861c390a6dc service nova] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:52:20.843696 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15ac72-b7d6-4e9c-84df-d7365923f4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:52:20.844572 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15ac72-b7d6-4e9c-84df-d7365923f4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:52:20.844876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15ac72-b7d6-4e9c-84df-d7365923f4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:52:20.845147 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15ac72-b7d6-4e9c-84df-d7365923f4c8 admin admin] PATH_INFO: `/v3/users/744150df971c481b8cfd3a88954ee613` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:52:20.846309 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15ac72-b7d6-4e9c-84df-d7365923f4c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=744150df971c481b8cfd3a88954ee613)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:52:20.847318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING py.warnings [None req-2f15ac72-b7d6-4e9c-84df-d7365923f4c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 14 21:52:20.847318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: warnings.warn(msg) Apr 14 21:52:20.847318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: Apr 14 21:52:20.848515 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15ac72-b7d6-4e9c-84df-d7365923f4c8 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:52:21.025425 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-2f15ac72-b7d6-4e9c-84df-d7365923f4c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '744150df971c481b8cfd3a88954ee613'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:52:21.026118 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-2f15ac72-b7d6-4e9c-84df-d7365923f4c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '744150df971c481b8cfd3a88954ee613'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:52:21.045061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-2f15ac72-b7d6-4e9c-84df-d7365923f4c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '744150df971c481b8cfd3a88954ee613'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:52:21.058362 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-2f15ac72-b7d6-4e9c-84df-d7365923f4c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '744150df971c481b8cfd3a88954ee613'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:52:21.059178 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-2f15ac72-b7d6-4e9c-84df-d7365923f4c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '744150df971c481b8cfd3a88954ee613'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:52:21.176038 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 743/1505] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:52:20 2022] DELETE /identity/v3/users/744150df971c481b8cfd3a88954ee613 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:52:21.180432 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06610ee9-8215-4e67-828d-d882a7f66a28 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:52:21.181008 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06610ee9-8215-4e67-828d-d882a7f66a28 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:52:21.181008 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06610ee9-8215-4e67-828d-d882a7f66a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:52:21.199192 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-06610ee9-8215-4e67-828d-d882a7f66a28 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:52:21.200424 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-06610ee9-8215-4e67-828d-d882a7f66a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:52:21.257547 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 763/1506] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:52:21.267017 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15ac72-b7d6-4e9c-84df-d7365923f4c8 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:52:21.268392 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-2f15ac72-b7d6-4e9c-84df-d7365923f4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:52:21.324057 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15ac72-b7d6-4e9c-84df-d7365923f4c8 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:52:21.328416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c0e8b-d584-482e-83a0-766de6506985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:52:21.329088 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c0e8b-d584-482e-83a0-766de6506985 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:52:21.329366 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c0e8b-d584-482e-83a0-766de6506985 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:52:21.329634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c0e8b-d584-482e-83a0-766de6506985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:52:21.338648 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c0e8b-d584-482e-83a0-766de6506985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:52:21.340683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c0e8b-d584-482e-83a0-766de6506985 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:52:21.350166 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 744/1507] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:52:21.880488 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06610ee9-8215-4e67-828d-d882a7f66a28 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:52:21.881987 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-06610ee9-8215-4e67-828d-d882a7f66a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:52:21.895258 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06610ee9-8215-4e67-828d-d882a7f66a28 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:52:21.901880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d23e5-a479-4459-bb0f-5c571e473b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:52:21.903299 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d23e5-a479-4459-bb0f-5c571e473b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:52:21.903516 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d23e5-a479-4459-bb0f-5c571e473b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:52:21.903813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d23e5-a479-4459-bb0f-5c571e473b56 admin admin] PATH_INFO: `/v3/projects/54cb03b849d04c9090efb94484ece45f` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:52:21.905103 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d23e5-a479-4459-bb0f-5c571e473b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54cb03b849d04c9090efb94484ece45f)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:52:21.906143 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING py.warnings [None req-ab5d23e5-a479-4459-bb0f-5c571e473b56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 14 21:52:21.906143 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: warnings.warn(msg) Apr 14 21:52:21.906143 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: Apr 14 21:52:21.907333 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d23e5-a479-4459-bb0f-5c571e473b56 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:52:22.028604 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ab5d23e5-a479-4459-bb0f-5c571e473b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54cb03b849d04c9090efb94484ece45f', 'request_id': 'req-ab5d23e5-a479-4459-bb0f-5c571e473b56'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:52:22.082391 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ab5d23e5-a479-4459-bb0f-5c571e473b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54cb03b849d04c9090efb94484ece45f', 'request_id': 'req-ab5d23e5-a479-4459-bb0f-5c571e473b56'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:52:22.097390 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ab5d23e5-a479-4459-bb0f-5c571e473b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54cb03b849d04c9090efb94484ece45f', 'request_id': 'req-ab5d23e5-a479-4459-bb0f-5c571e473b56'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:52:22.108966 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ab5d23e5-a479-4459-bb0f-5c571e473b56 admin admin] The token cache is being invalidate because project 54cb03b849d04c9090efb94484ece45f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:52:22.109253 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ab5d23e5-a479-4459-bb0f-5c571e473b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:52:22.109932 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ab5d23e5-a479-4459-bb0f-5c571e473b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:52:22.111632 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 764/1508] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:52:21 2022] DELETE /identity/v3/projects/54cb03b849d04c9090efb94484ece45f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:54:03.093148 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ffb84-c881-4a61-975e-4ffd94322f59 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:03.093803 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ffb84-c881-4a61-975e-4ffd94322f59 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:03.093803 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ffb84-c881-4a61-975e-4ffd94322f59 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:03.095371 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 745/1509] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 14 21:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:54:03.102564 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9341e79-7e7a-44fd-b916-fb0ccaa6f2d5 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:03.103413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9341e79-7e7a-44fd-b916-fb0ccaa6f2d5 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:03.103590 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9341e79-7e7a-44fd-b916-fb0ccaa6f2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:03.140915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-e9341e79-7e7a-44fd-b916-fb0ccaa6f2d5 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:54:03.142963 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e9341e79-7e7a-44fd-b916-fb0ccaa6f2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:54:03.223322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 765/1510] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 14 21:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:54:03.389427 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ffb84-c881-4a61-975e-4ffd94322f59 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:54:03.391324 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-406ffb84-c881-4a61-975e-4ffd94322f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:54:03.497082 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ffb84-c881-4a61-975e-4ffd94322f59 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:54:03.506590 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540a4b9-b460-4fef-911d-27901d53c3eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:54:03.507755 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a4b9-b460-4fef-911d-27901d53c3eb service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:03.508355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a4b9-b460-4fef-911d-27901d53c3eb service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:03.508908 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a4b9-b460-4fef-911d-27901d53c3eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:03.525808 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540a4b9-b460-4fef-911d-27901d53c3eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:54:03.527738 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540a4b9-b460-4fef-911d-27901d53c3eb service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:54:03.539749 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 746/1511] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:54:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:54:04.925877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ff560-5376-4243-93ce-445cce4a324b None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:04.926438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ff560-5376-4243-93ce-445cce4a324b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:04.926438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ff560-5376-4243-93ce-445cce4a324b None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:04.927792 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 766/1512] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 14 21:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:54:04.933387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e318c-cc80-434c-aa81-6cb415336965 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:04.933960 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e318c-cc80-434c-aa81-6cb415336965 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:04.933960 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e318c-cc80-434c-aa81-6cb415336965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:04.952256 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-e87e318c-cc80-434c-aa81-6cb415336965 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:54:04.953502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e87e318c-cc80-434c-aa81-6cb415336965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:54:04.962212 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 747/1513] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 14 21:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:54:05.080729 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400690dd-cb00-4f5a-b58a-94a2422e95a9 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:05.081014 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400690dd-cb00-4f5a-b58a-94a2422e95a9 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:05.081285 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400690dd-cb00-4f5a-b58a-94a2422e95a9 None None] PATH_INFO: `/v3` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:05.082593 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 767/1514] 10.222.0.81 () {54 vars in 925 bytes} [Thu Apr 14 21:54:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:54:05.089887 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92116b5-5635-4b2b-90a9-599b128973ff None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:05.090174 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92116b5-5635-4b2b-90a9-599b128973ff None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:05.090455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92116b5-5635-4b2b-90a9-599b128973ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:05.109685 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-f92116b5-5635-4b2b-90a9-599b128973ff None None] MFA Rules not processed for user `9e166c6b0e5542f7b912cbefa88bb5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:54:05.111088 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f92116b5-5635-4b2b-90a9-599b128973ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:54:05.119742 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400690dd-cb00-4f5a-b58a-94a2422e95a9 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:54:05.137328 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400690dd-cb00-4f5a-b58a-94a2422e95a9 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:54:05.151038 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58756f85-4b86-4170-989d-24091eaa5ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:54:05.151710 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58756f85-4b86-4170-989d-24091eaa5ec0 service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:05.152056 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58756f85-4b86-4170-989d-24091eaa5ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:05.152341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58756f85-4b86-4170-989d-24091eaa5ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:05.161562 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58756f85-4b86-4170-989d-24091eaa5ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:54:05.163195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58756f85-4b86-4170-989d-24091eaa5ec0 service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:54:05.173570 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 768/1515] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:54:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:54:05.188203 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 748/1516] 10.222.0.81 () {58 vars in 1015 bytes} [Thu Apr 14 21:54:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:54:09.577734 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09135e5c-f056-4944-b5e2-2a2615f3169d None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:09.578335 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09135e5c-f056-4944-b5e2-2a2615f3169d None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:09.578335 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09135e5c-f056-4944-b5e2-2a2615f3169d None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:09.579682 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 769/1517] 10.222.0.52 () {54 vars in 960 bytes} [Thu Apr 14 21:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:54:09.584927 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a19e3-bb23-4c36-ac82-3fe23f70ee10 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:09.591395 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a19e3-bb23-4c36-ac82-3fe23f70ee10 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:09.591395 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a19e3-bb23-4c36-ac82-3fe23f70ee10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:09.603532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-f94a19e3-bb23-4c36-ac82-3fe23f70ee10 None None] MFA Rules not processed for user `9e166c6b0e5542f7b912cbefa88bb5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:54:09.604762 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f94a19e3-bb23-4c36-ac82-3fe23f70ee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:54:09.613102 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 749/1518] 10.222.0.52 () {58 vars in 1057 bytes} [Thu Apr 14 21:54:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:54:09.621445 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09135e5c-f056-4944-b5e2-2a2615f3169d None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:54:09.635426 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09135e5c-f056-4944-b5e2-2a2615f3169d None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:54:09.640277 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349331ff-dfce-48af-83df-776d541e07be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e166c6b0e5542f7b912cbefa88bb5f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:54:09.640942 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349331ff-dfce-48af-83df-776d541e07be service placement] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:09.641222 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349331ff-dfce-48af-83df-776d541e07be service placement] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:09.641497 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349331ff-dfce-48af-83df-776d541e07be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:09.649714 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349331ff-dfce-48af-83df-776d541e07be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:54:09.651287 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349331ff-dfce-48af-83df-776d541e07be service placement] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:54:09.661041 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 770/1519] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:54:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:54:16.890505 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415e39-ec9e-4b49-9f2a-f2d69a7fa788 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:16.891094 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415e39-ec9e-4b49-9f2a-f2d69a7fa788 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:16.891094 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415e39-ec9e-4b49-9f2a-f2d69a7fa788 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:16.892419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 750/1520] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 14 21:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:54:16.897536 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896b6a5-8324-40cf-82f4-cfa99990791d None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:16.897964 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896b6a5-8324-40cf-82f4-cfa99990791d None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:16.898074 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896b6a5-8324-40cf-82f4-cfa99990791d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:16.917029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-4896b6a5-8324-40cf-82f4-cfa99990791d None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:54:16.918269 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-4896b6a5-8324-40cf-82f4-cfa99990791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:54:16.926381 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 771/1521] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 14 21:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:54:17.077694 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1415e39-ec9e-4b49-9f2a-f2d69a7fa788 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:54:17.092871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1415e39-ec9e-4b49-9f2a-f2d69a7fa788 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:54:17.098060 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8199f9-2cd6-419f-984b-f12fec43957b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:54:17.098693 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8199f9-2cd6-419f-984b-f12fec43957b service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:17.098970 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8199f9-2cd6-419f-984b-f12fec43957b service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:17.099243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8199f9-2cd6-419f-984b-f12fec43957b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:17.108087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8199f9-2cd6-419f-984b-f12fec43957b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:54:17.109763 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8199f9-2cd6-419f-984b-f12fec43957b service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:54:17.119423 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 751/1522] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:54:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:54:18.400081 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af0958-83e6-403f-b9cb-6c5b6513bcdc None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:18.400667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af0958-83e6-403f-b9cb-6c5b6513bcdc None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:18.400948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af0958-83e6-403f-b9cb-6c5b6513bcdc None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:18.402393 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 772/1523] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 14 21:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:54:18.407370 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563e1c6-cabf-4ea1-891f-33fcf90017cd None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:18.407835 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563e1c6-cabf-4ea1-891f-33fcf90017cd None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:18.407941 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563e1c6-cabf-4ea1-891f-33fcf90017cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:18.425638 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-2563e1c6-cabf-4ea1-891f-33fcf90017cd None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:54:18.426891 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-2563e1c6-cabf-4ea1-891f-33fcf90017cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:54:18.436993 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 752/1524] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 14 21:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:54:18.592816 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af0958-83e6-403f-b9cb-6c5b6513bcdc None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:54:18.607608 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af0958-83e6-403f-b9cb-6c5b6513bcdc None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:54:18.613436 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb4c34-ab9b-444e-b8ba-aff1ab9af6e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:54:18.614092 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb4c34-ab9b-444e-b8ba-aff1ab9af6e3 service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:18.614372 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb4c34-ab9b-444e-b8ba-aff1ab9af6e3 service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:18.614640 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb4c34-ab9b-444e-b8ba-aff1ab9af6e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:18.624179 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb4c34-ab9b-444e-b8ba-aff1ab9af6e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:54:18.625910 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb4c34-ab9b-444e-b8ba-aff1ab9af6e3 service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:54:18.635506 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 773/1525] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:54:23.195370 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f76b84-e6b5-4a96-afcb-ad2eed7d4bb8 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:23.195927 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f76b84-e6b5-4a96-afcb-ad2eed7d4bb8 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:23.195927 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f76b84-e6b5-4a96-afcb-ad2eed7d4bb8 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:23.197959 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 753/1526] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 14 21:54:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:54:23.203039 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8cd13-a1e0-4109-9c92-e46974b37d0c None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:23.203502 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8cd13-a1e0-4109-9c92-e46974b37d0c None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:23.203609 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8cd13-a1e0-4109-9c92-e46974b37d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:23.222292 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-1da8cd13-a1e0-4109-9c92-e46974b37d0c None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:54:23.223500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-1da8cd13-a1e0-4109-9c92-e46974b37d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:54:23.231256 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 774/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 14 21:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:54:23.268272 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f76b84-e6b5-4a96-afcb-ad2eed7d4bb8 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:54:23.269941 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c1f76b84-e6b5-4a96-afcb-ad2eed7d4bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:54:23.325928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f76b84-e6b5-4a96-afcb-ad2eed7d4bb8 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:54:23.329419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edf0ce-209c-4fe1-8b7c-c6f0262c4174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:54:23.330056 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edf0ce-209c-4fe1-8b7c-c6f0262c4174 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:23.330333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edf0ce-209c-4fe1-8b7c-c6f0262c4174 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:23.330601 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edf0ce-209c-4fe1-8b7c-c6f0262c4174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:23.340422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edf0ce-209c-4fe1-8b7c-c6f0262c4174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:54:23.341867 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edf0ce-209c-4fe1-8b7c-c6f0262c4174 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:54:23.351022 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 754/1528] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:54:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:54:25.781387 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de765c53-47da-4133-8cd6-f94ec5e3eff5 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:25.781928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de765c53-47da-4133-8cd6-f94ec5e3eff5 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:25.781928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de765c53-47da-4133-8cd6-f94ec5e3eff5 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:25.783241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 775/1529] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 14 21:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:54:25.788945 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027fc38-69d5-41b1-9207-50af0ff9f26a None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:25.789458 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027fc38-69d5-41b1-9207-50af0ff9f26a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:25.789564 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027fc38-69d5-41b1-9207-50af0ff9f26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:25.809518 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-2027fc38-69d5-41b1-9207-50af0ff9f26a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:54:25.810769 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-2027fc38-69d5-41b1-9207-50af0ff9f26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:54:25.819271 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 755/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 14 21:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:54:25.858124 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de765c53-47da-4133-8cd6-f94ec5e3eff5 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:54:25.860695 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-de765c53-47da-4133-8cd6-f94ec5e3eff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:54:25.873653 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de765c53-47da-4133-8cd6-f94ec5e3eff5 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:54:25.877171 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371079d-702d-4d3c-8527-55748169fed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:54:25.877803 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371079d-702d-4d3c-8527-55748169fed5 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:25.878081 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371079d-702d-4d3c-8527-55748169fed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:25.878357 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371079d-702d-4d3c-8527-55748169fed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:25.887301 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371079d-702d-4d3c-8527-55748169fed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:54:25.888758 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371079d-702d-4d3c-8527-55748169fed5 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:54:25.897978 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 776/1531] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:54:29.949203 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10d61-05ca-45e3-895b-bfecce640850 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:29.949805 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10d61-05ca-45e3-895b-bfecce640850 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:29.949805 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10d61-05ca-45e3-895b-bfecce640850 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:29.951092 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 756/1532] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 14 21:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:54:29.956417 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ebbdd-bf69-42fe-9e40-fb5b6961a3b7 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:29.956871 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ebbdd-bf69-42fe-9e40-fb5b6961a3b7 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:29.957011 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ebbdd-bf69-42fe-9e40-fb5b6961a3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:29.974975 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-d75ebbdd-bf69-42fe-9e40-fb5b6961a3b7 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:54:29.976178 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d75ebbdd-bf69-42fe-9e40-fb5b6961a3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:54:29.984821 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 777/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 14 21:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:54:30.263663 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b10d61-05ca-45e3-895b-bfecce640850 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:54:30.265432 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-89b10d61-05ca-45e3-895b-bfecce640850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:54:30.321037 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b10d61-05ca-45e3-895b-bfecce640850 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:54:30.324767 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c76899-8e27-4e93-b085-680065b1332e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:54:30.325409 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c76899-8e27-4e93-b085-680065b1332e service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:30.325688 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c76899-8e27-4e93-b085-680065b1332e service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:30.325960 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c76899-8e27-4e93-b085-680065b1332e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:30.334636 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c76899-8e27-4e93-b085-680065b1332e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:54:30.336319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c76899-8e27-4e93-b085-680065b1332e service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:54:30.346093 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 757/1534] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:54:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:54:32.729047 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30348d-2729-4f15-8d66-2e9488ee2a72 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:32.729618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30348d-2729-4f15-8d66-2e9488ee2a72 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:32.729618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30348d-2729-4f15-8d66-2e9488ee2a72 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:32.731026 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 778/1535] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 14 21:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:54:32.736458 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a2aef-e129-42a7-9a58-d30b6bcb5aa3 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:32.736946 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a2aef-e129-42a7-9a58-d30b6bcb5aa3 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:32.737041 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a2aef-e129-42a7-9a58-d30b6bcb5aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:32.782399 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-259a2aef-e129-42a7-9a58-d30b6bcb5aa3 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:54:32.782399 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-259a2aef-e129-42a7-9a58-d30b6bcb5aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:54:32.782399 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 758/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 14 21:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:54:33.042627 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab411d3-e730-4b42-bf35-948563707527 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:33.042627 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab411d3-e730-4b42-bf35-948563707527 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:33.042627 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab411d3-e730-4b42-bf35-948563707527 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:33.043836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 779/1537] 10.222.0.52 () {54 vars in 962 bytes} [Thu Apr 14 21:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:54:33.048641 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec666b2-8528-4566-9b54-592bdf9cca09 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:33.048927 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec666b2-8528-4566-9b54-592bdf9cca09 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:33.049204 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec666b2-8528-4566-9b54-592bdf9cca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:33.067046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-3ec666b2-8528-4566-9b54-592bdf9cca09 None None] MFA Rules not processed for user `f7f96ebcce204c729bf8e59d21dcc5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:54:33.068230 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-3ec666b2-8528-4566-9b54-592bdf9cca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:54:33.075310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 759/1538] 10.222.0.52 () {58 vars in 1059 bytes} [Thu Apr 14 21:54:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:54:33.084641 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab411d3-e730-4b42-bf35-948563707527 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:54:33.096267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab411d3-e730-4b42-bf35-948563707527 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:54:33.099752 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a497a5-91ec-4cf8-9f7f-ab4675c19dc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:54:33.100379 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a497a5-91ec-4cf8-9f7f-ab4675c19dc4 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:54:33.100688 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a497a5-91ec-4cf8-9f7f-ab4675c19dc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:54:33.100961 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a497a5-91ec-4cf8-9f7f-ab4675c19dc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:54:33.109972 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a497a5-91ec-4cf8-9f7f-ab4675c19dc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:54:33.111383 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a497a5-91ec-4cf8-9f7f-ab4675c19dc4 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:54:33.121029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 780/1539] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:56:04.695270 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae07cc-01f5-4be3-a984-b5e892c7a173 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:04.695983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae07cc-01f5-4be3-a984-b5e892c7a173 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:04.695983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae07cc-01f5-4be3-a984-b5e892c7a173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:04.723062 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-6cae07cc-01f5-4be3-a984-b5e892c7a173 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:04.724359 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-6cae07cc-01f5-4be3-a984-b5e892c7a173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:04.739567 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 760/1540] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:04.758985 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ccfdf-c5cc-458e-9342-1359b64cae21 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:04.759620 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ccfdf-c5cc-458e-9342-1359b64cae21 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:04.759620 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ccfdf-c5cc-458e-9342-1359b64cae21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:04.788517 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-ea2ccfdf-c5cc-458e-9342-1359b64cae21 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:04.789958 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ea2ccfdf-c5cc-458e-9342-1359b64cae21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:04.804663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 781/1541] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:04.810534 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae07cc-01f5-4be3-a984-b5e892c7a173 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:04.821267 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae07cc-01f5-4be3-a984-b5e892c7a173 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:04.832617 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839a0ea-ba58-4f34-b58b-7df3c83244ee None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:04.834376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839a0ea-ba58-4f34-b58b-7df3c83244ee None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:04.834376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839a0ea-ba58-4f34-b58b-7df3c83244ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:04.834697 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e031ec-e9fa-4014-99ba-60118258e966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:04.834697 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e031ec-e9fa-4014-99ba-60118258e966 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:04.834697 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e031ec-e9fa-4014-99ba-60118258e966 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:04.834945 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e031ec-e9fa-4014-99ba-60118258e966 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:04.835854 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e031ec-e9fa-4014-99ba-60118258e966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:04.836164 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e031ec-e9fa-4014-99ba-60118258e966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:04.837208 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING py.warnings [None req-66e031ec-e9fa-4014-99ba-60118258e966 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 14 21:56:04.837208 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: warnings.warn(msg) Apr 14 21:56:04.837208 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: Apr 14 21:56:04.838115 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e031ec-e9fa-4014-99ba-60118258e966 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:04.856391 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 761/1542] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:04.865662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e031ec-e9fa-4014-99ba-60118258e966 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:04.873851 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-5839a0ea-ba58-4f34-b58b-7df3c83244ee None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:04.878328 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-5839a0ea-ba58-4f34-b58b-7df3c83244ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:04.878447 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e031ec-e9fa-4014-99ba-60118258e966 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:04.892248 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f802592-5cb4-4da3-ab39-255a8e6d01ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:04.892488 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 782/1543] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:56:04.893364 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f802592-5cb4-4da3-ab39-255a8e6d01ef admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:04.893658 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f802592-5cb4-4da3-ab39-255a8e6d01ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:04.893940 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f802592-5cb4-4da3-ab39-255a8e6d01ef admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:04.894654 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f802592-5cb4-4da3-ab39-255a8e6d01ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:04.898206 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f802592-5cb4-4da3-ab39-255a8e6d01ef admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:04.904841 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953faab4-1351-45a7-afd0-c5f78e5efeff None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:04.905133 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953faab4-1351-45a7-afd0-c5f78e5efeff None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:04.905417 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953faab4-1351-45a7-afd0-c5f78e5efeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:04.949659 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-953faab4-1351-45a7-afd0-c5f78e5efeff None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:04.951084 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-953faab4-1351-45a7-afd0-c5f78e5efeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:04.968771 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 783/1544] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:56:04.976647 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953faab4-1351-45a7-afd0-c5f78e5efeff None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:04.995576 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953faab4-1351-45a7-afd0-c5f78e5efeff None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:05.010607 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc38f0b-dd2c-46d5-8fca-af05c4b360a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:05.012848 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc38f0b-dd2c-46d5-8fca-af05c4b360a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.012848 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc38f0b-dd2c-46d5-8fca-af05c4b360a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.012848 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc38f0b-dd2c-46d5-8fca-af05c4b360a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.012848 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc38f0b-dd2c-46d5-8fca-af05c4b360a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:05.012848 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc38f0b-dd2c-46d5-8fca-af05c4b360a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:05.014274 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc38f0b-dd2c-46d5-8fca-af05c4b360a2 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:05.022979 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 762/1545] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:04 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:56:05.028826 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f802592-5cb4-4da3-ab39-255a8e6d01ef admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:05.043331 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 784/1546] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:05.060487 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc38f0b-dd2c-46d5-8fca-af05c4b360a2 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:05.087352 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc38f0b-dd2c-46d5-8fca-af05c4b360a2 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:05.155118 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f802592-5cb4-4da3-ab39-255a8e6d01ef admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:05.170197 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab92c2-afa8-4675-9b4b-8f61a7e7d395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:05.170901 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab92c2-afa8-4675-9b4b-8f61a7e7d395 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.171184 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab92c2-afa8-4675-9b4b-8f61a7e7d395 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.171460 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab92c2-afa8-4675-9b4b-8f61a7e7d395 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.172154 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab92c2-afa8-4675-9b4b-8f61a7e7d395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:05.173221 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING py.warnings [None req-8cab92c2-afa8-4675-9b4b-8f61a7e7d395 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 14 21:56:05.173221 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: warnings.warn(msg) Apr 14 21:56:05.173221 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: Apr 14 21:56:05.175005 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab92c2-afa8-4675-9b4b-8f61a7e7d395 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:05.229199 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb8491-a014-4e7d-adfe-3ee8d163c4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:05.230027 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb8491-a014-4e7d-adfe-3ee8d163c4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.230317 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb8491-a014-4e7d-adfe-3ee8d163c4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.230737 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb8491-a014-4e7d-adfe-3ee8d163c4a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.232058 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb8491-a014-4e7d-adfe-3ee8d163c4a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:05.233909 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING py.warnings [None req-45fb8491-a014-4e7d-adfe-3ee8d163c4a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 14 21:56:05.233909 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: warnings.warn(msg) Apr 14 21:56:05.233909 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: Apr 14 21:56:05.235727 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb8491-a014-4e7d-adfe-3ee8d163c4a2 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:05.311971 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 763/1547] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:05 2022] POST /identity/v3/users => generated 290 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:05.313492 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d707c-e01b-4bf2-98e4-cd78e29f3489 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.313784 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d707c-e01b-4bf2-98e4-cd78e29f3489 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.314110 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d707c-e01b-4bf2-98e4-cd78e29f3489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.347298 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-f55d707c-e01b-4bf2-98e4-cd78e29f3489 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:05.348532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f55d707c-e01b-4bf2-98e4-cd78e29f3489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:05.362180 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 764/1548] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:05.363237 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d707c-e01b-4bf2-98e4-cd78e29f3489 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:05.377756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d707c-e01b-4bf2-98e4-cd78e29f3489 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:05.384851 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a488964-011d-4ed9-ab56-5074ae7656cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:05.387365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a488964-011d-4ed9-ab56-5074ae7656cc admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.387365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a488964-011d-4ed9-ab56-5074ae7656cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.387365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a488964-011d-4ed9-ab56-5074ae7656cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.387365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a488964-011d-4ed9-ab56-5074ae7656cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:05.390722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 785/1549] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:05 2022] POST /identity/v3/projects => generated 367 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:56:05.390876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a488964-011d-4ed9-ab56-5074ae7656cc admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:05.392050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7e17c-fc8b-41f2-8e78-5d9373d87251 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.392334 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7e17c-fc8b-41f2-8e78-5d9373d87251 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.392620 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7e17c-fc8b-41f2-8e78-5d9373d87251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.408746 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 765/1550] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:05.412623 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4b27d-d94d-4106-8641-dec3db900d44 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.412895 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4b27d-d94d-4106-8641-dec3db900d44 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.413238 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4b27d-d94d-4106-8641-dec3db900d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.420795 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-b5e7e17c-fc8b-41f2-8e78-5d9373d87251 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:05.422092 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b5e7e17c-fc8b-41f2-8e78-5d9373d87251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:05.439511 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-f0c4b27d-d94d-4106-8641-dec3db900d44 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:05.440762 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f0c4b27d-d94d-4106-8641-dec3db900d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:05.488256 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 786/1551] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:05.489152 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7e17c-fc8b-41f2-8e78-5d9373d87251 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:05.499132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7e17c-fc8b-41f2-8e78-5d9373d87251 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:05.503563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 766/1552] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:05.503970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cfe6d-4c58-4513-9312-0dd79105b3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:05.504405 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4b27d-d94d-4106-8641-dec3db900d44 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:05.504742 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cfe6d-4c58-4513-9312-0dd79105b3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.505030 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cfe6d-4c58-4513-9312-0dd79105b3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.505306 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cfe6d-4c58-4513-9312-0dd79105b3e9 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.506876 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cfe6d-4c58-4513-9312-0dd79105b3e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:05.508543 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cfe6d-4c58-4513-9312-0dd79105b3e9 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:05.515212 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4b27d-d94d-4106-8641-dec3db900d44 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:05.519755 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57587e1-bfbf-49b0-a930-1285f4bba169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:05.520419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57587e1-bfbf-49b0-a930-1285f4bba169 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.520722 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57587e1-bfbf-49b0-a930-1285f4bba169 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.521062 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57587e1-bfbf-49b0-a930-1285f4bba169 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.521927 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57587e1-bfbf-49b0-a930-1285f4bba169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:05.523503 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57587e1-bfbf-49b0-a930-1285f4bba169 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:05.533649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 767/1553] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:05.534930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed7de1-98cf-4dae-883c-68ec482e5422 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.535216 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed7de1-98cf-4dae-883c-68ec482e5422 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.535491 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed7de1-98cf-4dae-883c-68ec482e5422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.553636 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-67ed7de1-98cf-4dae-883c-68ec482e5422 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:05.554834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-67ed7de1-98cf-4dae-883c-68ec482e5422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:05.562964 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 768/1554] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:05.564156 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d999c7-3fb2-487f-8f50-0c523cd33447 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.564437 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d999c7-3fb2-487f-8f50-0c523cd33447 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.564742 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d999c7-3fb2-487f-8f50-0c523cd33447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.581214 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 787/1555] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:05 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:05.582797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0b7be-79b5-464d-9d74-4c60c96b22a4 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.583087 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0b7be-79b5-464d-9d74-4c60c96b22a4 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.583365 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0b7be-79b5-464d-9d74-4c60c96b22a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.586017 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-66d999c7-3fb2-487f-8f50-0c523cd33447 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:05.586233 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-66d999c7-3fb2-487f-8f50-0c523cd33447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:05.594440 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 769/1556] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:05.595819 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206a896-78a1-4f56-9901-198a1c03809c None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.596103 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206a896-78a1-4f56-9901-198a1c03809c None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.596375 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206a896-78a1-4f56-9901-198a1c03809c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.603284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-e6b0b7be-79b5-464d-9d74-4c60c96b22a4 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:05.604500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e6b0b7be-79b5-464d-9d74-4c60c96b22a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:05.612635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 788/1557] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:05.613483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0b7be-79b5-464d-9d74-4c60c96b22a4 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:05.619556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-8206a896-78a1-4f56-9901-198a1c03809c None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:05.619556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-8206a896-78a1-4f56-9901-198a1c03809c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:05.623841 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0b7be-79b5-464d-9d74-4c60c96b22a4 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:05.628870 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cd008-4997-4e22-b22d-dd6bdcbb0714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:05.629311 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 770/1558] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:05.629611 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cd008-4997-4e22-b22d-dd6bdcbb0714 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.630102 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cd008-4997-4e22-b22d-dd6bdcbb0714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.631058 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cd008-4997-4e22-b22d-dd6bdcbb0714 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.631179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d819a7-0e7a-47fb-94ce-db467c18b21e None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.632004 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cd008-4997-4e22-b22d-dd6bdcbb0714 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:05.632119 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d819a7-0e7a-47fb-94ce-db467c18b21e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.632352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d819a7-0e7a-47fb-94ce-db467c18b21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.632460 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cd008-4997-4e22-b22d-dd6bdcbb0714 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:05.634113 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cd008-4997-4e22-b22d-dd6bdcbb0714 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:05.646525 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 789/1559] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:05.647464 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cd008-4997-4e22-b22d-dd6bdcbb0714 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:05.652327 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-e4d819a7-0e7a-47fb-94ce-db467c18b21e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:05.653629 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e4d819a7-0e7a-47fb-94ce-db467c18b21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:05.657417 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cd008-4997-4e22-b22d-dd6bdcbb0714 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:05.661655 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 771/1560] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:05.662715 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632d9b8-b94f-4d6e-9679-ac9eca1ddc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:05.662957 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e051d-7a0a-4a39-b6c9-407aac6a8c82 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.663309 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e051d-7a0a-4a39-b6c9-407aac6a8c82 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.663652 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e051d-7a0a-4a39-b6c9-407aac6a8c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.669676 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632d9b8-b94f-4d6e-9679-ac9eca1ddc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.670286 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632d9b8-b94f-4d6e-9679-ac9eca1ddc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.670859 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632d9b8-b94f-4d6e-9679-ac9eca1ddc1e admin admin] PATH_INFO: `/v3/projects/34a0c2418f5346fbbb18e392ff11722a/users/bc2d1d7be96e486fb49aaecd71aebb6d/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.683821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-181e051d-7a0a-4a39-b6c9-407aac6a8c82 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:05.685113 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-181e051d-7a0a-4a39-b6c9-407aac6a8c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:05.690508 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632d9b8-b94f-4d6e-9679-ac9eca1ddc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a0c2418f5346fbbb18e392ff11722a, user_id=bc2d1d7be96e486fb49aaecd71aebb6d, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:05.691580 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING py.warnings [None req-c632d9b8-b94f-4d6e-9679-ac9eca1ddc1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 14 21:56:05.691580 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: warnings.warn(msg) Apr 14 21:56:05.691580 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: Apr 14 21:56:05.694377 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632d9b8-b94f-4d6e-9679-ac9eca1ddc1e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:05.695536 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 772/1561] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:05.696790 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e051d-7a0a-4a39-b6c9-407aac6a8c82 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:05.706903 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e051d-7a0a-4a39-b6c9-407aac6a8c82 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:05.712846 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2250d66-7ba6-4b92-b2f4-4918cbe1853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:05.713591 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2250d66-7ba6-4b92-b2f4-4918cbe1853e admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.713877 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2250d66-7ba6-4b92-b2f4-4918cbe1853e admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.714148 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2250d66-7ba6-4b92-b2f4-4918cbe1853e admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.714889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2250d66-7ba6-4b92-b2f4-4918cbe1853e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:05.716733 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2250d66-7ba6-4b92-b2f4-4918cbe1853e admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:05.729414 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 773/1562] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:05.731153 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731a05a-0698-4cf8-9eed-fb4c0618acb7 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.731443 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731a05a-0698-4cf8-9eed-fb4c0618acb7 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.731723 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731a05a-0698-4cf8-9eed-fb4c0618acb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.751363 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-b731a05a-0698-4cf8-9eed-fb4c0618acb7 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:05.752634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b731a05a-0698-4cf8-9eed-fb4c0618acb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:05.761248 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 774/1563] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:05.762610 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e034403-8036-4f5a-b355-a157a3820ee3 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.762894 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e034403-8036-4f5a-b355-a157a3820ee3 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.763174 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e034403-8036-4f5a-b355-a157a3820ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.773715 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 790/1564] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:05 2022] PUT /identity/v3/projects/34a0c2418f5346fbbb18e392ff11722a/users/bc2d1d7be96e486fb49aaecd71aebb6d/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:05.780889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06984a0-2520-4923-9a60-e61293f936f3 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.780889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06984a0-2520-4923-9a60-e61293f936f3 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.780889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06984a0-2520-4923-9a60-e61293f936f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.783999 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-1e034403-8036-4f5a-b355-a157a3820ee3 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:05.785265 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1e034403-8036-4f5a-b355-a157a3820ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:05.797674 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-a06984a0-2520-4923-9a60-e61293f936f3 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:05.799219 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-a06984a0-2520-4923-9a60-e61293f936f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:05.848990 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 775/1565] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:05.849821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e034403-8036-4f5a-b355-a157a3820ee3 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:05.858684 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e034403-8036-4f5a-b355-a157a3820ee3 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:05.863195 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855923ed-f7d1-4c63-b872-8974bb6fb928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:05.863824 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855923ed-f7d1-4c63-b872-8974bb6fb928 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.864103 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855923ed-f7d1-4c63-b872-8974bb6fb928 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.864376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855923ed-f7d1-4c63-b872-8974bb6fb928 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.864996 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 791/1566] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:05.865122 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855923ed-f7d1-4c63-b872-8974bb6fb928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:05.866242 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06984a0-2520-4923-9a60-e61293f936f3 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:05.867077 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855923ed-f7d1-4c63-b872-8974bb6fb928 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:05.875352 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06984a0-2520-4923-9a60-e61293f936f3 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:05.879945 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1287752-dd95-45f9-a8e5-34631bb2e073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:05.881452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1287752-dd95-45f9-a8e5-34631bb2e073 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.881782 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1287752-dd95-45f9-a8e5-34631bb2e073 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.882135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1287752-dd95-45f9-a8e5-34631bb2e073 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.882877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1287752-dd95-45f9-a8e5-34631bb2e073 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:05.883179 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1287752-dd95-45f9-a8e5-34631bb2e073 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:05.884895 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1287752-dd95-45f9-a8e5-34631bb2e073 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:05.896900 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 792/1567] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:05.900044 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1287752-dd95-45f9-a8e5-34631bb2e073 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:05.907847 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1287752-dd95-45f9-a8e5-34631bb2e073 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:05.912508 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199bd05-074a-4acd-a3b6-c6b1591cd505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:05.913192 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199bd05-074a-4acd-a3b6-c6b1591cd505 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.913472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199bd05-074a-4acd-a3b6-c6b1591cd505 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.913744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199bd05-074a-4acd-a3b6-c6b1591cd505 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.914491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199bd05-074a-4acd-a3b6-c6b1591cd505 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:05.914795 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199bd05-074a-4acd-a3b6-c6b1591cd505 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:05.917389 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199bd05-074a-4acd-a3b6-c6b1591cd505 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:05.932063 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 793/1568] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:05.932949 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199bd05-074a-4acd-a3b6-c6b1591cd505 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:05.944450 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199bd05-074a-4acd-a3b6-c6b1591cd505 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:05.950223 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427ac91-473c-43f6-b7e2-5e7af7558429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:05.953220 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427ac91-473c-43f6-b7e2-5e7af7558429 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.953220 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427ac91-473c-43f6-b7e2-5e7af7558429 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.953220 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427ac91-473c-43f6-b7e2-5e7af7558429 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.953220 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427ac91-473c-43f6-b7e2-5e7af7558429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:05.954679 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427ac91-473c-43f6-b7e2-5e7af7558429 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:05.968601 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 794/1569] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:05.973441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427ac91-473c-43f6-b7e2-5e7af7558429 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:05.983765 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427ac91-473c-43f6-b7e2-5e7af7558429 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:05.993312 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb976f4c-bbd4-4d74-b393-00babd34c837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:05.993480 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 776/1570] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:05 2022] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:05.993655 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb976f4c-bbd4-4d74-b393-00babd34c837 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.993655 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb976f4c-bbd4-4d74-b393-00babd34c837 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.993655 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb976f4c-bbd4-4d74-b393-00babd34c837 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.993916 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7182b10-d6dc-400e-8c68-380fb4dbac02 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:05.993916 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7182b10-d6dc-400e-8c68-380fb4dbac02 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:05.994095 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7182b10-d6dc-400e-8c68-380fb4dbac02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:05.994407 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb976f4c-bbd4-4d74-b393-00babd34c837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:05.994722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb976f4c-bbd4-4d74-b393-00babd34c837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:05.996436 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb976f4c-bbd4-4d74-b393-00babd34c837 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:06.013692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-b7182b10-d6dc-400e-8c68-380fb4dbac02 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:06.016878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b7182b10-d6dc-400e-8c68-380fb4dbac02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:06.016998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 795/1571] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:06.016998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb976f4c-bbd4-4d74-b393-00babd34c837 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:06.028622 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb976f4c-bbd4-4d74-b393-00babd34c837 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:06.075408 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 777/1572] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:06.076193 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7182b10-d6dc-400e-8c68-380fb4dbac02 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:06.086141 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7182b10-d6dc-400e-8c68-380fb4dbac02 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:06.088391 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94804e3-64ac-4613-a5f8-15e34c00dbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:06.089238 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94804e3-64ac-4613-a5f8-15e34c00dbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:06.089510 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94804e3-64ac-4613-a5f8-15e34c00dbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:06.089784 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94804e3-64ac-4613-a5f8-15e34c00dbc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:06.090533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94804e3-64ac-4613-a5f8-15e34c00dbc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:06.090866 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94804e3-64ac-4613-a5f8-15e34c00dbc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:06.092170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c0350-2af9-4ad7-9023-92efe8054f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:06.092775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94804e3-64ac-4613-a5f8-15e34c00dbc0 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:06.093243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c0350-2af9-4ad7-9023-92efe8054f29 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:06.093525 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c0350-2af9-4ad7-9023-92efe8054f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:06.093824 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c0350-2af9-4ad7-9023-92efe8054f29 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:06.094682 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c0350-2af9-4ad7-9023-92efe8054f29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:06.094994 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c0350-2af9-4ad7-9023-92efe8054f29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:06.096673 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c0350-2af9-4ad7-9023-92efe8054f29 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:06.104625 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 796/1573] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:06.105427 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94804e3-64ac-4613-a5f8-15e34c00dbc0 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:06.108870 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 778/1574] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:06.109822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c0350-2af9-4ad7-9023-92efe8054f29 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:06.117902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94804e3-64ac-4613-a5f8-15e34c00dbc0 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:06.121681 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c0350-2af9-4ad7-9023-92efe8054f29 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:06.125294 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be402ea5-125b-4113-91e7-7ce4c79c83bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:06.125294 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be402ea5-125b-4113-91e7-7ce4c79c83bd admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:06.125294 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be402ea5-125b-4113-91e7-7ce4c79c83bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:06.125294 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be402ea5-125b-4113-91e7-7ce4c79c83bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:06.125864 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb030811-15e4-457c-8702-461a7e40d96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:06.125973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be402ea5-125b-4113-91e7-7ce4c79c83bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:06.126070 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb030811-15e4-457c-8702-461a7e40d96d admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:06.126070 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb030811-15e4-457c-8702-461a7e40d96d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:06.126070 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb030811-15e4-457c-8702-461a7e40d96d admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:06.126628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb030811-15e4-457c-8702-461a7e40d96d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:06.127300 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be402ea5-125b-4113-91e7-7ce4c79c83bd admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:06.128489 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb030811-15e4-457c-8702-461a7e40d96d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:06.216915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 797/1575] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:06 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:06.217379 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be402ea5-125b-4113-91e7-7ce4c79c83bd admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:06.224251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 779/1576] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:06 2022] POST /identity/v3/projects => generated 393 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:06.224251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb030811-15e4-457c-8702-461a7e40d96d admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:06.281433 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be402ea5-125b-4113-91e7-7ce4c79c83bd admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:06.286032 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee21af-5bc6-4e46-a6fb-616d0af0a6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:06.286553 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb030811-15e4-457c-8702-461a7e40d96d admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:06.287019 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee21af-5bc6-4e46-a6fb-616d0af0a6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:06.287418 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee21af-5bc6-4e46-a6fb-616d0af0a6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:06.287693 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee21af-5bc6-4e46-a6fb-616d0af0a6c1 admin admin] PATH_INFO: `/v3/projects/8938ca108a2e4a33b97b4a6aac0bb279/users/2927bcaf59e74a15a6bf2a451e5560fd/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:06.291201 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de4cef-6443-4b92-b376-da6f3d838a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:06.291867 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de4cef-6443-4b92-b376-da6f3d838a34 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:06.292151 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de4cef-6443-4b92-b376-da6f3d838a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:06.292427 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de4cef-6443-4b92-b376-da6f3d838a34 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:06.293160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de4cef-6443-4b92-b376-da6f3d838a34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:06.295099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de4cef-6443-4b92-b376-da6f3d838a34 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:06.301810 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee21af-5bc6-4e46-a6fb-616d0af0a6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8938ca108a2e4a33b97b4a6aac0bb279, user_id=2927bcaf59e74a15a6bf2a451e5560fd, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:06.304984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee21af-5bc6-4e46-a6fb-616d0af0a6c1 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:06.393095 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 780/1577] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:06 2022] POST /identity/v3/users => generated 282 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:06.393095 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de4cef-6443-4b92-b376-da6f3d838a34 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:06.398511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 798/1578] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:06 2022] PUT /identity/v3/projects/8938ca108a2e4a33b97b4a6aac0bb279/users/2927bcaf59e74a15a6bf2a451e5560fd/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:06.399394 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee21af-5bc6-4e46-a6fb-616d0af0a6c1 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:06.410025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de4cef-6443-4b92-b376-da6f3d838a34 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:06.454127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee21af-5bc6-4e46-a6fb-616d0af0a6c1 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:06.457824 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89920cc7-ec50-4779-9732-b82ea4e1c7d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:06.458471 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89920cc7-ec50-4779-9732-b82ea4e1c7d5 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:06.458753 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89920cc7-ec50-4779-9732-b82ea4e1c7d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:06.459583 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89920cc7-ec50-4779-9732-b82ea4e1c7d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:06.466742 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693a65c-5824-4379-b75d-c1eb02156028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:06.467460 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693a65c-5824-4379-b75d-c1eb02156028 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:06.467744 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693a65c-5824-4379-b75d-c1eb02156028 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:06.468144 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693a65c-5824-4379-b75d-c1eb02156028 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:06.468879 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693a65c-5824-4379-b75d-c1eb02156028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:06.470832 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693a65c-5824-4379-b75d-c1eb02156028 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:06.518152 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89920cc7-ec50-4779-9732-b82ea4e1c7d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:06.519584 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89920cc7-ec50-4779-9732-b82ea4e1c7d5 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:06.530375 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 799/1579] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:06.531164 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89920cc7-ec50-4779-9732-b82ea4e1c7d5 service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:06.540750 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89920cc7-ec50-4779-9732-b82ea4e1c7d5 service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:06.545345 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1e3ab-aa70-47b6-a59d-001814373a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:06.545989 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1e3ab-aa70-47b6-a59d-001814373a7c admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:06.546284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1e3ab-aa70-47b6-a59d-001814373a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:06.546536 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1e3ab-aa70-47b6-a59d-001814373a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:06.547230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1e3ab-aa70-47b6-a59d-001814373a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:06.549217 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1e3ab-aa70-47b6-a59d-001814373a7c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:06.582364 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 781/1580] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:06 2022] POST /identity/v3/projects => generated 357 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:06.583328 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693a65c-5824-4379-b75d-c1eb02156028 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:06.646179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693a65c-5824-4379-b75d-c1eb02156028 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:06.651702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8741988-fd1d-4b4b-b2f6-83e3b8c00466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:06.656997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8741988-fd1d-4b4b-b2f6-83e3b8c00466 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:06.656997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8741988-fd1d-4b4b-b2f6-83e3b8c00466 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:06.656997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8741988-fd1d-4b4b-b2f6-83e3b8c00466 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:06.656997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8741988-fd1d-4b4b-b2f6-83e3b8c00466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:06.656997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8741988-fd1d-4b4b-b2f6-83e3b8c00466 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:06.657438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 800/1581] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:06 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:06.657438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1e3ab-aa70-47b6-a59d-001814373a7c admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:06.725980 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1e3ab-aa70-47b6-a59d-001814373a7c admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:06.730526 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db47eb-8f61-4e1a-95a4-a33bfeda66a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:06.731189 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db47eb-8f61-4e1a-95a4-a33bfeda66a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:06.731516 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db47eb-8f61-4e1a-95a4-a33bfeda66a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:06.731773 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db47eb-8f61-4e1a-95a4-a33bfeda66a8 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:06.732460 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db47eb-8f61-4e1a-95a4-a33bfeda66a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:06.734417 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db47eb-8f61-4e1a-95a4-a33bfeda66a8 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:06.737681 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 782/1582] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:06 2022] POST /identity/v3/projects => generated 389 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:06.737681 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8741988-fd1d-4b4b-b2f6-83e3b8c00466 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:06.796519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8741988-fd1d-4b4b-b2f6-83e3b8c00466 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:06.801547 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f3717-835b-43ae-bf43-90d2561a6e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:06.804640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f3717-835b-43ae-bf43-90d2561a6e86 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:06.804640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f3717-835b-43ae-bf43-90d2561a6e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:06.804640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f3717-835b-43ae-bf43-90d2561a6e86 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:06.804640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f3717-835b-43ae-bf43-90d2561a6e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:06.805744 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f3717-835b-43ae-bf43-90d2561a6e86 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:06.841007 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 801/1583] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:06 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:06.841007 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db47eb-8f61-4e1a-95a4-a33bfeda66a8 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:06.848024 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db47eb-8f61-4e1a-95a4-a33bfeda66a8 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:06.853305 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061eabdb-5d70-4b97-a2b3-91bab4b7e009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:06.853969 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eabdb-5d70-4b97-a2b3-91bab4b7e009 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:06.854248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eabdb-5d70-4b97-a2b3-91bab4b7e009 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:06.854518 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eabdb-5d70-4b97-a2b3-91bab4b7e009 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:06.855268 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061eabdb-5d70-4b97-a2b3-91bab4b7e009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:06.859147 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061eabdb-5d70-4b97-a2b3-91bab4b7e009 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:06.871714 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 802/1584] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:06.871714 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14355e-5475-40ed-ac45-9461192e6dc1 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:06.871714 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14355e-5475-40ed-ac45-9461192e6dc1 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:06.871714 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14355e-5475-40ed-ac45-9461192e6dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:06.897524 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-ef14355e-5475-40ed-ac45-9461192e6dc1 None None] MFA Rules not processed for user `2927bcaf59e74a15a6bf2a451e5560fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:06.899038 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ef14355e-5475-40ed-ac45-9461192e6dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:06.924656 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 783/1585] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:06 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:06.925497 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f3717-835b-43ae-bf43-90d2561a6e86 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:06.936136 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f3717-835b-43ae-bf43-90d2561a6e86 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:06.941651 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0eb32-29ca-48cb-98b6-a716f95b4825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:06.941651 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0eb32-29ca-48cb-98b6-a716f95b4825 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:06.942673 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0eb32-29ca-48cb-98b6-a716f95b4825 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:06.942950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0eb32-29ca-48cb-98b6-a716f95b4825 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:06.944209 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0eb32-29ca-48cb-98b6-a716f95b4825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:06.946179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0eb32-29ca-48cb-98b6-a716f95b4825 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:06.968901 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 803/1586] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:06.969999 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14355e-5475-40ed-ac45-9461192e6dc1 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:06.986314 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14355e-5475-40ed-ac45-9461192e6dc1 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:06.992231 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b5b28-e7c0-414f-9164-4b85f987822c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:06.993046 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b5b28-e7c0-414f-9164-4b85f987822c admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:06.999989 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b5b28-e7c0-414f-9164-4b85f987822c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:06.999989 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b5b28-e7c0-414f-9164-4b85f987822c admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:06.999989 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b5b28-e7c0-414f-9164-4b85f987822c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:06.999989 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b5b28-e7c0-414f-9164-4b85f987822c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.026841 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 784/1587] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:06 2022] POST /identity/v3/users => generated 279 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:07.028099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0eb32-29ca-48cb-98b6-a716f95b4825 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.040527 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0eb32-29ca-48cb-98b6-a716f95b4825 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.046010 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80297549-481f-4f27-b258-cfd703d401de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.051662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80297549-481f-4f27-b258-cfd703d401de admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.051662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80297549-481f-4f27-b258-cfd703d401de admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.051662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80297549-481f-4f27-b258-cfd703d401de admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.051662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80297549-481f-4f27-b258-cfd703d401de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.051662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80297549-481f-4f27-b258-cfd703d401de admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.125064 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 804/1588] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:06 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:07.126212 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b5b28-e7c0-414f-9164-4b85f987822c admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.138529 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b5b28-e7c0-414f-9164-4b85f987822c admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.143362 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c46fad-6efc-457a-92ec-6fe186b935f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.144032 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c46fad-6efc-457a-92ec-6fe186b935f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.144300 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c46fad-6efc-457a-92ec-6fe186b935f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.145753 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c46fad-6efc-457a-92ec-6fe186b935f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.145753 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c46fad-6efc-457a-92ec-6fe186b935f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.147636 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c46fad-6efc-457a-92ec-6fe186b935f7 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.158230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 805/1589] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:07.159141 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c46fad-6efc-457a-92ec-6fe186b935f7 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.170274 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c46fad-6efc-457a-92ec-6fe186b935f7 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.174969 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5c877-1e48-4aeb-9e28-8575069ed729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.175645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5c877-1e48-4aeb-9e28-8575069ed729 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.175645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5c877-1e48-4aeb-9e28-8575069ed729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.175645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5c877-1e48-4aeb-9e28-8575069ed729 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.175645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5c877-1e48-4aeb-9e28-8575069ed729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.175645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5c877-1e48-4aeb-9e28-8575069ed729 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.191602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 785/1590] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:07 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:07.191602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80297549-481f-4f27-b258-cfd703d401de admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.194819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 806/1591] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:07.195687 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5c877-1e48-4aeb-9e28-8575069ed729 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.203218 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80297549-481f-4f27-b258-cfd703d401de admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.210905 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855aadd-657c-4688-a730-9c18ce6f75df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.211671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855aadd-657c-4688-a730-9c18ce6f75df admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.211954 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855aadd-657c-4688-a730-9c18ce6f75df admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.212964 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855aadd-657c-4688-a730-9c18ce6f75df admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.215598 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855aadd-657c-4688-a730-9c18ce6f75df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.215598 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855aadd-657c-4688-a730-9c18ce6f75df admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.226918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 786/1592] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:07.226918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855aadd-657c-4688-a730-9c18ce6f75df admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.237835 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855aadd-657c-4688-a730-9c18ce6f75df admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.246828 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c66db-d1f5-4e12-8b51-cde5d4adeff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.247511 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c66db-d1f5-4e12-8b51-cde5d4adeff2 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.247793 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c66db-d1f5-4e12-8b51-cde5d4adeff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.248066 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c66db-d1f5-4e12-8b51-cde5d4adeff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.248869 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c66db-d1f5-4e12-8b51-cde5d4adeff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.250480 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c66db-d1f5-4e12-8b51-cde5d4adeff2 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.261992 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 787/1593] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:07.262868 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c66db-d1f5-4e12-8b51-cde5d4adeff2 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.268087 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5c877-1e48-4aeb-9e28-8575069ed729 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.273698 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c66db-d1f5-4e12-8b51-cde5d4adeff2 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.273915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c094591-59a6-4bb8-b907-249446f5b65f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.274580 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c094591-59a6-4bb8-b907-249446f5b65f service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.274872 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c094591-59a6-4bb8-b907-249446f5b65f service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.275139 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c094591-59a6-4bb8-b907-249446f5b65f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.278752 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ec83d-6a64-4aed-9d31-33ca9ae42ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.279449 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ec83d-6a64-4aed-9d31-33ca9ae42ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.279731 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ec83d-6a64-4aed-9d31-33ca9ae42ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.280004 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ec83d-6a64-4aed-9d31-33ca9ae42ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.280882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ec83d-6a64-4aed-9d31-33ca9ae42ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.284287 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c094591-59a6-4bb8-b907-249446f5b65f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.285919 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c094591-59a6-4bb8-b907-249446f5b65f service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.288409 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ec83d-6a64-4aed-9d31-33ca9ae42ae7 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.297577 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 807/1594] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:07.298683 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c094591-59a6-4bb8-b907-249446f5b65f service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.302915 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 788/1595] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:07.302915 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ec83d-6a64-4aed-9d31-33ca9ae42ae7 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.317170 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c094591-59a6-4bb8-b907-249446f5b65f service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.325245 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ec83d-6a64-4aed-9d31-33ca9ae42ae7 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.328825 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab816f8c-67ad-4e42-bdc9-bbdd05cd9def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.329598 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab816f8c-67ad-4e42-bdc9-bbdd05cd9def admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.329884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab816f8c-67ad-4e42-bdc9-bbdd05cd9def admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.330252 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab816f8c-67ad-4e42-bdc9-bbdd05cd9def admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.330683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b40db-caf8-439d-a8f5-d8d34b845e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.331434 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b40db-caf8-439d-a8f5-d8d34b845e1d admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.331728 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab816f8c-67ad-4e42-bdc9-bbdd05cd9def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.331889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b40db-caf8-439d-a8f5-d8d34b845e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.332279 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b40db-caf8-439d-a8f5-d8d34b845e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.333186 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b40db-caf8-439d-a8f5-d8d34b845e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.333636 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab816f8c-67ad-4e42-bdc9-bbdd05cd9def admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.336564 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b40db-caf8-439d-a8f5-d8d34b845e1d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.345542 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 808/1596] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:07.346853 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab816f8c-67ad-4e42-bdc9-bbdd05cd9def admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.354985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 789/1597] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:07.354985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b40db-caf8-439d-a8f5-d8d34b845e1d admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.359549 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab816f8c-67ad-4e42-bdc9-bbdd05cd9def admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.366468 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b40db-caf8-439d-a8f5-d8d34b845e1d admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.369593 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac1cf9-8b43-41ea-878f-139020e99abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.370978 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac1cf9-8b43-41ea-878f-139020e99abc admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.371418 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac1cf9-8b43-41ea-878f-139020e99abc admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.371750 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac1cf9-8b43-41ea-878f-139020e99abc admin admin] PATH_INFO: `/v3/projects/010e6221c8894fc7b29f3fa3a6331ef9/users/860bf509d22a4805859d346370f6fd9e/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.372088 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361de137-94b1-4492-8b2c-5c784d3192e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.372889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361de137-94b1-4492-8b2c-5c784d3192e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.373264 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361de137-94b1-4492-8b2c-5c784d3192e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.373601 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361de137-94b1-4492-8b2c-5c784d3192e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.374398 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361de137-94b1-4492-8b2c-5c784d3192e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.376113 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361de137-94b1-4492-8b2c-5c784d3192e6 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.387650 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 790/1598] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:07.390097 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361de137-94b1-4492-8b2c-5c784d3192e6 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.391791 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac1cf9-8b43-41ea-878f-139020e99abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=010e6221c8894fc7b29f3fa3a6331ef9, user_id=860bf509d22a4805859d346370f6fd9e, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.394449 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac1cf9-8b43-41ea-878f-139020e99abc admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.406573 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361de137-94b1-4492-8b2c-5c784d3192e6 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.411922 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c17ae-1d11-4ca6-80ea-27f182fdf8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.413379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c17ae-1d11-4ca6-80ea-27f182fdf8cb admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.414883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c17ae-1d11-4ca6-80ea-27f182fdf8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.414883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c17ae-1d11-4ca6-80ea-27f182fdf8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.414883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c17ae-1d11-4ca6-80ea-27f182fdf8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.416045 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c17ae-1d11-4ca6-80ea-27f182fdf8cb admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.428956 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 791/1599] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:07.429981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c17ae-1d11-4ca6-80ea-27f182fdf8cb admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.440362 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c17ae-1d11-4ca6-80ea-27f182fdf8cb admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.445579 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e07c9d-24ac-4952-8852-df379bcc87e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.446376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e07c9d-24ac-4952-8852-df379bcc87e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.446722 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e07c9d-24ac-4952-8852-df379bcc87e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.446909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e07c9d-24ac-4952-8852-df379bcc87e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.447633 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e07c9d-24ac-4952-8852-df379bcc87e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.449284 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e07c9d-24ac-4952-8852-df379bcc87e0 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.462598 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 809/1600] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:07 2022] PUT /identity/v3/projects/010e6221c8894fc7b29f3fa3a6331ef9/users/860bf509d22a4805859d346370f6fd9e/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:07.464292 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac1cf9-8b43-41ea-878f-139020e99abc admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.466481 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 792/1601] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:07.467401 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e07c9d-24ac-4952-8852-df379bcc87e0 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.482001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e07c9d-24ac-4952-8852-df379bcc87e0 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.546996 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac1cf9-8b43-41ea-878f-139020e99abc admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.554514 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed7924-34c6-438f-81e0-8e1ab70050d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.556113 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed7924-34c6-438f-81e0-8e1ab70050d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.557036 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed7924-34c6-438f-81e0-8e1ab70050d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.557036 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed7924-34c6-438f-81e0-8e1ab70050d3 admin admin] PATH_INFO: `/v3/projects/5b7dab05d38a408098e897db95032c35/users/bc624635a05f469d86503d0a80738164/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.572101 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a1136-ab8b-448f-8d18-56c8c9580463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.574468 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a1136-ab8b-448f-8d18-56c8c9580463 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.574889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a1136-ab8b-448f-8d18-56c8c9580463 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.575262 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a1136-ab8b-448f-8d18-56c8c9580463 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.579476 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a1136-ab8b-448f-8d18-56c8c9580463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.582865 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a1136-ab8b-448f-8d18-56c8c9580463 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.587293 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed7924-34c6-438f-81e0-8e1ab70050d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7dab05d38a408098e897db95032c35, user_id=bc624635a05f469d86503d0a80738164, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.590055 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed7924-34c6-438f-81e0-8e1ab70050d3 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.601079 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 793/1602] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:07.601079 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a1136-ab8b-448f-8d18-56c8c9580463 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.610445 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a1136-ab8b-448f-8d18-56c8c9580463 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.617719 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0479f3-1f1a-4bea-9057-a38fccbd4838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.618636 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0479f3-1f1a-4bea-9057-a38fccbd4838 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.618947 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0479f3-1f1a-4bea-9057-a38fccbd4838 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.619180 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0479f3-1f1a-4bea-9057-a38fccbd4838 admin admin] PATH_INFO: `/v3/projects/07795b5930f74368a7508f0536b9f800/users/136152c5c06b4e44803b127e232ff865/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.635137 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0479f3-1f1a-4bea-9057-a38fccbd4838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07795b5930f74368a7508f0536b9f800, user_id=136152c5c06b4e44803b127e232ff865, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.638039 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0479f3-1f1a-4bea-9057-a38fccbd4838 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.684776 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 810/1603] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:07 2022] PUT /identity/v3/projects/5b7dab05d38a408098e897db95032c35/users/bc624635a05f469d86503d0a80738164/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:07.685689 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed7924-34c6-438f-81e0-8e1ab70050d3 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.739890 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 794/1604] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:07 2022] PUT /identity/v3/projects/07795b5930f74368a7508f0536b9f800/users/136152c5c06b4e44803b127e232ff865/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:07.741278 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0479f3-1f1a-4bea-9057-a38fccbd4838 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.766261 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed7924-34c6-438f-81e0-8e1ab70050d3 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.805634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0479f3-1f1a-4bea-9057-a38fccbd4838 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:07.811009 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aae9f1-6016-4ba8-b0a0-7de55e54bada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.811911 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aae9f1-6016-4ba8-b0a0-7de55e54bada admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.812196 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aae9f1-6016-4ba8-b0a0-7de55e54bada admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.812475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aae9f1-6016-4ba8-b0a0-7de55e54bada admin admin] PATH_INFO: `/v3/projects/9b0146753d9c4364a672742dcb01e8e3/users/6b6ca2890fd64c59859baac6f3dda157/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.819180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f40978-9852-4192-a820-b37d19f710b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:07.820156 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f40978-9852-4192-a820-b37d19f710b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.820438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f40978-9852-4192-a820-b37d19f710b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.820750 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f40978-9852-4192-a820-b37d19f710b4 admin admin] PATH_INFO: `/v3/projects/4c46e95c051b41ab871c99dd81834533/users/4b55cfb05b0f4de5b5d8c95d96d94d52/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.828672 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aae9f1-6016-4ba8-b0a0-7de55e54bada admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b0146753d9c4364a672742dcb01e8e3, user_id=6b6ca2890fd64c59859baac6f3dda157, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.831441 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aae9f1-6016-4ba8-b0a0-7de55e54bada admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.838948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f40978-9852-4192-a820-b37d19f710b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c46e95c051b41ab871c99dd81834533, user_id=4b55cfb05b0f4de5b5d8c95d96d94d52, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:07.840210 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f40978-9852-4192-a820-b37d19f710b4 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:07.938663 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 795/1605] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:07 2022] PUT /identity/v3/projects/9b0146753d9c4364a672742dcb01e8e3/users/6b6ca2890fd64c59859baac6f3dda157/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:07.938872 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 811/1606] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:07 2022] PUT /identity/v3/projects/4c46e95c051b41ab871c99dd81834533/users/4b55cfb05b0f4de5b5d8c95d96d94d52/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:07.939329 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cc0ed-f718-40a5-a739-bd2b6c1bf2f7 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:07.939412 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f40978-9852-4192-a820-b37d19f710b4 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:07.939486 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cc0ed-f718-40a5-a739-bd2b6c1bf2f7 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:07.939486 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cc0ed-f718-40a5-a739-bd2b6c1bf2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:07.967669 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-4a8cc0ed-f718-40a5-a739-bd2b6c1bf2f7 None None] MFA Rules not processed for user `860bf509d22a4805859d346370f6fd9e`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:07.971040 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-4a8cc0ed-f718-40a5-a739-bd2b6c1bf2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:08.011269 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f40978-9852-4192-a820-b37d19f710b4 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:08.044717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 796/1607] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:07 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:08.046096 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebf77c-0735-4673-b741-6cd7e8b05082 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.046409 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebf77c-0735-4673-b741-6cd7e8b05082 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.046683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebf77c-0735-4673-b741-6cd7e8b05082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.074604 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-71ebf77c-0735-4673-b741-6cd7e8b05082 None None] MFA Rules not processed for user `bc624635a05f469d86503d0a80738164`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:08.075818 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-71ebf77c-0735-4673-b741-6cd7e8b05082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:08.075956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8fa2e-4b6a-468a-8e46-f4c4a60e7b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:08.076812 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8fa2e-4b6a-468a-8e46-f4c4a60e7b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.077097 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8fa2e-4b6a-468a-8e46-f4c4a60e7b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.077373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8fa2e-4b6a-468a-8e46-f4c4a60e7b44 admin admin] PATH_INFO: `/v3/projects/4341bd0e366648d2a8e427316961d985/users/5fe1c344dfc940479b4ed781461bd89b/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.095041 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8fa2e-4b6a-468a-8e46-f4c4a60e7b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4341bd0e366648d2a8e427316961d985, user_id=5fe1c344dfc940479b4ed781461bd89b, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:08.098169 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8fa2e-4b6a-468a-8e46-f4c4a60e7b44 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:08.144876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 797/1608] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:08.146127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b03d8-a845-472d-b0e3-92b1951abc55 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.146308 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b03d8-a845-472d-b0e3-92b1951abc55 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.146619 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b03d8-a845-472d-b0e3-92b1951abc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.165074 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 812/1609] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:07 2022] PUT /identity/v3/projects/4341bd0e366648d2a8e427316961d985/users/5fe1c344dfc940479b4ed781461bd89b/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:08.165312 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-1a8b03d8-a845-472d-b0e3-92b1951abc55 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:08.166261 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1a8b03d8-a845-472d-b0e3-92b1951abc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:08.166443 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb8fed-17e8-4165-93b1-8569a5de26e0 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.166735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb8fed-17e8-4165-93b1-8569a5de26e0 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.167011 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb8fed-17e8-4165-93b1-8569a5de26e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.194013 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-95fb8fed-17e8-4165-93b1-8569a5de26e0 None None] MFA Rules not processed for user `4b55cfb05b0f4de5b5d8c95d96d94d52`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:08.195297 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-95fb8fed-17e8-4165-93b1-8569a5de26e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:08.229526 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 798/1610] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:08.237529 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3019e2-2a65-4abf-97ee-12621afd60d4 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.237529 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3019e2-2a65-4abf-97ee-12621afd60d4 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.237529 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3019e2-2a65-4abf-97ee-12621afd60d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.265786 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-7b3019e2-2a65-4abf-97ee-12621afd60d4 None None] MFA Rules not processed for user `6b6ca2890fd64c59859baac6f3dda157`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:08.267153 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-7b3019e2-2a65-4abf-97ee-12621afd60d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:08.274085 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 813/1611] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:08 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:08.275479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99905ae5-ea29-4b26-ad77-71ef0e46e698 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.275949 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99905ae5-ea29-4b26-ad77-71ef0e46e698 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.276235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99905ae5-ea29-4b26-ad77-71ef0e46e698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.307029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-99905ae5-ea29-4b26-ad77-71ef0e46e698 None None] MFA Rules not processed for user `bc2d1d7be96e486fb49aaecd71aebb6d`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:08.308456 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-99905ae5-ea29-4b26-ad77-71ef0e46e698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:08.344628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 799/1612] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:08.344628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3019e2-2a65-4abf-97ee-12621afd60d4 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:08.370660 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3019e2-2a65-4abf-97ee-12621afd60d4 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:08.375967 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934904e9-91b1-4189-84e8-6c4618f51343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:08.377012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934904e9-91b1-4189-84e8-6c4618f51343 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.377371 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934904e9-91b1-4189-84e8-6c4618f51343 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.377717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934904e9-91b1-4189-84e8-6c4618f51343 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.378589 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934904e9-91b1-4189-84e8-6c4618f51343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:08.380624 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934904e9-91b1-4189-84e8-6c4618f51343 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:08.390218 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 814/1613] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:08.391600 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0399d-5a78-4fcb-99dc-3fd6003502af None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.391883 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0399d-5a78-4fcb-99dc-3fd6003502af None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.392157 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0399d-5a78-4fcb-99dc-3fd6003502af None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.393785 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 815/1614] 10.222.0.52 () {54 vars in 960 bytes} [Thu Apr 14 21:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:56:08.394803 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acff25-8100-45cc-8538-ce976b9af894 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.395083 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acff25-8100-45cc-8538-ce976b9af894 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.395347 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acff25-8100-45cc-8538-ce976b9af894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.416152 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-28acff25-8100-45cc-8538-ce976b9af894 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:08.417415 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-28acff25-8100-45cc-8538-ce976b9af894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:08.425116 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 816/1615] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:08.425889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acff25-8100-45cc-8538-ce976b9af894 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:08.485219 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 800/1616] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:08 2022] POST /identity/v3/projects => generated 363 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:08.485466 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acff25-8100-45cc-8538-ce976b9af894 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:08.486522 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934904e9-91b1-4189-84e8-6c4618f51343 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:08.538903 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4de994-80aa-4c95-be59-56526fb4b363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:08.539572 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4de994-80aa-4c95-be59-56526fb4b363 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.539835 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4de994-80aa-4c95-be59-56526fb4b363 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.540109 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4de994-80aa-4c95-be59-56526fb4b363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.549157 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4de994-80aa-4c95-be59-56526fb4b363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:08.549622 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934904e9-91b1-4189-84e8-6c4618f51343 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:08.550614 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4de994-80aa-4c95-be59-56526fb4b363 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:08.555287 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9507f39-111b-4e0a-a7b3-9ee41f7ee2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:08.555943 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9507f39-111b-4e0a-a7b3-9ee41f7ee2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.556231 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9507f39-111b-4e0a-a7b3-9ee41f7ee2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.556505 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9507f39-111b-4e0a-a7b3-9ee41f7ee2a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.557305 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9507f39-111b-4e0a-a7b3-9ee41f7ee2a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:08.559146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9507f39-111b-4e0a-a7b3-9ee41f7ee2a2 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:08.561069 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 817/1617] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:08.562540 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959c1fe-9d49-4ae2-b8c2-0c5352b79bd2 None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.562831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959c1fe-9d49-4ae2-b8c2-0c5352b79bd2 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.563108 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959c1fe-9d49-4ae2-b8c2-0c5352b79bd2 None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.564626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 818/1618] 10.222.0.52 () {54 vars in 960 bytes} [Thu Apr 14 21:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:56:08.565578 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1eaea-33b8-4b6c-9c21-99b823a4702c None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.566102 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1eaea-33b8-4b6c-9c21-99b823a4702c None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.566304 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1eaea-33b8-4b6c-9c21-99b823a4702c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.589390 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-18a1eaea-33b8-4b6c-9c21-99b823a4702c None None] MFA Rules not processed for user `e7f3ea629181433eb8c6d5dbc354c141`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:08.590562 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-18a1eaea-33b8-4b6c-9c21-99b823a4702c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:08.659884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 819/1619] 10.222.0.52 () {58 vars in 1057 bytes} [Thu Apr 14 21:56:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:08.661302 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0579e-e8a5-45b2-99cb-6a85db7676a0 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.661586 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0579e-e8a5-45b2-99cb-6a85db7676a0 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.661857 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0579e-e8a5-45b2-99cb-6a85db7676a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.681733 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 801/1620] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:08 2022] POST /identity/v3/projects => generated 357 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:08.681733 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9507f39-111b-4e0a-a7b3-9ee41f7ee2a2 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:08.682460 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-f6d0579e-e8a5-45b2-99cb-6a85db7676a0 None None] MFA Rules not processed for user `bc2d1d7be96e486fb49aaecd71aebb6d`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:08.683648 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f6d0579e-e8a5-45b2-99cb-6a85db7676a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:08.746621 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 820/1621] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:08.747373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0579e-e8a5-45b2-99cb-6a85db7676a0 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:08.749863 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9507f39-111b-4e0a-a7b3-9ee41f7ee2a2 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:08.755376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff97b1-f0f7-4448-8ee1-c446ea645298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:08.758814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff97b1-f0f7-4448-8ee1-c446ea645298 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.758814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff97b1-f0f7-4448-8ee1-c446ea645298 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.758814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff97b1-f0f7-4448-8ee1-c446ea645298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.815266 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0579e-e8a5-45b2-99cb-6a85db7676a0 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:08.821283 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfac0e-7164-48b9-9f85-7d1a1d58ec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:08.821955 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfac0e-7164-48b9-9f85-7d1a1d58ec26 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.822240 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfac0e-7164-48b9-9f85-7d1a1d58ec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.822517 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfac0e-7164-48b9-9f85-7d1a1d58ec26 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.823256 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfac0e-7164-48b9-9f85-7d1a1d58ec26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:08.825315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfac0e-7164-48b9-9f85-7d1a1d58ec26 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:08.832412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff97b1-f0f7-4448-8ee1-c446ea645298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:08.832412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff97b1-f0f7-4448-8ee1-c446ea645298 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:08.839046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 802/1622] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:08.840357 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55581adb-92f7-4d66-9d2c-d85deb8a6254 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.840692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55581adb-92f7-4d66-9d2c-d85deb8a6254 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.840966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55581adb-92f7-4d66-9d2c-d85deb8a6254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.859017 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-55581adb-92f7-4d66-9d2c-d85deb8a6254 None None] MFA Rules not processed for user `e7f3ea629181433eb8c6d5dbc354c141`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:08.860237 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-55581adb-92f7-4d66-9d2c-d85deb8a6254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:08.905634 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 821/1623] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:08 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:08.906571 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfac0e-7164-48b9-9f85-7d1a1d58ec26 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:08.946603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 803/1624] 10.222.0.52 () {58 vars in 1057 bytes} [Thu Apr 14 21:56:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:08.947723 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55581adb-92f7-4d66-9d2c-d85deb8a6254 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:08.966685 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55581adb-92f7-4d66-9d2c-d85deb8a6254 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:08.972708 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c49de6-51f7-4205-b36f-abc278905284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:08.973757 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c49de6-51f7-4205-b36f-abc278905284 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:08.974072 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c49de6-51f7-4205-b36f-abc278905284 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:08.974472 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c49de6-51f7-4205-b36f-abc278905284 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:08.975288 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c49de6-51f7-4205-b36f-abc278905284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:08.977717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c49de6-51f7-4205-b36f-abc278905284 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:09.018771 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfac0e-7164-48b9-9f85-7d1a1d58ec26 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:09.026852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da98431-00ff-4418-8861-7dad79e0c285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:09.027607 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da98431-00ff-4418-8861-7dad79e0c285 service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:09.028054 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da98431-00ff-4418-8861-7dad79e0c285 service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:09.029198 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da98431-00ff-4418-8861-7dad79e0c285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:09.088287 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da98431-00ff-4418-8861-7dad79e0c285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:09.089945 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da98431-00ff-4418-8861-7dad79e0c285 service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:09.098718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 822/1625] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:09.099528 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da98431-00ff-4418-8861-7dad79e0c285 service nova] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:09.109199 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da98431-00ff-4418-8861-7dad79e0c285 service nova] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:09.113696 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22530933-b352-4c8a-a876-c7cf4b00e633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:09.114333 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22530933-b352-4c8a-a876-c7cf4b00e633 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:09.114610 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22530933-b352-4c8a-a876-c7cf4b00e633 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:09.114938 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22530933-b352-4c8a-a876-c7cf4b00e633 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:09.115895 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22530933-b352-4c8a-a876-c7cf4b00e633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:09.117565 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22530933-b352-4c8a-a876-c7cf4b00e633 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:09.128284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 823/1626] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:09.132154 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22530933-b352-4c8a-a876-c7cf4b00e633 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:09.133207 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 804/1627] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:08 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:09.134310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c49de6-51f7-4205-b36f-abc278905284 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:09.144840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c49de6-51f7-4205-b36f-abc278905284 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:09.145283 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22530933-b352-4c8a-a876-c7cf4b00e633 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:09.151411 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508b9a9-791f-47ae-af8b-a265bcdd54c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:09.152033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af10e1d-8a1c-44ea-9c46-cc266e124e12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:09.152613 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508b9a9-791f-47ae-af8b-a265bcdd54c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:09.152726 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10e1d-8a1c-44ea-9c46-cc266e124e12 service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:09.152977 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10e1d-8a1c-44ea-9c46-cc266e124e12 service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:09.153255 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10e1d-8a1c-44ea-9c46-cc266e124e12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:09.153976 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508b9a9-791f-47ae-af8b-a265bcdd54c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:09.154471 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508b9a9-791f-47ae-af8b-a265bcdd54c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:09.155436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508b9a9-791f-47ae-af8b-a265bcdd54c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:09.157283 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508b9a9-791f-47ae-af8b-a265bcdd54c8 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:09.172604 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 805/1628] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:09.173998 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508b9a9-791f-47ae-af8b-a265bcdd54c8 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:09.186043 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508b9a9-791f-47ae-af8b-a265bcdd54c8 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:09.191353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300625ab-851a-4793-84de-da0a67dd9df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:09.192507 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300625ab-851a-4793-84de-da0a67dd9df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:09.193074 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300625ab-851a-4793-84de-da0a67dd9df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:09.194349 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300625ab-851a-4793-84de-da0a67dd9df0 admin admin] PATH_INFO: `/v3/projects/9414f2a54e1c40cca76e0b14e1035065/users/f094c93313f24d148ef33ce84224ca98/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:09.214172 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af10e1d-8a1c-44ea-9c46-cc266e124e12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:09.218288 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af10e1d-8a1c-44ea-9c46-cc266e124e12 service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:09.221275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300625ab-851a-4793-84de-da0a67dd9df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9414f2a54e1c40cca76e0b14e1035065, user_id=f094c93313f24d148ef33ce84224ca98, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:09.223993 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300625ab-851a-4793-84de-da0a67dd9df0 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:09.227231 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 824/1629] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:09.228059 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af10e1d-8a1c-44ea-9c46-cc266e124e12 service nova] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:09.239166 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af10e1d-8a1c-44ea-9c46-cc266e124e12 service nova] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:09.245451 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5876363-8f4a-4b45-853a-ffe3fad3189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:09.246966 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5876363-8f4a-4b45-853a-ffe3fad3189c admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:09.246966 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5876363-8f4a-4b45-853a-ffe3fad3189c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:09.247335 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5876363-8f4a-4b45-853a-ffe3fad3189c admin admin] PATH_INFO: `/v3/projects/e51942938cab47e691a09e7839e732be/users/a50c2c14c614409da4191e58187a4385/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:09.264742 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5876363-8f4a-4b45-853a-ffe3fad3189c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51942938cab47e691a09e7839e732be, user_id=a50c2c14c614409da4191e58187a4385, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:09.267890 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5876363-8f4a-4b45-853a-ffe3fad3189c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:09.327235 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 806/1630] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:09 2022] PUT /identity/v3/projects/9414f2a54e1c40cca76e0b14e1035065/users/f094c93313f24d148ef33ce84224ca98/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:09.328562 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300625ab-851a-4793-84de-da0a67dd9df0 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:09.380843 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 825/1631] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:09 2022] PUT /identity/v3/projects/e51942938cab47e691a09e7839e732be/users/a50c2c14c614409da4191e58187a4385/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:09.382735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5876363-8f4a-4b45-853a-ffe3fad3189c admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:09.481531 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300625ab-851a-4793-84de-da0a67dd9df0 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:09.511241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5876363-8f4a-4b45-853a-ffe3fad3189c admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:09.517899 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5dc2c-27c2-44e3-b057-1444b74a8013 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:09.518726 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5dc2c-27c2-44e3-b057-1444b74a8013 service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:09.519169 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5dc2c-27c2-44e3-b057-1444b74a8013 service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:09.519508 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5dc2c-27c2-44e3-b057-1444b74a8013 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:09.569216 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6e6ff-d66d-46fe-97f5-62e10296bad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:09.570098 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6e6ff-d66d-46fe-97f5-62e10296bad4 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:09.570385 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6e6ff-d66d-46fe-97f5-62e10296bad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:09.570852 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6e6ff-d66d-46fe-97f5-62e10296bad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:09.571629 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6e6ff-d66d-46fe-97f5-62e10296bad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:09.573338 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6e6ff-d66d-46fe-97f5-62e10296bad4 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:09.585277 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 807/1632] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:56:09.586756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6e6ff-d66d-46fe-97f5-62e10296bad4 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:09.602000 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6e6ff-d66d-46fe-97f5-62e10296bad4 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:09.606532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ed704-de6b-4886-b48a-a3013b1ee568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:09.607997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ed704-de6b-4886-b48a-a3013b1ee568 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:09.608292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ed704-de6b-4886-b48a-a3013b1ee568 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:09.608571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ed704-de6b-4886-b48a-a3013b1ee568 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:09.609351 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ed704-de6b-4886-b48a-a3013b1ee568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:09.611331 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ed704-de6b-4886-b48a-a3013b1ee568 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:09.614728 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5dc2c-27c2-44e3-b057-1444b74a8013 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:09.617896 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5dc2c-27c2-44e3-b057-1444b74a8013 service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:09.626456 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 808/1633] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:09.626456 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ed704-de6b-4886-b48a-a3013b1ee568 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:09.635981 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 826/1634] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:09.637379 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033b0df-17e9-410c-8d11-78c5317c099d None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:09.637873 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033b0df-17e9-410c-8d11-78c5317c099d None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:09.638175 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033b0df-17e9-410c-8d11-78c5317c099d None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:09.640199 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 827/1635] 10.222.0.52 () {54 vars in 912 bytes} [Thu Apr 14 21:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:56:09.641017 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033b0df-17e9-410c-8d11-78c5317c099d None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:09.647163 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ed704-de6b-4886-b48a-a3013b1ee568 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:09.655776 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033b0df-17e9-410c-8d11-78c5317c099d None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:09.661468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0aebcf-39ec-43e3-b7be-15474d3c2d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:09.662159 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a3501-e6af-410f-bbd3-4a41d9c08626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:09.662460 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aebcf-39ec-43e3-b7be-15474d3c2d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:09.662740 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aebcf-39ec-43e3-b7be-15474d3c2d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:09.663071 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a3501-e6af-410f-bbd3-4a41d9c08626 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:09.663202 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aebcf-39ec-43e3-b7be-15474d3c2d2f admin admin] PATH_INFO: `/v3/projects/e51942938cab47e691a09e7839e732be/users/a50c2c14c614409da4191e58187a4385/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:09.663387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a3501-e6af-410f-bbd3-4a41d9c08626 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:09.663699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a3501-e6af-410f-bbd3-4a41d9c08626 admin admin] PATH_INFO: `/v3/projects/9414f2a54e1c40cca76e0b14e1035065/users/f094c93313f24d148ef33ce84224ca98/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:09.665480 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0aebcf-39ec-43e3-b7be-15474d3c2d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51942938cab47e691a09e7839e732be, user_id=a50c2c14c614409da4191e58187a4385, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:09.667679 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a3501-e6af-410f-bbd3-4a41d9c08626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9414f2a54e1c40cca76e0b14e1035065, user_id=f094c93313f24d148ef33ce84224ca98, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:09.668592 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0aebcf-39ec-43e3-b7be-15474d3c2d2f admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:09.670896 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a3501-e6af-410f-bbd3-4a41d9c08626 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:09.684373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 828/1636] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:09 2022] PUT /identity/v3/projects/e51942938cab47e691a09e7839e732be/users/a50c2c14c614409da4191e58187a4385/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:09.686409 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56115b1d-b1e9-4481-ad0e-3fd1cdf504b2 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:09.686697 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56115b1d-b1e9-4481-ad0e-3fd1cdf504b2 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:09.686972 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56115b1d-b1e9-4481-ad0e-3fd1cdf504b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:09.704135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 809/1637] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:09 2022] PUT /identity/v3/projects/9414f2a54e1c40cca76e0b14e1035065/users/f094c93313f24d148ef33ce84224ca98/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:09.712291 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420df8b-6d5a-437b-a076-4b1927dec644 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:09.712291 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420df8b-6d5a-437b-a076-4b1927dec644 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:09.716752 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420df8b-6d5a-437b-a076-4b1927dec644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:09.762912 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-56115b1d-b1e9-4481-ad0e-3fd1cdf504b2 None None] MFA Rules not processed for user `e7f3ea629181433eb8c6d5dbc354c141`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:09.768506 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-56115b1d-b1e9-4481-ad0e-3fd1cdf504b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:09.772838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-c420df8b-6d5a-437b-a076-4b1927dec644 None None] MFA Rules not processed for user `a50c2c14c614409da4191e58187a4385`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:09.783436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c420df8b-6d5a-437b-a076-4b1927dec644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:09.854187 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 829/1638] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Apr 14 21:56:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:09.854187 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29746579-8d2f-419d-923c-cec76a0ade9c None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:09.854525 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29746579-8d2f-419d-923c-cec76a0ade9c None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:09.855020 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29746579-8d2f-419d-923c-cec76a0ade9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:09.862038 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 810/1639] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:09 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:09.868628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e48d60-7f41-4f5c-b926-bf6679b7e20a None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:09.869089 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e48d60-7f41-4f5c-b926-bf6679b7e20a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:09.869232 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e48d60-7f41-4f5c-b926-bf6679b7e20a None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:09.870824 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 811/1640] 10.222.0.52 () {54 vars in 912 bytes} [Thu Apr 14 21:56:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:56:09.873699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e48d60-7f41-4f5c-b926-bf6679b7e20a None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:09.900165 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-29746579-8d2f-419d-923c-cec76a0ade9c None None] MFA Rules not processed for user `f094c93313f24d148ef33ce84224ca98`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:09.901926 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-29746579-8d2f-419d-923c-cec76a0ade9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:09.969147 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e48d60-7f41-4f5c-b926-bf6679b7e20a None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:09.978774 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee0ed9-c232-4a4a-a1b1-76acee52f6df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:09.980318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee0ed9-c232-4a4a-a1b1-76acee52f6df service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:09.980646 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee0ed9-c232-4a4a-a1b1-76acee52f6df service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:09.980940 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee0ed9-c232-4a4a-a1b1-76acee52f6df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:09.996350 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee0ed9-c232-4a4a-a1b1-76acee52f6df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:09.997877 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee0ed9-c232-4a4a-a1b1-76acee52f6df service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:10.005943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 830/1641] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:09 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:10.005943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790be5f8-70d5-4f91-872e-d33d9ee40cbb None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:10.005943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790be5f8-70d5-4f91-872e-d33d9ee40cbb None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:10.005943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790be5f8-70d5-4f91-872e-d33d9ee40cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:10.010951 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 812/1642] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:10.012155 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee0ed9-c232-4a4a-a1b1-76acee52f6df service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:10.030346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee0ed9-c232-4a4a-a1b1-76acee52f6df service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:10.030346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c31a2-b9ca-46ad-94df-e9a0a0b273c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:10.030346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c31a2-b9ca-46ad-94df-e9a0a0b273c5 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:10.030346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c31a2-b9ca-46ad-94df-e9a0a0b273c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:10.030724 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-790be5f8-70d5-4f91-872e-d33d9ee40cbb None None] MFA Rules not processed for user `e7f3ea629181433eb8c6d5dbc354c141`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:10.031154 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c31a2-b9ca-46ad-94df-e9a0a0b273c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:10.031243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-790be5f8-70d5-4f91-872e-d33d9ee40cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:10.043832 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c31a2-b9ca-46ad-94df-e9a0a0b273c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:10.045462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c31a2-b9ca-46ad-94df-e9a0a0b273c5 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:10.049093 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 831/1643] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Apr 14 21:56:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:10.062671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 813/1644] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:10 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:10.071392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790be5f8-70d5-4f91-872e-d33d9ee40cbb None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:10.072969 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-790be5f8-70d5-4f91-872e-d33d9ee40cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:10.163624 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790be5f8-70d5-4f91-872e-d33d9ee40cbb None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:10.168033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64023d-f834-40cb-abe6-c36a2795e72b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d261ec6e42f4be08c4d584fd3d00850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:10.169397 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64023d-f834-40cb-abe6-c36a2795e72b service glance] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:10.169397 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64023d-f834-40cb-abe6-c36a2795e72b service glance] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:10.171615 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64023d-f834-40cb-abe6-c36a2795e72b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:10.182510 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64023d-f834-40cb-abe6-c36a2795e72b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:10.184080 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64023d-f834-40cb-abe6-c36a2795e72b service glance] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:10.215249 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 832/1645] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:10.221498 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c31a2-b9ca-46ad-94df-e9a0a0b273c5 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:10.233473 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c31a2-b9ca-46ad-94df-e9a0a0b273c5 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:10.241110 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d035b56-4170-4602-8580-876816dfc1b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:10.241788 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d035b56-4170-4602-8580-876816dfc1b2 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:10.242067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d035b56-4170-4602-8580-876816dfc1b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:10.243154 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d035b56-4170-4602-8580-876816dfc1b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:10.259882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d035b56-4170-4602-8580-876816dfc1b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:10.262326 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d035b56-4170-4602-8580-876816dfc1b2 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:10.296797 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 814/1646] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:10 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:10.676768 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64023d-f834-40cb-abe6-c36a2795e72b service glance] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:10.687234 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64023d-f834-40cb-abe6-c36a2795e72b service glance] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:10.696635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63e6fd-d38b-42c5-959e-f2be8150a5ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:10.697467 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63e6fd-d38b-42c5-959e-f2be8150a5ce service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:10.697753 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63e6fd-d38b-42c5-959e-f2be8150a5ce service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:10.698094 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63e6fd-d38b-42c5-959e-f2be8150a5ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:10.795193 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63e6fd-d38b-42c5-959e-f2be8150a5ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:10.796845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63e6fd-d38b-42c5-959e-f2be8150a5ce service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:10.806493 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 833/1647] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:10 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:10.863099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71682cb7-e6e1-4a07-b3a1-65bdf94fb39c None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:10.863099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71682cb7-e6e1-4a07-b3a1-65bdf94fb39c None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:10.863099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71682cb7-e6e1-4a07-b3a1-65bdf94fb39c None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:10.863099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 815/1648] 10.222.0.52 () {54 vars in 912 bytes} [Thu Apr 14 21:56:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:56:10.863718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4338c42-9ec8-46d1-a24b-10fa80cf6ebd None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:10.863718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4338c42-9ec8-46d1-a24b-10fa80cf6ebd None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:10.863718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4338c42-9ec8-46d1-a24b-10fa80cf6ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:10.913050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-c4338c42-9ec8-46d1-a24b-10fa80cf6ebd None None] MFA Rules not processed for user `1bfbd6a387e44037a58e521230783347`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:10.914823 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c4338c42-9ec8-46d1-a24b-10fa80cf6ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:10.995315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 834/1649] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Apr 14 21:56:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:11.022316 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71682cb7-e6e1-4a07-b3a1-65bdf94fb39c None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:11.040942 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71682cb7-e6e1-4a07-b3a1-65bdf94fb39c None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:11.046280 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4338c42-9ec8-46d1-a24b-10fa80cf6ebd None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:11.049508 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734445b-1eb0-433b-add3-10dff63c354b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:11.051916 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734445b-1eb0-433b-add3-10dff63c354b service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:11.052412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734445b-1eb0-433b-add3-10dff63c354b service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:11.052892 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734445b-1eb0-433b-add3-10dff63c354b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:11.059605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4338c42-9ec8-46d1-a24b-10fa80cf6ebd None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:11.069439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ae013-033d-4a22-9098-d1a9d21f51a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:11.072019 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ae013-033d-4a22-9098-d1a9d21f51a0 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:11.072340 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ae013-033d-4a22-9098-d1a9d21f51a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:11.072644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ae013-033d-4a22-9098-d1a9d21f51a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:11.097894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ae013-033d-4a22-9098-d1a9d21f51a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:11.099813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ae013-033d-4a22-9098-d1a9d21f51a0 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:11.128881 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 835/1650] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:56:11.167226 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734445b-1eb0-433b-add3-10dff63c354b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:11.179191 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734445b-1eb0-433b-add3-10dff63c354b service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:11.199703 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 816/1651] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:11 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:12.287258 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ae013-033d-4a22-9098-d1a9d21f51a0 service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:12.401068 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901cbb3-2ea6-4f15-aed4-13fed4b49a72 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:12.404420 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901cbb3-2ea6-4f15-aed4-13fed4b49a72 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:12.405677 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901cbb3-2ea6-4f15-aed4-13fed4b49a72 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:12.409583 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 817/1652] 10.222.0.52 () {54 vars in 960 bytes} [Thu Apr 14 21:56:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 14 21:56:12.422934 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aad967-95f2-4d08-8178-aca24e0f0aaa None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:12.423819 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aad967-95f2-4d08-8178-aca24e0f0aaa None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:12.425401 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aad967-95f2-4d08-8178-aca24e0f0aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:12.434373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ae013-033d-4a22-9098-d1a9d21f51a0 service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:12.447298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1493d69-deb0-46ed-9c81-5a977c1e61aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:12.448965 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1493d69-deb0-46ed-9c81-5a977c1e61aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:12.449349 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1493d69-deb0-46ed-9c81-5a977c1e61aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:12.449732 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1493d69-deb0-46ed-9c81-5a977c1e61aa admin admin] PATH_INFO: `/v3/users/bc624635a05f469d86503d0a80738164` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:12.451337 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1493d69-deb0-46ed-9c81-5a977c1e61aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc624635a05f469d86503d0a80738164)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:12.452500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: WARNING py.warnings [None req-f1493d69-deb0-46ed-9c81-5a977c1e61aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 14 21:56:12.452500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: warnings.warn(msg) Apr 14 21:56:12.452500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: Apr 14 21:56:12.454986 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1493d69-deb0-46ed-9c81-5a977c1e61aa admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:12.530723 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-79aad967-95f2-4d08-8178-aca24e0f0aaa None None] MFA Rules not processed for user `9e166c6b0e5542f7b912cbefa88bb5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:12.544913 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-79aad967-95f2-4d08-8178-aca24e0f0aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:12.689910 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 818/1653] 10.222.0.52 () {58 vars in 1057 bytes} [Thu Apr 14 21:56:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:12.705844 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aad967-95f2-4d08-8178-aca24e0f0aaa None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:12.715818 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aad967-95f2-4d08-8178-aca24e0f0aaa None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:12.732113 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b6224-ae5d-430b-9833-710f5809f2e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e166c6b0e5542f7b912cbefa88bb5f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:12.733245 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b6224-ae5d-430b-9833-710f5809f2e3 service placement] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:12.733824 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b6224-ae5d-430b-9833-710f5809f2e3 service placement] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:12.734323 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b6224-ae5d-430b-9833-710f5809f2e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:12.741571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-831b6224-ae5d-430b-9833-710f5809f2e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:12.762605 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b6224-ae5d-430b-9833-710f5809f2e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:12.764431 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b6224-ae5d-430b-9833-710f5809f2e3 service placement] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:12.776965 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 819/1654] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:12.793235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f1493d69-deb0-46ed-9c81-5a977c1e61aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc624635a05f469d86503d0a80738164'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:12.794295 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f1493d69-deb0-46ed-9c81-5a977c1e61aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc624635a05f469d86503d0a80738164'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:12.822015 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f1493d69-deb0-46ed-9c81-5a977c1e61aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc624635a05f469d86503d0a80738164'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:12.843810 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f1493d69-deb0-46ed-9c81-5a977c1e61aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc624635a05f469d86503d0a80738164'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:12.845190 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f1493d69-deb0-46ed-9c81-5a977c1e61aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc624635a05f469d86503d0a80738164'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:12.958990 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 836/1655] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:12 2022] DELETE /identity/v3/users/bc624635a05f469d86503d0a80738164 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:12.964373 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb72e78-d9e3-4e66-8ad3-f7f1adbe8b6c None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:12.964767 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb72e78-d9e3-4e66-8ad3-f7f1adbe8b6c None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:12.965353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb72e78-d9e3-4e66-8ad3-f7f1adbe8b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:13.043760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-bbb72e78-d9e3-4e66-8ad3-f7f1adbe8b6c None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:13.049265 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-bbb72e78-d9e3-4e66-8ad3-f7f1adbe8b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:13.247199 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 820/1656] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:13.275191 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1493d69-deb0-46ed-9c81-5a977c1e61aa admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:13.277195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f1493d69-deb0-46ed-9c81-5a977c1e61aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:13.444862 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1493d69-deb0-46ed-9c81-5a977c1e61aa admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:13.461872 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44aeba-3cee-44e9-8d59-a5a107def61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:13.463434 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44aeba-3cee-44e9-8d59-a5a107def61d service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:13.464830 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44aeba-3cee-44e9-8d59-a5a107def61d service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:13.465312 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44aeba-3cee-44e9-8d59-a5a107def61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:13.499504 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44aeba-3cee-44e9-8d59-a5a107def61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:13.504642 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44aeba-3cee-44e9-8d59-a5a107def61d service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:13.870888 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 837/1657] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:14.580778 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb72e78-d9e3-4e66-8ad3-f7f1adbe8b6c None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:14.581350 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-bbb72e78-d9e3-4e66-8ad3-f7f1adbe8b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:14.617650 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb72e78-d9e3-4e66-8ad3-f7f1adbe8b6c None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:14.649189 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca0e24-ed51-493b-aa17-dbc25073a5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:14.655771 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca0e24-ed51-493b-aa17-dbc25073a5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:14.655771 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca0e24-ed51-493b-aa17-dbc25073a5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:14.655771 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca0e24-ed51-493b-aa17-dbc25073a5a5 admin admin] PATH_INFO: `/v3/projects/5b7dab05d38a408098e897db95032c35` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:14.664161 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca0e24-ed51-493b-aa17-dbc25073a5a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b7dab05d38a408098e897db95032c35)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:14.672420 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: WARNING py.warnings [None req-beca0e24-ed51-493b-aa17-dbc25073a5a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 14 21:56:14.672420 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: warnings.warn(msg) Apr 14 21:56:14.672420 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: Apr 14 21:56:14.673806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca0e24-ed51-493b-aa17-dbc25073a5a5 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:14.948655 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-beca0e24-ed51-493b-aa17-dbc25073a5a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b7dab05d38a408098e897db95032c35', 'request_id': 'req-beca0e24-ed51-493b-aa17-dbc25073a5a5'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:15.068992 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44aeba-3cee-44e9-8d59-a5a107def61d service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:15.069612 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-beca0e24-ed51-493b-aa17-dbc25073a5a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b7dab05d38a408098e897db95032c35', 'request_id': 'req-beca0e24-ed51-493b-aa17-dbc25073a5a5'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:15.071697 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-fb44aeba-3cee-44e9-8d59-a5a107def61d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:15.097183 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44aeba-3cee-44e9-8d59-a5a107def61d service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:15.118742 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-beca0e24-ed51-493b-aa17-dbc25073a5a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b7dab05d38a408098e897db95032c35', 'request_id': 'req-beca0e24-ed51-493b-aa17-dbc25073a5a5'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:15.164916 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-beca0e24-ed51-493b-aa17-dbc25073a5a5 admin admin] The token cache is being invalidate because project 5b7dab05d38a408098e897db95032c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:15.165207 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-beca0e24-ed51-493b-aa17-dbc25073a5a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:15.170631 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-beca0e24-ed51-493b-aa17-dbc25073a5a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:15.177464 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 821/1658] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:14 2022] DELETE /identity/v3/projects/5b7dab05d38a408098e897db95032c35 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:15.185830 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b92d2-84bb-422e-9d49-234e3b79261c None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:15.186520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b92d2-84bb-422e-9d49-234e3b79261c None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:15.186831 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b92d2-84bb-422e-9d49-234e3b79261c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:15.252092 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-7f9b92d2-84bb-422e-9d49-234e3b79261c None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:15.254733 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-7f9b92d2-84bb-422e-9d49-234e3b79261c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:15.284347 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227cae0-d6a5-4884-9f36-5ec60466698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:15.288680 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227cae0-d6a5-4884-9f36-5ec60466698c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:15.293262 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227cae0-d6a5-4884-9f36-5ec60466698c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:15.293743 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227cae0-d6a5-4884-9f36-5ec60466698c admin admin] PATH_INFO: `/v3/users/6b6ca2890fd64c59859baac6f3dda157` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:15.296135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227cae0-d6a5-4884-9f36-5ec60466698c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6ca2890fd64c59859baac6f3dda157)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:15.300227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227cae0-d6a5-4884-9f36-5ec60466698c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:15.428170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 822/1659] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:15.436509 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbacc73-5934-4f55-b426-c3c37a96ebab None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:15.436820 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbacc73-5934-4f55-b426-c3c37a96ebab None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:15.437093 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbacc73-5934-4f55-b426-c3c37a96ebab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:15.472263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-8dbacc73-5934-4f55-b426-c3c37a96ebab None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:15.473584 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-8dbacc73-5934-4f55-b426-c3c37a96ebab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:15.494161 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 823/1660] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:15.505413 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbacc73-5934-4f55-b426-c3c37a96ebab None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:15.536841 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbacc73-5934-4f55-b426-c3c37a96ebab None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:15.544342 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf55ead-8142-4955-8b03-35e23ce17df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:15.544603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf55ead-8142-4955-8b03-35e23ce17df9 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:15.544802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf55ead-8142-4955-8b03-35e23ce17df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:15.545076 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf55ead-8142-4955-8b03-35e23ce17df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:15.546180 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf55ead-8142-4955-8b03-35e23ce17df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:15.546180 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf55ead-8142-4955-8b03-35e23ce17df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:15.547746 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf55ead-8142-4955-8b03-35e23ce17df9 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:15.570395 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 824/1661] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:56:15.576038 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf55ead-8142-4955-8b03-35e23ce17df9 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:15.587545 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf55ead-8142-4955-8b03-35e23ce17df9 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:15.593614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8330eb5-b753-4956-ab3a-eb38f653a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:15.594526 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8330eb5-b753-4956-ab3a-eb38f653a8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:15.594970 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8330eb5-b753-4956-ab3a-eb38f653a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:15.595693 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8330eb5-b753-4956-ab3a-eb38f653a8a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:15.596557 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8330eb5-b753-4956-ab3a-eb38f653a8a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:15.599016 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8330eb5-b753-4956-ab3a-eb38f653a8a5 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:15.653995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c227cae0-d6a5-4884-9f36-5ec60466698c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6ca2890fd64c59859baac6f3dda157'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:15.655825 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c227cae0-d6a5-4884-9f36-5ec60466698c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6ca2890fd64c59859baac6f3dda157'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:15.683275 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c227cae0-d6a5-4884-9f36-5ec60466698c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6ca2890fd64c59859baac6f3dda157'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:15.699934 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c227cae0-d6a5-4884-9f36-5ec60466698c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6ca2890fd64c59859baac6f3dda157'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:15.701279 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c227cae0-d6a5-4884-9f36-5ec60466698c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6ca2890fd64c59859baac6f3dda157'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:15.736899 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 825/1662] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:15 2022] POST /identity/v3/projects => generated 403 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:56:15.741932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8330eb5-b753-4956-ab3a-eb38f653a8a5 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:15.746750 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b8330eb5-b753-4956-ab3a-eb38f653a8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:15.844673 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 838/1663] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:15 2022] DELETE /identity/v3/users/6b6ca2890fd64c59859baac6f3dda157 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:15.846350 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fedb1-3243-4fa7-8364-676f07124d6b None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:15.853009 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fedb1-3243-4fa7-8364-676f07124d6b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:15.853694 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fedb1-3243-4fa7-8364-676f07124d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:15.910218 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-1a5fedb1-3243-4fa7-8364-676f07124d6b None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:15.913835 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-1a5fedb1-3243-4fa7-8364-676f07124d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:15.918130 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8330eb5-b753-4956-ab3a-eb38f653a8a5 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:16.045716 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 839/1664] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:16.056017 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fedb1-3243-4fa7-8364-676f07124d6b None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:16.060735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-1a5fedb1-3243-4fa7-8364-676f07124d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:16.099254 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fe2d3-9583-469a-93f0-abc969104369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:16.100397 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe2d3-9583-469a-93f0-abc969104369 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:16.100933 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe2d3-9583-469a-93f0-abc969104369 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:16.101387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe2d3-9583-469a-93f0-abc969104369 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:16.102858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fe2d3-9583-469a-93f0-abc969104369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:16.105504 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fe2d3-9583-469a-93f0-abc969104369 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:16.234129 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fedb1-3243-4fa7-8364-676f07124d6b None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:16.250283 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 826/1665] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:15 2022] POST /identity/v3/users => generated 302 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:56:16.251639 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fe2d3-9583-469a-93f0-abc969104369 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:16.262299 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ba3e3-bf2b-417a-8d35-88c73bd9151d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:16.263044 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ba3e3-bf2b-417a-8d35-88c73bd9151d service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:16.263325 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ba3e3-bf2b-417a-8d35-88c73bd9151d service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:16.263601 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ba3e3-bf2b-417a-8d35-88c73bd9151d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:16.279812 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fe2d3-9583-469a-93f0-abc969104369 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:16.301877 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d00251-949b-4a17-90fb-aed7cb5e6b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:16.303100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d00251-949b-4a17-90fb-aed7cb5e6b0f admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:16.303390 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d00251-949b-4a17-90fb-aed7cb5e6b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:16.303665 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d00251-949b-4a17-90fb-aed7cb5e6b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:16.307283 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ba3e3-bf2b-417a-8d35-88c73bd9151d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:16.309033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ba3e3-bf2b-417a-8d35-88c73bd9151d service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:16.313042 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d00251-949b-4a17-90fb-aed7cb5e6b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:16.314814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d00251-949b-4a17-90fb-aed7cb5e6b0f admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:16.345512 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 840/1666] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:16.356064 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 827/1667] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:56:16.356996 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ba3e3-bf2b-417a-8d35-88c73bd9151d service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:16.376627 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ba3e3-bf2b-417a-8d35-88c73bd9151d service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:16.398212 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0133663-4a88-4153-a31e-48d5b5c3e32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:16.401304 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0133663-4a88-4153-a31e-48d5b5c3e32a admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:16.403880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0133663-4a88-4153-a31e-48d5b5c3e32a admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:16.406362 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0133663-4a88-4153-a31e-48d5b5c3e32a admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:16.406362 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0133663-4a88-4153-a31e-48d5b5c3e32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:16.412738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0133663-4a88-4153-a31e-48d5b5c3e32a admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:16.452662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d00251-949b-4a17-90fb-aed7cb5e6b0f admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:16.453514 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 841/1668] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:16.467829 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d00251-949b-4a17-90fb-aed7cb5e6b0f admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:16.479706 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6de190-ac8d-4e1d-8c7a-212300b6e8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:16.480716 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6de190-ac8d-4e1d-8c7a-212300b6e8fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:16.481482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6de190-ac8d-4e1d-8c7a-212300b6e8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:16.481482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6de190-ac8d-4e1d-8c7a-212300b6e8fa admin admin] PATH_INFO: `/v3/projects/aaf3299c044c464a876701dad3b74af5/users/74f5449cae2a44099b93be218312a588/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:16.499699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6de190-ac8d-4e1d-8c7a-212300b6e8fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf3299c044c464a876701dad3b74af5, user_id=74f5449cae2a44099b93be218312a588, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:16.503694 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6de190-ac8d-4e1d-8c7a-212300b6e8fa admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:16.620029 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 828/1669] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:16 2022] PUT /identity/v3/projects/aaf3299c044c464a876701dad3b74af5/users/74f5449cae2a44099b93be218312a588/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:56:16.632558 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083887e6-cca9-4432-8b74-db6b1b3820f4 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:16.633162 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083887e6-cca9-4432-8b74-db6b1b3820f4 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:16.633555 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083887e6-cca9-4432-8b74-db6b1b3820f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:16.700784 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-083887e6-cca9-4432-8b74-db6b1b3820f4 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:16.703254 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-083887e6-cca9-4432-8b74-db6b1b3820f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:17.079839 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 842/1670] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:17.142898 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6de190-ac8d-4e1d-8c7a-212300b6e8fa admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:17.294893 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6de190-ac8d-4e1d-8c7a-212300b6e8fa admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:17.308334 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10701208-612d-4024-b99c-84591be113b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:17.309243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10701208-612d-4024-b99c-84591be113b4 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:17.309631 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10701208-612d-4024-b99c-84591be113b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:17.310009 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10701208-612d-4024-b99c-84591be113b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:17.340316 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10701208-612d-4024-b99c-84591be113b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:17.342634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10701208-612d-4024-b99c-84591be113b4 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:17.365611 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 829/1671] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:18.278539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083887e6-cca9-4432-8b74-db6b1b3820f4 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:18.280187 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-083887e6-cca9-4432-8b74-db6b1b3820f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:18.305018 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083887e6-cca9-4432-8b74-db6b1b3820f4 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:18.323638 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188d093-d37d-440e-9bfa-a2f3a02c3d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:18.327544 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188d093-d37d-440e-9bfa-a2f3a02c3d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:18.329096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188d093-d37d-440e-9bfa-a2f3a02c3d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:18.329389 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188d093-d37d-440e-9bfa-a2f3a02c3d10 admin admin] PATH_INFO: `/v3/projects/9b0146753d9c4364a672742dcb01e8e3` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:18.333242 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188d093-d37d-440e-9bfa-a2f3a02c3d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b0146753d9c4364a672742dcb01e8e3)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:18.341412 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188d093-d37d-440e-9bfa-a2f3a02c3d10 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:18.500205 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875dce7-ac98-4e22-a0c7-d6156eb77cbc None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:18.500787 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875dce7-ac98-4e22-a0c7-d6156eb77cbc None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:18.500787 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875dce7-ac98-4e22-a0c7-d6156eb77cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:18.557766 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4188d093-d37d-440e-9bfa-a2f3a02c3d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b0146753d9c4364a672742dcb01e8e3', 'request_id': 'req-4188d093-d37d-440e-9bfa-a2f3a02c3d10'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:18.560251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-e875dce7-ac98-4e22-a0c7-d6156eb77cbc None None] MFA Rules not processed for user `1144e9036d0b4bafb30995ff1a8449ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:18.561671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e875dce7-ac98-4e22-a0c7-d6156eb77cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:18.644982 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4188d093-d37d-440e-9bfa-a2f3a02c3d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b0146753d9c4364a672742dcb01e8e3', 'request_id': 'req-4188d093-d37d-440e-9bfa-a2f3a02c3d10'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:18.655639 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4188d093-d37d-440e-9bfa-a2f3a02c3d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b0146753d9c4364a672742dcb01e8e3', 'request_id': 'req-4188d093-d37d-440e-9bfa-a2f3a02c3d10'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:18.697065 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4188d093-d37d-440e-9bfa-a2f3a02c3d10 admin admin] The token cache is being invalidate because project 9b0146753d9c4364a672742dcb01e8e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:18.697292 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4188d093-d37d-440e-9bfa-a2f3a02c3d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:18.698133 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4188d093-d37d-440e-9bfa-a2f3a02c3d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:18.699885 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 843/1672] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:18 2022] DELETE /identity/v3/projects/9b0146753d9c4364a672742dcb01e8e3 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:18.704805 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae33c8-cad8-4ebc-aded-a6dce44b7450 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:18.706723 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae33c8-cad8-4ebc-aded-a6dce44b7450 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:18.707181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae33c8-cad8-4ebc-aded-a6dce44b7450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:18.760725 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-8bae33c8-cad8-4ebc-aded-a6dce44b7450 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:18.772223 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8bae33c8-cad8-4ebc-aded-a6dce44b7450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:18.800981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 830/1673] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Apr 14 21:56:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:56:18.954558 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 844/1674] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:18.962491 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4e3d5-4bb2-437d-a664-8cf29750c4e2 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:18.962781 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4e3d5-4bb2-437d-a664-8cf29750c4e2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:18.963062 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4e3d5-4bb2-437d-a664-8cf29750c4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:18.999337 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-86c4e3d5-4bb2-437d-a664-8cf29750c4e2 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:19.000916 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-86c4e3d5-4bb2-437d-a664-8cf29750c4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:19.020883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 831/1675] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:19.025711 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae33c8-cad8-4ebc-aded-a6dce44b7450 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:19.041871 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae33c8-cad8-4ebc-aded-a6dce44b7450 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:19.058956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43893ea9-bf55-4c88-8c71-7b3c1a3de792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:19.059642 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43893ea9-bf55-4c88-8c71-7b3c1a3de792 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:19.059926 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43893ea9-bf55-4c88-8c71-7b3c1a3de792 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:19.060700 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43893ea9-bf55-4c88-8c71-7b3c1a3de792 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:19.077400 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43893ea9-bf55-4c88-8c71-7b3c1a3de792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:19.077815 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43893ea9-bf55-4c88-8c71-7b3c1a3de792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:19.081383 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43893ea9-bf55-4c88-8c71-7b3c1a3de792 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:19.113092 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 845/1676] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:19.117952 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4e3d5-4bb2-437d-a664-8cf29750c4e2 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:19.133106 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4e3d5-4bb2-437d-a664-8cf29750c4e2 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:19.148926 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d8003-d0ce-4a61-a928-ba2651234cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:19.149810 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d8003-d0ce-4a61-a928-ba2651234cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:19.150368 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d8003-d0ce-4a61-a928-ba2651234cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:19.150800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d8003-d0ce-4a61-a928-ba2651234cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:19.152229 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d8003-d0ce-4a61-a928-ba2651234cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:19.155082 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d8003-d0ce-4a61-a928-ba2651234cc8 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:19.185955 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd626e0-4001-4b42-a6d1-1471472d64c5 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:19.188944 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd626e0-4001-4b42-a6d1-1471472d64c5 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:19.191261 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd626e0-4001-4b42-a6d1-1471472d64c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:19.253251 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-ecd626e0-4001-4b42-a6d1-1471472d64c5 None None] MFA Rules not processed for user `5fe1c344dfc940479b4ed781461bd89b`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:19.254944 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ecd626e0-4001-4b42-a6d1-1471472d64c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:19.280197 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 832/1677] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:19 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:56:19.284209 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d8003-d0ce-4a61-a928-ba2651234cc8 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:19.376825 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 846/1678] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:19.381937 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd626e0-4001-4b42-a6d1-1471472d64c5 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:19.384164 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ecd626e0-4001-4b42-a6d1-1471472d64c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:19.473059 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d8003-d0ce-4a61-a928-ba2651234cc8 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:19.488005 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a5b7b-e2df-42aa-ae3b-be7d02ca3cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:19.489883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a5b7b-e2df-42aa-ae3b-be7d02ca3cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:19.489883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a5b7b-e2df-42aa-ae3b-be7d02ca3cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:19.491041 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a5b7b-e2df-42aa-ae3b-be7d02ca3cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:19.491782 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a5b7b-e2df-42aa-ae3b-be7d02ca3cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:19.495702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a5b7b-e2df-42aa-ae3b-be7d02ca3cb8 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:19.569275 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd626e0-4001-4b42-a6d1-1471472d64c5 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:19.588882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 833/1679] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:19 2022] POST /identity/v3/users => generated 287 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:19.593743 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a5b7b-e2df-42aa-ae3b-be7d02ca3cb8 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:19.605395 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-da6a5b7b-e2df-42aa-ae3b-be7d02ca3cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:19.729104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488a214-9fa2-4b05-9052-0e31dc7aa453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:19.730003 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488a214-9fa2-4b05-9052-0e31dc7aa453 service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:19.731341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488a214-9fa2-4b05-9052-0e31dc7aa453 service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:19.731770 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488a214-9fa2-4b05-9052-0e31dc7aa453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:19.786740 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a5b7b-e2df-42aa-ae3b-be7d02ca3cb8 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:19.795437 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67126f39-2ecb-43ed-8798-fe643ebcf789 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bf55488d046c4be98a903d113c0fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:19.796548 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67126f39-2ecb-43ed-8798-fe643ebcf789 service swift] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:19.797051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67126f39-2ecb-43ed-8798-fe643ebcf789 service swift] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:19.797333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67126f39-2ecb-43ed-8798-fe643ebcf789 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:19.866566 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488a214-9fa2-4b05-9052-0e31dc7aa453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:19.868725 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488a214-9fa2-4b05-9052-0e31dc7aa453 service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:19.882665 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 847/1680] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:19.883553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488a214-9fa2-4b05-9052-0e31dc7aa453 service nova] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:19.890221 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67126f39-2ecb-43ed-8798-fe643ebcf789 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:19.891921 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67126f39-2ecb-43ed-8798-fe643ebcf789 service swift] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:19.895445 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488a214-9fa2-4b05-9052-0e31dc7aa453 service nova] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:19.902717 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa5baa-b285-4412-a1ae-97fc9bf76094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:19.903406 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa5baa-b285-4412-a1ae-97fc9bf76094 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:19.903687 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa5baa-b285-4412-a1ae-97fc9bf76094 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:19.903965 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa5baa-b285-4412-a1ae-97fc9bf76094 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:19.904771 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa5baa-b285-4412-a1ae-97fc9bf76094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:19.905429 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 834/1681] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Apr 14 21:56:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 14 21:56:19.906367 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa5baa-b285-4412-a1ae-97fc9bf76094 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:19.920187 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 848/1682] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:19.926463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67126f39-2ecb-43ed-8798-fe643ebcf789 service swift] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:19.945788 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67126f39-2ecb-43ed-8798-fe643ebcf789 service swift] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:19.951738 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28727f18-e2c9-4753-9c25-16faec918618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:19.952563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28727f18-e2c9-4753-9c25-16faec918618 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:19.952943 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28727f18-e2c9-4753-9c25-16faec918618 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:19.953308 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28727f18-e2c9-4753-9c25-16faec918618 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:19.954739 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28727f18-e2c9-4753-9c25-16faec918618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:19.956677 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28727f18-e2c9-4753-9c25-16faec918618 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:19.979425 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 835/1683] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:19.991340 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa5baa-b285-4412-a1ae-97fc9bf76094 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:20.007798 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa5baa-b285-4412-a1ae-97fc9bf76094 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:20.015382 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e36f63-6dbd-4144-8fb6-80859bc487ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:20.016689 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e36f63-6dbd-4144-8fb6-80859bc487ad admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:20.017073 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e36f63-6dbd-4144-8fb6-80859bc487ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:20.017462 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e36f63-6dbd-4144-8fb6-80859bc487ad admin admin] PATH_INFO: `/v3/projects/ab07c0fcae554bf28086e1926b20547d/users/0452ad33fd864021812204dd05210475/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:20.081026 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e36f63-6dbd-4144-8fb6-80859bc487ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab07c0fcae554bf28086e1926b20547d, user_id=0452ad33fd864021812204dd05210475, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:20.088400 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e36f63-6dbd-4144-8fb6-80859bc487ad admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:20.193017 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 849/1684] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:19 2022] PUT /identity/v3/projects/ab07c0fcae554bf28086e1926b20547d/users/0452ad33fd864021812204dd05210475/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:20.210230 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05468d0b-c70e-48b5-8094-e7e5430516f3 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:20.210764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05468d0b-c70e-48b5-8094-e7e5430516f3 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:20.211492 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05468d0b-c70e-48b5-8094-e7e5430516f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:20.285393 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-05468d0b-c70e-48b5-8094-e7e5430516f3 None None] MFA Rules not processed for user `0452ad33fd864021812204dd05210475`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:20.289716 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-05468d0b-c70e-48b5-8094-e7e5430516f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:20.459582 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 836/1685] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:20.463811 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e36f63-6dbd-4144-8fb6-80859bc487ad admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:20.649865 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e36f63-6dbd-4144-8fb6-80859bc487ad admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:20.655178 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d202d-2ae8-4458-86da-fb29134c5751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:20.656351 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d202d-2ae8-4458-86da-fb29134c5751 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:20.656714 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d202d-2ae8-4458-86da-fb29134c5751 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:20.657270 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d202d-2ae8-4458-86da-fb29134c5751 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:20.658213 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d202d-2ae8-4458-86da-fb29134c5751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:20.660284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d202d-2ae8-4458-86da-fb29134c5751 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:20.770959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 850/1686] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:20 2022] POST /identity/v3/projects => generated 373 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:20.775221 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05468d0b-c70e-48b5-8094-e7e5430516f3 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:20.795917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05468d0b-c70e-48b5-8094-e7e5430516f3 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:20.929946 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb697b6a-824a-4684-b239-494c204d2cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:20.930650 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb697b6a-824a-4684-b239-494c204d2cec admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:20.931093 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb697b6a-824a-4684-b239-494c204d2cec admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:20.931509 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb697b6a-824a-4684-b239-494c204d2cec admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:20.932375 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb697b6a-824a-4684-b239-494c204d2cec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:20.939035 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb697b6a-824a-4684-b239-494c204d2cec admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:21.040594 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 837/1687] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:20 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:21.044713 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d202d-2ae8-4458-86da-fb29134c5751 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:21.066374 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d202d-2ae8-4458-86da-fb29134c5751 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:21.077721 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9fa018-2d9c-4c9c-b8c7-7f7aeebcc9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:21.078876 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fa018-2d9c-4c9c-b8c7-7f7aeebcc9ec admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:21.079793 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fa018-2d9c-4c9c-b8c7-7f7aeebcc9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:21.080180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fa018-2d9c-4c9c-b8c7-7f7aeebcc9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:21.082120 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fa018-2d9c-4c9c-b8c7-7f7aeebcc9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:21.085566 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fa018-2d9c-4c9c-b8c7-7f7aeebcc9ec admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:21.112926 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 851/1688] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:21.114327 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb697b6a-824a-4684-b239-494c204d2cec admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:21.133370 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb697b6a-824a-4684-b239-494c204d2cec admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:21.147310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f4093-88a0-45d1-9593-f1e048dc7cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:21.148546 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4093-88a0-45d1-9593-f1e048dc7cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:21.150717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4093-88a0-45d1-9593-f1e048dc7cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:21.151259 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4093-88a0-45d1-9593-f1e048dc7cdc admin admin] PATH_INFO: `/v3/projects/5ecd1da1c0fe41cd8a1d9b33720f8412/users/1d9520a7b8a34e3fa55c6e0758b70cea/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:21.185538 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f4093-88a0-45d1-9593-f1e048dc7cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecd1da1c0fe41cd8a1d9b33720f8412, user_id=1d9520a7b8a34e3fa55c6e0758b70cea, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:21.210123 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f4093-88a0-45d1-9593-f1e048dc7cdc admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:21.307275 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52caa6-1f24-49c4-95b8-1e2d926589a2 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:21.307766 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52caa6-1f24-49c4-95b8-1e2d926589a2 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:21.308304 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52caa6-1f24-49c4-95b8-1e2d926589a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:21.326401 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 838/1689] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:21 2022] PUT /identity/v3/projects/5ecd1da1c0fe41cd8a1d9b33720f8412/users/1d9520a7b8a34e3fa55c6e0758b70cea/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:56:21.330772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f4093-88a0-45d1-9593-f1e048dc7cdc admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:21.375443 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-1f52caa6-1f24-49c4-95b8-1e2d926589a2 None None] MFA Rules not processed for user `74f5449cae2a44099b93be218312a588`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:21.377142 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-1f52caa6-1f24-49c4-95b8-1e2d926589a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:21.506179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f4093-88a0-45d1-9593-f1e048dc7cdc admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:21.529166 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e1ce5-30e2-45fc-ae85-8bb42e1696fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:21.530169 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e1ce5-30e2-45fc-ae85-8bb42e1696fd admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:21.531467 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e1ce5-30e2-45fc-ae85-8bb42e1696fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:21.533454 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e1ce5-30e2-45fc-ae85-8bb42e1696fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:21.534924 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e1ce5-30e2-45fc-ae85-8bb42e1696fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:21.543573 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e1ce5-30e2-45fc-ae85-8bb42e1696fd admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:21.555167 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 852/1690] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:56:21.560229 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52caa6-1f24-49c4-95b8-1e2d926589a2 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:21.568743 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-1f52caa6-1f24-49c4-95b8-1e2d926589a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:21.581422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 839/1691] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:21.588165 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e1ce5-30e2-45fc-ae85-8bb42e1696fd admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:21.614731 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52caa6-1f24-49c4-95b8-1e2d926589a2 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:21.617133 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e1ce5-30e2-45fc-ae85-8bb42e1696fd admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:21.632356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeac9e-242f-4354-9737-00ddb7ae707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:21.632475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e992f-9924-40af-be08-eea8fa4a6d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:21.632475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e992f-9924-40af-be08-eea8fa4a6d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:21.632475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e992f-9924-40af-be08-eea8fa4a6d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:21.632475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e992f-9924-40af-be08-eea8fa4a6d9a admin admin] PATH_INFO: `/v3/projects/5ecd1da1c0fe41cd8a1d9b33720f8412/users/1d9520a7b8a34e3fa55c6e0758b70cea/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:21.632745 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeac9e-242f-4354-9737-00ddb7ae707b admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:21.632745 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeac9e-242f-4354-9737-00ddb7ae707b admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:21.632745 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeac9e-242f-4354-9737-00ddb7ae707b admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:21.633214 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caeac9e-242f-4354-9737-00ddb7ae707b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:21.635110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caeac9e-242f-4354-9737-00ddb7ae707b admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:21.638039 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e992f-9924-40af-be08-eea8fa4a6d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecd1da1c0fe41cd8a1d9b33720f8412, user_id=1d9520a7b8a34e3fa55c6e0758b70cea, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:21.641202 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e992f-9924-40af-be08-eea8fa4a6d9a admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:21.675498 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 840/1692] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:21 2022] PUT /identity/v3/projects/5ecd1da1c0fe41cd8a1d9b33720f8412/users/1d9520a7b8a34e3fa55c6e0758b70cea/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:56:21.686863 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8f76e-1df7-4fb2-8d17-4ffc3ce873c5 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:21.687281 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8f76e-1df7-4fb2-8d17-4ffc3ce873c5 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:21.687567 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8f76e-1df7-4fb2-8d17-4ffc3ce873c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:21.722267 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-bff8f76e-1df7-4fb2-8d17-4ffc3ce873c5 None None] MFA Rules not processed for user `1d9520a7b8a34e3fa55c6e0758b70cea`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:21.723642 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-bff8f76e-1df7-4fb2-8d17-4ffc3ce873c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:21.770096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 853/1693] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:21 2022] POST /identity/v3/projects => generated 403 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:21.774568 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeac9e-242f-4354-9737-00ddb7ae707b admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:21.877501 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 841/1694] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:56:21.887985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8f76e-1df7-4fb2-8d17-4ffc3ce873c5 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:21.891227 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-bff8f76e-1df7-4fb2-8d17-4ffc3ce873c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:21.910507 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeac9e-242f-4354-9737-00ddb7ae707b admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:21.921715 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b570af6-f7a8-4583-ade6-4864c5ea5e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:21.923186 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b570af6-f7a8-4583-ade6-4864c5ea5e3e admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:21.923718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b570af6-f7a8-4583-ade6-4864c5ea5e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:21.924233 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b570af6-f7a8-4583-ade6-4864c5ea5e3e admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:21.925203 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b570af6-f7a8-4583-ade6-4864c5ea5e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:21.928242 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b570af6-f7a8-4583-ade6-4864c5ea5e3e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:21.994744 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8f76e-1df7-4fb2-8d17-4ffc3ce873c5 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:22.018229 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 854/1695] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:21 2022] POST /identity/v3/users => generated 308 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:22.019274 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b570af6-f7a8-4583-ade6-4864c5ea5e3e admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:22.033078 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b570af6-f7a8-4583-ade6-4864c5ea5e3e admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:22.038414 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f51143-b217-4301-88d6-a7979f88b31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:22.039264 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f51143-b217-4301-88d6-a7979f88b31d admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:22.039554 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f51143-b217-4301-88d6-a7979f88b31d admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:22.040039 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f51143-b217-4301-88d6-a7979f88b31d admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:22.040927 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f51143-b217-4301-88d6-a7979f88b31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:22.043003 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f51143-b217-4301-88d6-a7979f88b31d admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:22.064104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 855/1696] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:22.069860 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f51143-b217-4301-88d6-a7979f88b31d admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:22.088437 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f51143-b217-4301-88d6-a7979f88b31d admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:22.097033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2048dd-4841-4cca-bb20-ef0f0b3febb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:22.098086 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2048dd-4841-4cca-bb20-ef0f0b3febb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:22.098438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2048dd-4841-4cca-bb20-ef0f0b3febb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:22.099605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2048dd-4841-4cca-bb20-ef0f0b3febb9 admin admin] PATH_INFO: `/v3/projects/9e503fff72104d7c9744e12477ad9ef6/users/a857ed46558c46d7ad9068111d3055c5/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:22.112795 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3080d-b4e1-45b6-8e02-65b93bf89923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:22.113620 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3080d-b4e1-45b6-8e02-65b93bf89923 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:22.113918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3080d-b4e1-45b6-8e02-65b93bf89923 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:22.114264 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3080d-b4e1-45b6-8e02-65b93bf89923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:22.120253 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2048dd-4841-4cca-bb20-ef0f0b3febb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e503fff72104d7c9744e12477ad9ef6, user_id=a857ed46558c46d7ad9068111d3055c5, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:22.123184 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2048dd-4841-4cca-bb20-ef0f0b3febb9 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:22.192435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3080d-b4e1-45b6-8e02-65b93bf89923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:22.194527 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3080d-b4e1-45b6-8e02-65b93bf89923 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:22.204983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 842/1697] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:22.216888 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 856/1698] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:22 2022] PUT /identity/v3/projects/9e503fff72104d7c9744e12477ad9ef6/users/a857ed46558c46d7ad9068111d3055c5/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:22.220847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3080d-b4e1-45b6-8e02-65b93bf89923 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:22.232412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3080d-b4e1-45b6-8e02-65b93bf89923 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:22.480938 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310f476-0d2c-45a5-8570-e6b1594bce59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:22.484955 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310f476-0d2c-45a5-8570-e6b1594bce59 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:22.486185 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310f476-0d2c-45a5-8570-e6b1594bce59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:22.501801 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310f476-0d2c-45a5-8570-e6b1594bce59 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:22.502909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310f476-0d2c-45a5-8570-e6b1594bce59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:22.504491 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310f476-0d2c-45a5-8570-e6b1594bce59 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:22.523529 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 843/1699] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:22.527484 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2048dd-4841-4cca-bb20-ef0f0b3febb9 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:22.557185 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2048dd-4841-4cca-bb20-ef0f0b3febb9 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:22.571269 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7d109-9417-4092-8e92-7e6af803deb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:22.572228 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7d109-9417-4092-8e92-7e6af803deb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:22.572515 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7d109-9417-4092-8e92-7e6af803deb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:22.572823 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7d109-9417-4092-8e92-7e6af803deb6 admin admin] PATH_INFO: `/v3/projects/9e503fff72104d7c9744e12477ad9ef6/users/a857ed46558c46d7ad9068111d3055c5/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:22.575860 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7d109-9417-4092-8e92-7e6af803deb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e503fff72104d7c9744e12477ad9ef6, user_id=a857ed46558c46d7ad9068111d3055c5, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:22.579517 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7d109-9417-4092-8e92-7e6af803deb6 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:22.603662 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 857/1700] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:22 2022] PUT /identity/v3/projects/9e503fff72104d7c9744e12477ad9ef6/users/a857ed46558c46d7ad9068111d3055c5/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:23.435835 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a600a44-6eed-4ffc-876f-49838d9d4d39 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:23.435835 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a600a44-6eed-4ffc-876f-49838d9d4d39 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:23.435835 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a600a44-6eed-4ffc-876f-49838d9d4d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:23.495833 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-1a600a44-6eed-4ffc-876f-49838d9d4d39 None None] MFA Rules not processed for user `136152c5c06b4e44803b127e232ff865`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:23.497249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1a600a44-6eed-4ffc-876f-49838d9d4d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:23.632944 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cab02-65b6-4172-bb33-20c4086b0440 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:23.633808 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cab02-65b6-4172-bb33-20c4086b0440 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:23.634346 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cab02-65b6-4172-bb33-20c4086b0440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:23.638283 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 844/1701] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:23.675703 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-277cab02-65b6-4172-bb33-20c4086b0440 None None] MFA Rules not processed for user `136152c5c06b4e44803b127e232ff865`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:23.677391 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-277cab02-65b6-4172-bb33-20c4086b0440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:23.686933 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 858/1702] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:23.699277 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a600a44-6eed-4ffc-876f-49838d9d4d39 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:23.700814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1a600a44-6eed-4ffc-876f-49838d9d4d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:23.803810 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cab02-65b6-4172-bb33-20c4086b0440 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:23.919359 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a600a44-6eed-4ffc-876f-49838d9d4d39 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:23.932179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb218192-3c66-4f8d-9eb2-ed2907cfe97e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:23.933267 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb218192-3c66-4f8d-9eb2-ed2907cfe97e service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:23.935455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb218192-3c66-4f8d-9eb2-ed2907cfe97e service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:23.935956 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb218192-3c66-4f8d-9eb2-ed2907cfe97e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:23.938894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cab02-65b6-4172-bb33-20c4086b0440 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:23.952696 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb888b7-ae99-46ae-9fe5-a8281805c71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:23.953888 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb888b7-ae99-46ae-9fe5-a8281805c71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:23.954350 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb888b7-ae99-46ae-9fe5-a8281805c71c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:23.954766 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb888b7-ae99-46ae-9fe5-a8281805c71c admin admin] PATH_INFO: `/v3/users/0452ad33fd864021812204dd05210475` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:23.959449 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb888b7-ae99-46ae-9fe5-a8281805c71c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0452ad33fd864021812204dd05210475)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:23.964794 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb888b7-ae99-46ae-9fe5-a8281805c71c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:23.966960 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb218192-3c66-4f8d-9eb2-ed2907cfe97e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:23.969770 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb218192-3c66-4f8d-9eb2-ed2907cfe97e service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:23.993403 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 845/1703] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:56:24.280991 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-7eb888b7-ae99-46ae-9fe5-a8281805c71c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0452ad33fd864021812204dd05210475'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:24.282444 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-7eb888b7-ae99-46ae-9fe5-a8281805c71c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0452ad33fd864021812204dd05210475'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:24.319346 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-7eb888b7-ae99-46ae-9fe5-a8281805c71c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0452ad33fd864021812204dd05210475'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:24.473246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-7eb888b7-ae99-46ae-9fe5-a8281805c71c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0452ad33fd864021812204dd05210475'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:24.473246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-7eb888b7-ae99-46ae-9fe5-a8281805c71c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0452ad33fd864021812204dd05210475'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:24.770795 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 859/1704] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:23 2022] DELETE /identity/v3/users/0452ad33fd864021812204dd05210475 => generated 0 bytes in 968 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:56:24.777261 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3ce83-6c5e-45bd-a5d4-e28d848c5090 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:24.778768 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3ce83-6c5e-45bd-a5d4-e28d848c5090 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:24.779509 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3ce83-6c5e-45bd-a5d4-e28d848c5090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:24.842933 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-e5a3ce83-6c5e-45bd-a5d4-e28d848c5090 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:24.845839 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e5a3ce83-6c5e-45bd-a5d4-e28d848c5090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:25.003436 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707b806-1b25-435c-bea4-5c1841609e8f None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:25.004119 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707b806-1b25-435c-bea4-5c1841609e8f None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:25.004837 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707b806-1b25-435c-bea4-5c1841609e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:25.035776 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 846/1705] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:25.039490 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-8707b806-1b25-435c-bea4-5c1841609e8f None None] MFA Rules not processed for user `1bfbd6a387e44037a58e521230783347`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:25.041321 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8707b806-1b25-435c-bea4-5c1841609e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:25.050768 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3ce83-6c5e-45bd-a5d4-e28d848c5090 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:25.052333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e5a3ce83-6c5e-45bd-a5d4-e28d848c5090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:25.222484 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 860/1706] 10.222.0.81 () {58 vars in 1015 bytes} [Thu Apr 14 21:56:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:25.283853 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707b806-1b25-435c-bea4-5c1841609e8f None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:25.285479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8707b806-1b25-435c-bea4-5c1841609e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:25.288532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3ce83-6c5e-45bd-a5d4-e28d848c5090 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:25.307042 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667a721-3f75-4a18-b18d-62e4b116f9a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:25.307042 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667a721-3f75-4a18-b18d-62e4b116f9a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:25.307042 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667a721-3f75-4a18-b18d-62e4b116f9a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:25.307042 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667a721-3f75-4a18-b18d-62e4b116f9a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:25.315012 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707b806-1b25-435c-bea4-5c1841609e8f None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:25.337951 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166d0e1-ca8c-4d9b-b6ab-ab2cbcc51b49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:25.338793 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d0e1-ca8c-4d9b-b6ab-ab2cbcc51b49 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:25.338926 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667a721-3f75-4a18-b18d-62e4b116f9a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:25.339265 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d0e1-ca8c-4d9b-b6ab-ab2cbcc51b49 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:25.339672 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d0e1-ca8c-4d9b-b6ab-ab2cbcc51b49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:25.341063 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667a721-3f75-4a18-b18d-62e4b116f9a7 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:25.370117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166d0e1-ca8c-4d9b-b6ab-ab2cbcc51b49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:25.377924 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166d0e1-ca8c-4d9b-b6ab-ab2cbcc51b49 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:25.391246 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 847/1707] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:56:25.402923 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 861/1708] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:26.259274 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3672227-ad22-4811-b95d-0eedc6239857 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:26.259873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3672227-ad22-4811-b95d-0eedc6239857 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:26.259873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3672227-ad22-4811-b95d-0eedc6239857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:26.311306 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d3672227-ad22-4811-b95d-0eedc6239857 None None] MFA Rules not processed for user `136152c5c06b4e44803b127e232ff865`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:26.312847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d3672227-ad22-4811-b95d-0eedc6239857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:26.559757 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 848/1709] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:26.849132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b63a1a-b271-4d85-ae19-404e2aafc1b5 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:26.850668 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b63a1a-b271-4d85-ae19-404e2aafc1b5 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:26.851620 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b63a1a-b271-4d85-ae19-404e2aafc1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:26.941377 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-33b63a1a-b271-4d85-ae19-404e2aafc1b5 None None] MFA Rules not processed for user `5fe1c344dfc940479b4ed781461bd89b`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:26.948364 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-33b63a1a-b271-4d85-ae19-404e2aafc1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:27.108598 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3672227-ad22-4811-b95d-0eedc6239857 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:27.111389 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d3672227-ad22-4811-b95d-0eedc6239857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:27.174687 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3672227-ad22-4811-b95d-0eedc6239857 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:27.193680 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391ee98-3bb0-4afd-8ed2-bea82470995d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:27.195770 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391ee98-3bb0-4afd-8ed2-bea82470995d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:27.198349 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391ee98-3bb0-4afd-8ed2-bea82470995d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:27.199324 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391ee98-3bb0-4afd-8ed2-bea82470995d admin admin] PATH_INFO: `/v3/projects/ab07c0fcae554bf28086e1926b20547d` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:27.204514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391ee98-3bb0-4afd-8ed2-bea82470995d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab07c0fcae554bf28086e1926b20547d)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:27.231066 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391ee98-3bb0-4afd-8ed2-bea82470995d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:27.290256 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 862/1710] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:27.529505 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-b391ee98-3bb0-4afd-8ed2-bea82470995d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab07c0fcae554bf28086e1926b20547d', 'request_id': 'req-b391ee98-3bb0-4afd-8ed2-bea82470995d'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:27.562309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d8407-2a8b-4f33-bff5-fd77a61f2bc7 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:27.562616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d8407-2a8b-4f33-bff5-fd77a61f2bc7 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:27.562890 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d8407-2a8b-4f33-bff5-fd77a61f2bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:27.633260 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-b391ee98-3bb0-4afd-8ed2-bea82470995d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab07c0fcae554bf28086e1926b20547d', 'request_id': 'req-b391ee98-3bb0-4afd-8ed2-bea82470995d'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:27.643653 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-b391ee98-3bb0-4afd-8ed2-bea82470995d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab07c0fcae554bf28086e1926b20547d', 'request_id': 'req-b391ee98-3bb0-4afd-8ed2-bea82470995d'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:27.743674 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-b391ee98-3bb0-4afd-8ed2-bea82470995d admin admin] The token cache is being invalidate because project ab07c0fcae554bf28086e1926b20547d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:27.743982 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-b391ee98-3bb0-4afd-8ed2-bea82470995d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:27.749127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-b391ee98-3bb0-4afd-8ed2-bea82470995d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:27.757548 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-904d8407-2a8b-4f33-bff5-fd77a61f2bc7 None None] MFA Rules not processed for user `a857ed46558c46d7ad9068111d3055c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:27.777461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-904d8407-2a8b-4f33-bff5-fd77a61f2bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:27.778761 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 849/1711] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:27 2022] DELETE /identity/v3/projects/ab07c0fcae554bf28086e1926b20547d => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:27.784737 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391ee98-3bb0-4afd-8ed2-bea82470995d admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:27.790843 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b391ee98-3bb0-4afd-8ed2-bea82470995d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:28.197442 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391ee98-3bb0-4afd-8ed2-bea82470995d admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:28.221840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b3e7f-3e47-41fc-9fbb-e1d953f51ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:28.233374 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b3e7f-3e47-41fc-9fbb-e1d953f51ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:28.233979 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b3e7f-3e47-41fc-9fbb-e1d953f51ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:28.234446 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b3e7f-3e47-41fc-9fbb-e1d953f51ec5 admin admin] PATH_INFO: `/v3/users/1d9520a7b8a34e3fa55c6e0758b70cea` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:28.243847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b3e7f-3e47-41fc-9fbb-e1d953f51ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9520a7b8a34e3fa55c6e0758b70cea)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:28.246187 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b3e7f-3e47-41fc-9fbb-e1d953f51ec5 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:28.323892 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 863/1712] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 763 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:28.589521 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fd1b3e7f-3e47-41fc-9fbb-e1d953f51ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9520a7b8a34e3fa55c6e0758b70cea'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:28.591596 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fd1b3e7f-3e47-41fc-9fbb-e1d953f51ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9520a7b8a34e3fa55c6e0758b70cea'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:28.647956 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fd1b3e7f-3e47-41fc-9fbb-e1d953f51ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9520a7b8a34e3fa55c6e0758b70cea'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:28.688360 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fd1b3e7f-3e47-41fc-9fbb-e1d953f51ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9520a7b8a34e3fa55c6e0758b70cea'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:28.691218 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fd1b3e7f-3e47-41fc-9fbb-e1d953f51ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9520a7b8a34e3fa55c6e0758b70cea'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:28.831656 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 850/1713] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:27 2022] DELETE /identity/v3/users/1d9520a7b8a34e3fa55c6e0758b70cea => generated 0 bytes in 1043 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:28.840254 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d8407-2a8b-4f33-bff5-fd77a61f2bc7 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:28.844874 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-904d8407-2a8b-4f33-bff5-fd77a61f2bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:28.886630 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d8407-2a8b-4f33-bff5-fd77a61f2bc7 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:29.069410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d008b-feaa-43a5-99b8-0ce48a605096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:29.074052 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d008b-feaa-43a5-99b8-0ce48a605096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:29.075319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d008b-feaa-43a5-99b8-0ce48a605096 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:29.075319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d008b-feaa-43a5-99b8-0ce48a605096 admin admin] PATH_INFO: `/v3/users/2927bcaf59e74a15a6bf2a451e5560fd` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:29.077643 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d008b-feaa-43a5-99b8-0ce48a605096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2927bcaf59e74a15a6bf2a451e5560fd)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:29.082073 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d008b-feaa-43a5-99b8-0ce48a605096 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:29.456350 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-dd1d008b-feaa-43a5-99b8-0ce48a605096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2927bcaf59e74a15a6bf2a451e5560fd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:29.460328 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-dd1d008b-feaa-43a5-99b8-0ce48a605096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2927bcaf59e74a15a6bf2a451e5560fd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:29.512818 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-dd1d008b-feaa-43a5-99b8-0ce48a605096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2927bcaf59e74a15a6bf2a451e5560fd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:29.526777 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf283c5-c378-4839-8b83-eb284247f139 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:29.527429 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf283c5-c378-4839-8b83-eb284247f139 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:29.528067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf283c5-c378-4839-8b83-eb284247f139 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:29.530158 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 851/1714] 10.222.0.52 () {54 vars in 912 bytes} [Thu Apr 14 21:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:56:29.542731 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793ece8-2cbb-4082-8005-2ad9ca621cc5 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:29.543361 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793ece8-2cbb-4082-8005-2ad9ca621cc5 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:29.544033 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793ece8-2cbb-4082-8005-2ad9ca621cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:29.560822 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-dd1d008b-feaa-43a5-99b8-0ce48a605096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2927bcaf59e74a15a6bf2a451e5560fd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:29.565706 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-dd1d008b-feaa-43a5-99b8-0ce48a605096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2927bcaf59e74a15a6bf2a451e5560fd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:29.609851 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-9793ece8-2cbb-4082-8005-2ad9ca621cc5 None None] MFA Rules not processed for user `1bfbd6a387e44037a58e521230783347`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:29.619466 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9793ece8-2cbb-4082-8005-2ad9ca621cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:29.688638 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 864/1715] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:28 2022] DELETE /identity/v3/users/2927bcaf59e74a15a6bf2a451e5560fd => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:29.693871 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f80de-819b-466a-b06e-0603ed66ce25 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:29.695642 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f80de-819b-466a-b06e-0603ed66ce25 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:29.696049 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f80de-819b-466a-b06e-0603ed66ce25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:29.781586 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-c29f80de-819b-466a-b06e-0603ed66ce25 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:29.789119 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c29f80de-819b-466a-b06e-0603ed66ce25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:29.963394 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 852/1716] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Apr 14 21:56:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Apr 14 21:56:29.963394 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9c24f-d3ad-4650-bd4b-8826976f11a7 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:29.963394 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9c24f-d3ad-4650-bd4b-8826976f11a7 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:29.963394 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9c24f-d3ad-4650-bd4b-8826976f11a7 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:29.963394 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 853/1717] 10.222.0.52 () {54 vars in 921 bytes} [Thu Apr 14 21:56:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:56:30.006932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9c24f-d3ad-4650-bd4b-8826976f11a7 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:30.006932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-84a9c24f-d3ad-4650-bd4b-8826976f11a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:30.124381 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 865/1718] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:30.126161 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a18ca1-c864-41db-b268-74f04e793cad None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:30.128449 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a18ca1-c864-41db-b268-74f04e793cad None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:30.128958 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a18ca1-c864-41db-b268-74f04e793cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:30.159928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9c24f-d3ad-4650-bd4b-8826976f11a7 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:30.170571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde27f5-3688-481f-bbdb-af8cdc0424c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:30.172182 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde27f5-3688-481f-bbdb-af8cdc0424c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:30.173220 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde27f5-3688-481f-bbdb-af8cdc0424c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:30.173783 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-f3a18ca1-c864-41db-b268-74f04e793cad None None] MFA Rules not processed for user `e7f3ea629181433eb8c6d5dbc354c141`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:30.174097 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde27f5-3688-481f-bbdb-af8cdc0424c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:30.175054 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f3a18ca1-c864-41db-b268-74f04e793cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:30.220044 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde27f5-3688-481f-bbdb-af8cdc0424c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:30.221855 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde27f5-3688-481f-bbdb-af8cdc0424c0 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:30.257559 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 854/1719] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:56:30.345035 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde27f5-3688-481f-bbdb-af8cdc0424c0 service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:30.352037 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ecde27f5-3688-481f-bbdb-af8cdc0424c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:30.374285 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde27f5-3688-481f-bbdb-af8cdc0424c0 service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:30.394928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31597175-d07d-466a-9685-4e7569c10e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:30.395622 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31597175-d07d-466a-9685-4e7569c10e5a service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:30.401853 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31597175-d07d-466a-9685-4e7569c10e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:30.402137 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31597175-d07d-466a-9685-4e7569c10e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:30.435701 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 866/1720] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Apr 14 21:56:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:30.449749 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31597175-d07d-466a-9685-4e7569c10e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:30.456438 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31597175-d07d-466a-9685-4e7569c10e5a service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:30.480657 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 855/1721] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:30.655436 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a18ca1-c864-41db-b268-74f04e793cad None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:30.658459 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f3a18ca1-c864-41db-b268-74f04e793cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:30.707535 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a18ca1-c864-41db-b268-74f04e793cad None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:30.743445 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed03fe-794d-4003-aa83-d44101b6ca07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:30.745257 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed03fe-794d-4003-aa83-d44101b6ca07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:30.745724 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed03fe-794d-4003-aa83-d44101b6ca07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:30.749542 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed03fe-794d-4003-aa83-d44101b6ca07 admin admin] PATH_INFO: `/v3/projects/5ecd1da1c0fe41cd8a1d9b33720f8412` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:30.756897 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed03fe-794d-4003-aa83-d44101b6ca07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ecd1da1c0fe41cd8a1d9b33720f8412)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:30.759234 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed03fe-794d-4003-aa83-d44101b6ca07 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:31.026547 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-43ed03fe-794d-4003-aa83-d44101b6ca07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ecd1da1c0fe41cd8a1d9b33720f8412', 'request_id': 'req-43ed03fe-794d-4003-aa83-d44101b6ca07'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:31.171034 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-43ed03fe-794d-4003-aa83-d44101b6ca07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ecd1da1c0fe41cd8a1d9b33720f8412', 'request_id': 'req-43ed03fe-794d-4003-aa83-d44101b6ca07'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:31.202187 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-43ed03fe-794d-4003-aa83-d44101b6ca07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ecd1da1c0fe41cd8a1d9b33720f8412', 'request_id': 'req-43ed03fe-794d-4003-aa83-d44101b6ca07'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:31.251181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-43ed03fe-794d-4003-aa83-d44101b6ca07 admin admin] The token cache is being invalidate because project 5ecd1da1c0fe41cd8a1d9b33720f8412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:31.254878 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-43ed03fe-794d-4003-aa83-d44101b6ca07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:31.261656 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-43ed03fe-794d-4003-aa83-d44101b6ca07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:31.267258 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 867/1722] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:30 2022] DELETE /identity/v3/projects/5ecd1da1c0fe41cd8a1d9b33720f8412 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:31.274698 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df56a7-7639-423c-9005-7d33b3891eb1 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:31.276462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df56a7-7639-423c-9005-7d33b3891eb1 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:31.277260 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df56a7-7639-423c-9005-7d33b3891eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:31.353924 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-32df56a7-7639-423c-9005-7d33b3891eb1 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:31.356240 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-32df56a7-7639-423c-9005-7d33b3891eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:31.541229 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed03fe-794d-4003-aa83-d44101b6ca07 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:31.543853 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-43ed03fe-794d-4003-aa83-d44101b6ca07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:31.595695 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 856/1723] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:31.608033 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8fb4f-dcb0-43d6-b72b-01ef57a971db None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:31.608436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8fb4f-dcb0-43d6-b72b-01ef57a971db None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:31.608846 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8fb4f-dcb0-43d6-b72b-01ef57a971db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:31.657869 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-84c8fb4f-dcb0-43d6-b72b-01ef57a971db None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:31.664181 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-84c8fb4f-dcb0-43d6-b72b-01ef57a971db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:31.691869 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 857/1724] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:31.693681 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8fb4f-dcb0-43d6-b72b-01ef57a971db None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:31.719086 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8fb4f-dcb0-43d6-b72b-01ef57a971db None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:31.735959 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f3768-7b05-4fc1-9d79-bc9edc71da67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:31.735959 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f3768-7b05-4fc1-9d79-bc9edc71da67 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:31.735959 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f3768-7b05-4fc1-9d79-bc9edc71da67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:31.735959 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f3768-7b05-4fc1-9d79-bc9edc71da67 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:31.741859 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f3768-7b05-4fc1-9d79-bc9edc71da67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:31.742967 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f3768-7b05-4fc1-9d79-bc9edc71da67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:31.748971 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f3768-7b05-4fc1-9d79-bc9edc71da67 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:31.791662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 858/1725] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:56:31.792891 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f3768-7b05-4fc1-9d79-bc9edc71da67 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:31.827284 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f3768-7b05-4fc1-9d79-bc9edc71da67 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:31.839621 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0046f-27c2-4b3e-80fb-a5d957750cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:31.840486 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0046f-27c2-4b3e-80fb-a5d957750cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:31.840943 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0046f-27c2-4b3e-80fb-a5d957750cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:31.841287 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0046f-27c2-4b3e-80fb-a5d957750cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:31.842497 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0046f-27c2-4b3e-80fb-a5d957750cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:31.844531 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0046f-27c2-4b3e-80fb-a5d957750cf5 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:31.861648 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed03fe-794d-4003-aa83-d44101b6ca07 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:31.879296 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a7300-3b0c-4cef-97b9-8f3e4c1285bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:31.880232 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a7300-3b0c-4cef-97b9-8f3e4c1285bb service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:31.881245 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a7300-3b0c-4cef-97b9-8f3e4c1285bb service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:31.881533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a7300-3b0c-4cef-97b9-8f3e4c1285bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:31.891575 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-847a7300-3b0c-4cef-97b9-8f3e4c1285bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:31.930402 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a7300-3b0c-4cef-97b9-8f3e4c1285bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:31.936003 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a7300-3b0c-4cef-97b9-8f3e4c1285bb service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:31.954104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 868/1726] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:56:31.973595 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 859/1727] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:31 2022] POST /identity/v3/projects => generated 363 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:31.982159 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a7300-3b0c-4cef-97b9-8f3e4c1285bb service nova] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:31.999154 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a7300-3b0c-4cef-97b9-8f3e4c1285bb service nova] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:32.172556 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff93d9-05a6-4476-8fd0-24dec1007cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:32.173466 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff93d9-05a6-4476-8fd0-24dec1007cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:32.178180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff93d9-05a6-4476-8fd0-24dec1007cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:32.178180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff93d9-05a6-4476-8fd0-24dec1007cb7 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:32.178180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff93d9-05a6-4476-8fd0-24dec1007cb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:32.178180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff93d9-05a6-4476-8fd0-24dec1007cb7 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:32.332405 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 869/1728] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:31 2022] POST /identity/v3/users => generated 282 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:32.341239 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0046f-27c2-4b3e-80fb-a5d957750cf5 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:32.435477 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0046f-27c2-4b3e-80fb-a5d957750cf5 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:32.476954 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff93d9-05a6-4476-8fd0-24dec1007cb7 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:32.478780 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c7ff93d9-05a6-4476-8fd0-24dec1007cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:32.498979 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67726aa1-6d9f-4acc-ba03-0aa869d30436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:32.499677 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67726aa1-6d9f-4acc-ba03-0aa869d30436 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:32.502629 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67726aa1-6d9f-4acc-ba03-0aa869d30436 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:32.507568 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67726aa1-6d9f-4acc-ba03-0aa869d30436 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:32.508709 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67726aa1-6d9f-4acc-ba03-0aa869d30436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:32.530690 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff93d9-05a6-4476-8fd0-24dec1007cb7 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:32.531730 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67726aa1-6d9f-4acc-ba03-0aa869d30436 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:32.549813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7daa08-b87f-4092-9695-554169407d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:32.549813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7daa08-b87f-4092-9695-554169407d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:32.549813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7daa08-b87f-4092-9695-554169407d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:32.549813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7daa08-b87f-4092-9695-554169407d9c admin admin] PATH_INFO: `/v3/users/860bf509d22a4805859d346370f6fd9e` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:32.550478 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7daa08-b87f-4092-9695-554169407d9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=860bf509d22a4805859d346370f6fd9e)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:32.556139 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7daa08-b87f-4092-9695-554169407d9c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:32.560523 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 860/1729] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:32.566266 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67726aa1-6d9f-4acc-ba03-0aa869d30436 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:32.590802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67726aa1-6d9f-4acc-ba03-0aa869d30436 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:32.619434 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755156c-9ac3-43c6-9a7b-5d2dfea78318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:32.620429 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755156c-9ac3-43c6-9a7b-5d2dfea78318 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:32.620894 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755156c-9ac3-43c6-9a7b-5d2dfea78318 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:32.621375 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755156c-9ac3-43c6-9a7b-5d2dfea78318 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:32.622362 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755156c-9ac3-43c6-9a7b-5d2dfea78318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:32.624298 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755156c-9ac3-43c6-9a7b-5d2dfea78318 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:32.668246 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 861/1730] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:32.669483 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755156c-9ac3-43c6-9a7b-5d2dfea78318 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:32.689633 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755156c-9ac3-43c6-9a7b-5d2dfea78318 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:32.696743 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003df65-d238-47f2-90f2-dbd745db9751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:32.698515 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003df65-d238-47f2-90f2-dbd745db9751 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:32.698978 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003df65-d238-47f2-90f2-dbd745db9751 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:32.699885 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003df65-d238-47f2-90f2-dbd745db9751 admin admin] PATH_INFO: `/v3/projects/7e0b6448a5a342878ed1efe57c690efb/users/fab57dc77aaf4f9dbecef9c71748fde7/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:32.748105 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003df65-d238-47f2-90f2-dbd745db9751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0b6448a5a342878ed1efe57c690efb, user_id=fab57dc77aaf4f9dbecef9c71748fde7, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:32.760823 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003df65-d238-47f2-90f2-dbd745db9751 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:32.823491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9b7daa08-b87f-4092-9695-554169407d9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '860bf509d22a4805859d346370f6fd9e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:32.823491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9b7daa08-b87f-4092-9695-554169407d9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '860bf509d22a4805859d346370f6fd9e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:32.855422 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9b7daa08-b87f-4092-9695-554169407d9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '860bf509d22a4805859d346370f6fd9e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:32.892715 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9b7daa08-b87f-4092-9695-554169407d9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '860bf509d22a4805859d346370f6fd9e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:32.899363 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9b7daa08-b87f-4092-9695-554169407d9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '860bf509d22a4805859d346370f6fd9e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:32.929770 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 862/1731] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:32 2022] PUT /identity/v3/projects/7e0b6448a5a342878ed1efe57c690efb/users/fab57dc77aaf4f9dbecef9c71748fde7/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:32.931676 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1602269-2fbc-4b5c-aca7-926e7759f2db None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:32.932691 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1602269-2fbc-4b5c-aca7-926e7759f2db None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:32.933056 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1602269-2fbc-4b5c-aca7-926e7759f2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:33.006393 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-e1602269-2fbc-4b5c-aca7-926e7759f2db None None] MFA Rules not processed for user `fab57dc77aaf4f9dbecef9c71748fde7`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:33.008352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e1602269-2fbc-4b5c-aca7-926e7759f2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:33.059863 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 870/1732] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:32 2022] DELETE /identity/v3/users/860bf509d22a4805859d346370f6fd9e => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:33.067800 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdbf35-387a-4788-abce-de0d17cfef48 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:33.070010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdbf35-387a-4788-abce-de0d17cfef48 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:33.070298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdbf35-387a-4788-abce-de0d17cfef48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:33.142471 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 863/1733] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:33.149102 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1602269-2fbc-4b5c-aca7-926e7759f2db None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:33.154602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e1602269-2fbc-4b5c-aca7-926e7759f2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:33.174421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-61bdbf35-387a-4788-abce-de0d17cfef48 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:33.175996 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-61bdbf35-387a-4788-abce-de0d17cfef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:33.398219 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1602269-2fbc-4b5c-aca7-926e7759f2db None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:33.483844 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 871/1734] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:33.559846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdbf35-387a-4788-abce-de0d17cfef48 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:33.561500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-61bdbf35-387a-4788-abce-de0d17cfef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:33.595305 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de19b5-5f33-4f40-a889-9fe4bdbfee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:33.597416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de19b5-5f33-4f40-a889-9fe4bdbfee8f admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:33.597860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de19b5-5f33-4f40-a889-9fe4bdbfee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:33.600023 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de19b5-5f33-4f40-a889-9fe4bdbfee8f admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:33.603314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de19b5-5f33-4f40-a889-9fe4bdbfee8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:33.605767 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de19b5-5f33-4f40-a889-9fe4bdbfee8f admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:33.698823 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdbf35-387a-4788-abce-de0d17cfef48 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:33.705008 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c6070-2a82-4cf1-b156-3ee6e44d88c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:33.706054 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c6070-2a82-4cf1-b156-3ee6e44d88c2 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:33.706496 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c6070-2a82-4cf1-b156-3ee6e44d88c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:33.706974 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c6070-2a82-4cf1-b156-3ee6e44d88c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:33.732021 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c6070-2a82-4cf1-b156-3ee6e44d88c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:33.734635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c6070-2a82-4cf1-b156-3ee6e44d88c2 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:33.749785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 864/1735] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:33 2022] POST /identity/v3/projects => generated 363 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:33.749785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de19b5-5f33-4f40-a889-9fe4bdbfee8f admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:33.762036 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 872/1736] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:56:33.907525 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de19b5-5f33-4f40-a889-9fe4bdbfee8f admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:33.913253 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595346a-d0a7-4579-8fed-a7f77d84795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:33.913964 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595346a-d0a7-4579-8fed-a7f77d84795f admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:33.914254 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595346a-d0a7-4579-8fed-a7f77d84795f admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:33.914561 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595346a-d0a7-4579-8fed-a7f77d84795f admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:33.915348 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595346a-d0a7-4579-8fed-a7f77d84795f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:33.918025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595346a-d0a7-4579-8fed-a7f77d84795f admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:34.066787 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 865/1737] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:33 2022] POST /identity/v3/users => generated 288 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:34.072223 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c6070-2a82-4cf1-b156-3ee6e44d88c2 service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:34.089649 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c6070-2a82-4cf1-b156-3ee6e44d88c2 service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:34.131372 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1387c2b-341f-4425-961e-9c3b139e9a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:34.131372 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1387c2b-341f-4425-961e-9c3b139e9a06 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:34.131372 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1387c2b-341f-4425-961e-9c3b139e9a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:34.131372 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1387c2b-341f-4425-961e-9c3b139e9a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:34.131872 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1387c2b-341f-4425-961e-9c3b139e9a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:34.133323 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1387c2b-341f-4425-961e-9c3b139e9a06 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:34.151922 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 873/1738] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:34.156203 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595346a-d0a7-4579-8fed-a7f77d84795f admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:34.184800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595346a-d0a7-4579-8fed-a7f77d84795f admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:34.203458 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58671467-b8cb-4257-96ae-7b0bc5a65728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:34.211087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58671467-b8cb-4257-96ae-7b0bc5a65728 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:34.211087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58671467-b8cb-4257-96ae-7b0bc5a65728 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:34.211087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58671467-b8cb-4257-96ae-7b0bc5a65728 admin admin] PATH_INFO: `/v3/projects/1b5ae3ae3ccd4e43b31fd8fcdc2c1e91/users/756ba34f71d544f281b64d9f50fb384e/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:34.229066 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58671467-b8cb-4257-96ae-7b0bc5a65728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5ae3ae3ccd4e43b31fd8fcdc2c1e91, user_id=756ba34f71d544f281b64d9f50fb384e, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:34.235412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58671467-b8cb-4257-96ae-7b0bc5a65728 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:34.368767 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 866/1739] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:34 2022] PUT /identity/v3/projects/1b5ae3ae3ccd4e43b31fd8fcdc2c1e91/users/756ba34f71d544f281b64d9f50fb384e/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:34.372814 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1387c2b-341f-4425-961e-9c3b139e9a06 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:34.384235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1387c2b-341f-4425-961e-9c3b139e9a06 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:34.440103 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58671467-b8cb-4257-96ae-7b0bc5a65728 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:34.441867 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-58671467-b8cb-4257-96ae-7b0bc5a65728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:34.480566 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07106d0d-bb32-442f-a7c4-e129f7fe17c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:34.482063 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07106d0d-bb32-442f-a7c4-e129f7fe17c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:34.482351 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07106d0d-bb32-442f-a7c4-e129f7fe17c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:34.482627 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07106d0d-bb32-442f-a7c4-e129f7fe17c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:34.486328 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07106d0d-bb32-442f-a7c4-e129f7fe17c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:34.488171 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07106d0d-bb32-442f-a7c4-e129f7fe17c7 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:34.515252 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 874/1740] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:34.521749 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07106d0d-bb32-442f-a7c4-e129f7fe17c7 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:34.552065 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07106d0d-bb32-442f-a7c4-e129f7fe17c7 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:34.562988 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2750e4-5e6b-4e54-a3bb-ca9a072c495c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:34.563903 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2750e4-5e6b-4e54-a3bb-ca9a072c495c admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:34.564242 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2750e4-5e6b-4e54-a3bb-ca9a072c495c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:34.564524 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2750e4-5e6b-4e54-a3bb-ca9a072c495c admin admin] PATH_INFO: `/v3/projects/1b5ae3ae3ccd4e43b31fd8fcdc2c1e91/users/756ba34f71d544f281b64d9f50fb384e/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:34.569637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2750e4-5e6b-4e54-a3bb-ca9a072c495c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5ae3ae3ccd4e43b31fd8fcdc2c1e91, user_id=756ba34f71d544f281b64d9f50fb384e, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:34.571748 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2750e4-5e6b-4e54-a3bb-ca9a072c495c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:34.586631 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 875/1741] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:34 2022] PUT /identity/v3/projects/1b5ae3ae3ccd4e43b31fd8fcdc2c1e91/users/756ba34f71d544f281b64d9f50fb384e/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:34.593351 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58671467-b8cb-4257-96ae-7b0bc5a65728 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:34.597352 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac381b2-f8a5-44a6-b4ac-dedc2c7d5f09 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:34.597644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac381b2-f8a5-44a6-b4ac-dedc2c7d5f09 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:34.597929 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac381b2-f8a5-44a6-b4ac-dedc2c7d5f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:34.648881 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-5ac381b2-f8a5-44a6-b4ac-dedc2c7d5f09 None None] MFA Rules not processed for user `756ba34f71d544f281b64d9f50fb384e`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:34.650706 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-5ac381b2-f8a5-44a6-b4ac-dedc2c7d5f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:34.722239 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a90ab-3d10-4f2a-83ee-4249680fbeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:34.728737 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a90ab-3d10-4f2a-83ee-4249680fbeaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:34.728737 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a90ab-3d10-4f2a-83ee-4249680fbeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:34.728737 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a90ab-3d10-4f2a-83ee-4249680fbeaa admin admin] PATH_INFO: `/v3/projects/010e6221c8894fc7b29f3fa3a6331ef9` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:34.728737 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a90ab-3d10-4f2a-83ee-4249680fbeaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=010e6221c8894fc7b29f3fa3a6331ef9)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:34.733987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a90ab-3d10-4f2a-83ee-4249680fbeaa admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:34.779618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 876/1742] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:34 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:56:34.785343 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac381b2-f8a5-44a6-b4ac-dedc2c7d5f09 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:34.788068 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-5ac381b2-f8a5-44a6-b4ac-dedc2c7d5f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:34.813118 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac381b2-f8a5-44a6-b4ac-dedc2c7d5f09 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:34.828074 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354bb72-9a89-4b82-bfab-efc037d9d79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:34.828918 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354bb72-9a89-4b82-bfab-efc037d9d79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:34.829197 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354bb72-9a89-4b82-bfab-efc037d9d79f admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:34.829524 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354bb72-9a89-4b82-bfab-efc037d9d79f admin admin] PATH_INFO: `/v3/projects/8938ca108a2e4a33b97b4a6aac0bb279` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:34.831687 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354bb72-9a89-4b82-bfab-efc037d9d79f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8938ca108a2e4a33b97b4a6aac0bb279)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:34.834616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354bb72-9a89-4b82-bfab-efc037d9d79f admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:34.941960 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-493a90ab-3d10-4f2a-83ee-4249680fbeaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '010e6221c8894fc7b29f3fa3a6331ef9', 'request_id': 'req-493a90ab-3d10-4f2a-83ee-4249680fbeaa'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.055298 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-493a90ab-3d10-4f2a-83ee-4249680fbeaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '010e6221c8894fc7b29f3fa3a6331ef9', 'request_id': 'req-493a90ab-3d10-4f2a-83ee-4249680fbeaa'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.064562 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-493a90ab-3d10-4f2a-83ee-4249680fbeaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '010e6221c8894fc7b29f3fa3a6331ef9', 'request_id': 'req-493a90ab-3d10-4f2a-83ee-4249680fbeaa'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.076716 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9354bb72-9a89-4b82-bfab-efc037d9d79f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8938ca108a2e4a33b97b4a6aac0bb279', 'request_id': 'req-9354bb72-9a89-4b82-bfab-efc037d9d79f'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.085361 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-493a90ab-3d10-4f2a-83ee-4249680fbeaa admin admin] The token cache is being invalidate because project 010e6221c8894fc7b29f3fa3a6331ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:35.090520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-493a90ab-3d10-4f2a-83ee-4249680fbeaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.090520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-493a90ab-3d10-4f2a-83ee-4249680fbeaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.090520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 867/1743] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:34 2022] DELETE /identity/v3/projects/010e6221c8894fc7b29f3fa3a6331ef9 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:35.090520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a90ab-3d10-4f2a-83ee-4249680fbeaa admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:35.093521 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-493a90ab-3d10-4f2a-83ee-4249680fbeaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:35.164311 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9354bb72-9a89-4b82-bfab-efc037d9d79f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8938ca108a2e4a33b97b4a6aac0bb279', 'request_id': 'req-9354bb72-9a89-4b82-bfab-efc037d9d79f'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.174781 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9354bb72-9a89-4b82-bfab-efc037d9d79f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8938ca108a2e4a33b97b4a6aac0bb279', 'request_id': 'req-9354bb72-9a89-4b82-bfab-efc037d9d79f'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.186758 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a90ab-3d10-4f2a-83ee-4249680fbeaa admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:35.197582 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9354bb72-9a89-4b82-bfab-efc037d9d79f admin admin] The token cache is being invalidate because project 8938ca108a2e4a33b97b4a6aac0bb279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:35.197879 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9354bb72-9a89-4b82-bfab-efc037d9d79f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.198641 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9354bb72-9a89-4b82-bfab-efc037d9d79f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.200618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 877/1744] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:34 2022] DELETE /identity/v3/projects/8938ca108a2e4a33b97b4a6aac0bb279 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:35.201592 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354bb72-9a89-4b82-bfab-efc037d9d79f admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:35.204842 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-9354bb72-9a89-4b82-bfab-efc037d9d79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:35.277667 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a233f91-2c9f-491f-a0d7-085380c50b67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:35.278584 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a233f91-2c9f-491f-a0d7-085380c50b67 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:35.278878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a233f91-2c9f-491f-a0d7-085380c50b67 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:35.279153 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a233f91-2c9f-491f-a0d7-085380c50b67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:35.281103 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-3a233f91-2c9f-491f-a0d7-085380c50b67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:35.306908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354bb72-9a89-4b82-bfab-efc037d9d79f admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:35.312302 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678e683-c916-4d69-a57f-25e683109280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:35.313595 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e683-c916-4d69-a57f-25e683109280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:35.314028 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e683-c916-4d69-a57f-25e683109280 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:35.314448 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e683-c916-4d69-a57f-25e683109280 admin admin] PATH_INFO: `/v3/users/74f5449cae2a44099b93be218312a588` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:35.315915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678e683-c916-4d69-a57f-25e683109280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f5449cae2a44099b93be218312a588)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:35.318517 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678e683-c916-4d69-a57f-25e683109280 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:35.379048 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a233f91-2c9f-491f-a0d7-085380c50b67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:35.381093 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a233f91-2c9f-491f-a0d7-085380c50b67 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:35.391812 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 868/1745] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:35 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:35.392788 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a233f91-2c9f-491f-a0d7-085380c50b67 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:35.394108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-3a233f91-2c9f-491f-a0d7-085380c50b67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:35.408856 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a233f91-2c9f-491f-a0d7-085380c50b67 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:35.414600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cca22-4fa6-4c22-bb43-18a0a9e6ba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:35.415349 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cca22-4fa6-4c22-bb43-18a0a9e6ba0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:35.415622 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cca22-4fa6-4c22-bb43-18a0a9e6ba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:35.415896 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cca22-4fa6-4c22-bb43-18a0a9e6ba0c admin admin] PATH_INFO: `/v3/users/f094c93313f24d148ef33ce84224ca98` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:35.417169 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cca22-4fa6-4c22-bb43-18a0a9e6ba0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f094c93313f24d148ef33ce84224ca98)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:35.419096 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cca22-4fa6-4c22-bb43-18a0a9e6ba0c admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:35.571970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-a678e683-c916-4d69-a57f-25e683109280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f5449cae2a44099b93be218312a588'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.572754 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-a678e683-c916-4d69-a57f-25e683109280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f5449cae2a44099b93be218312a588'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.587465 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-a678e683-c916-4d69-a57f-25e683109280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f5449cae2a44099b93be218312a588'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.600923 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-a678e683-c916-4d69-a57f-25e683109280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f5449cae2a44099b93be218312a588'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.605748 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-a678e683-c916-4d69-a57f-25e683109280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f5449cae2a44099b93be218312a588'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.742130 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-512cca22-4fa6-4c22-bb43-18a0a9e6ba0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f094c93313f24d148ef33ce84224ca98'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.743134 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-512cca22-4fa6-4c22-bb43-18a0a9e6ba0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f094c93313f24d148ef33ce84224ca98'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.755012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-512cca22-4fa6-4c22-bb43-18a0a9e6ba0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f094c93313f24d148ef33ce84224ca98'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.762253 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-512cca22-4fa6-4c22-bb43-18a0a9e6ba0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f094c93313f24d148ef33ce84224ca98'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.763056 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-512cca22-4fa6-4c22-bb43-18a0a9e6ba0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f094c93313f24d148ef33ce84224ca98'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:35.820413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 878/1746] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:35 2022] DELETE /identity/v3/users/74f5449cae2a44099b93be218312a588 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:35.821983 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec56da-999f-4d8b-8c87-9a4d024c8cc5 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:35.822275 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec56da-999f-4d8b-8c87-9a4d024c8cc5 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:35.822554 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec56da-999f-4d8b-8c87-9a4d024c8cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:35.858313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-2bec56da-999f-4d8b-8c87-9a4d024c8cc5 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:35.859800 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-2bec56da-999f-4d8b-8c87-9a4d024c8cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:35.942337 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 869/1747] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:35 2022] DELETE /identity/v3/users/f094c93313f24d148ef33ce84224ca98 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:35.943962 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cca22-4fa6-4c22-bb43-18a0a9e6ba0c admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:35.945846 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-512cca22-4fa6-4c22-bb43-18a0a9e6ba0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:35.981241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 879/1748] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:35.990338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ef4d3-fa64-4614-93bb-2aa24740a8c4 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:35.990338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ef4d3-fa64-4614-93bb-2aa24740a8c4 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:35.990338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ef4d3-fa64-4614-93bb-2aa24740a8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:36.072951 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-819ef4d3-fa64-4614-93bb-2aa24740a8c4 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:36.074295 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-819ef4d3-fa64-4614-93bb-2aa24740a8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:36.151876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cca22-4fa6-4c22-bb43-18a0a9e6ba0c admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:36.151876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaa80b-a45a-4722-9ee9-f77170ee5ee8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:36.151876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaa80b-a45a-4722-9ee9-f77170ee5ee8 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:36.151876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaa80b-a45a-4722-9ee9-f77170ee5ee8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:36.152333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaa80b-a45a-4722-9ee9-f77170ee5ee8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:36.155929 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-97eaa80b-a45a-4722-9ee9-f77170ee5ee8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:36.201455 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 880/1749] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:36.204058 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ef4d3-fa64-4614-93bb-2aa24740a8c4 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:36.205628 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-819ef4d3-fa64-4614-93bb-2aa24740a8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:36.248108 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ef4d3-fa64-4614-93bb-2aa24740a8c4 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:36.255229 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99476e-c18e-4f97-855f-af47b1f555b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:36.257691 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99476e-c18e-4f97-855f-af47b1f555b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:36.258868 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99476e-c18e-4f97-855f-af47b1f555b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:36.259421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99476e-c18e-4f97-855f-af47b1f555b0 admin admin] PATH_INFO: `/v3/projects/aaf3299c044c464a876701dad3b74af5` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:36.261410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99476e-c18e-4f97-855f-af47b1f555b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaf3299c044c464a876701dad3b74af5)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:36.264364 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99476e-c18e-4f97-855f-af47b1f555b0 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:36.333715 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eaa80b-a45a-4722-9ee9-f77170ee5ee8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:36.335372 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eaa80b-a45a-4722-9ee9-f77170ee5ee8 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:36.362696 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 870/1750] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:36.363646 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaa80b-a45a-4722-9ee9-f77170ee5ee8 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:36.414150 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaa80b-a45a-4722-9ee9-f77170ee5ee8 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:36.433528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87e515-999c-47bf-b3e0-f5077baa7a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:36.433528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87e515-999c-47bf-b3e0-f5077baa7a28 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:36.433528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87e515-999c-47bf-b3e0-f5077baa7a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:36.433528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87e515-999c-47bf-b3e0-f5077baa7a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:36.433861 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87e515-999c-47bf-b3e0-f5077baa7a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:36.433861 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87e515-999c-47bf-b3e0-f5077baa7a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:36.435529 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87e515-999c-47bf-b3e0-f5077baa7a28 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:36.452762 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ee99476e-c18e-4f97-855f-af47b1f555b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaf3299c044c464a876701dad3b74af5', 'request_id': 'req-ee99476e-c18e-4f97-855f-af47b1f555b0'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:36.479455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 871/1751] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:36.494365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87e515-999c-47bf-b3e0-f5077baa7a28 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:36.512882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87e515-999c-47bf-b3e0-f5077baa7a28 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:36.536089 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ee99476e-c18e-4f97-855f-af47b1f555b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaf3299c044c464a876701dad3b74af5', 'request_id': 'req-ee99476e-c18e-4f97-855f-af47b1f555b0'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:36.556707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ee99476e-c18e-4f97-855f-af47b1f555b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaf3299c044c464a876701dad3b74af5', 'request_id': 'req-ee99476e-c18e-4f97-855f-af47b1f555b0'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:36.594216 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ee99476e-c18e-4f97-855f-af47b1f555b0 admin admin] The token cache is being invalidate because project aaf3299c044c464a876701dad3b74af5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:36.594512 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ee99476e-c18e-4f97-855f-af47b1f555b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:36.595443 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ee99476e-c18e-4f97-855f-af47b1f555b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:36.597406 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 881/1752] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:36 2022] DELETE /identity/v3/projects/aaf3299c044c464a876701dad3b74af5 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:36.601893 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99476e-c18e-4f97-855f-af47b1f555b0 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:36.604016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ee99476e-c18e-4f97-855f-af47b1f555b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:36.606300 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b87f6b-3706-4d33-8ea2-62df450dfcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:36.607069 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b87f6b-3706-4d33-8ea2-62df450dfcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:36.607476 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b87f6b-3706-4d33-8ea2-62df450dfcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:36.607760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b87f6b-3706-4d33-8ea2-62df450dfcf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:36.609065 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b87f6b-3706-4d33-8ea2-62df450dfcf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:36.610686 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b87f6b-3706-4d33-8ea2-62df450dfcf8 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:36.632654 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99476e-c18e-4f97-855f-af47b1f555b0 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:36.648343 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72847b-dd50-4d7c-888b-c0b82913a4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:36.649918 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72847b-dd50-4d7c-888b-c0b82913a4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:36.650314 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72847b-dd50-4d7c-888b-c0b82913a4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:36.650926 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72847b-dd50-4d7c-888b-c0b82913a4c1 admin admin] PATH_INFO: `/v3/users/a857ed46558c46d7ad9068111d3055c5` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:36.652545 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72847b-dd50-4d7c-888b-c0b82913a4c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a857ed46558c46d7ad9068111d3055c5)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:36.654814 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72847b-dd50-4d7c-888b-c0b82913a4c1 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:36.688410 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 872/1753] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:36 2022] POST /identity/v3/projects => generated 387 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:36.692769 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b87f6b-3706-4d33-8ea2-62df450dfcf8 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:36.694738 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a3b87f6b-3706-4d33-8ea2-62df450dfcf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:36.779427 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b87f6b-3706-4d33-8ea2-62df450dfcf8 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:36.792729 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0116e28-112a-4719-9657-9e1724d1e84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:36.798100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0116e28-112a-4719-9657-9e1724d1e84b admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:36.798100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0116e28-112a-4719-9657-9e1724d1e84b admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:36.798100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0116e28-112a-4719-9657-9e1724d1e84b admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:36.798100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0116e28-112a-4719-9657-9e1724d1e84b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:36.798100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0116e28-112a-4719-9657-9e1724d1e84b admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:36.865498 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fe72847b-dd50-4d7c-888b-c0b82913a4c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a857ed46558c46d7ad9068111d3055c5'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:36.871985 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fe72847b-dd50-4d7c-888b-c0b82913a4c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a857ed46558c46d7ad9068111d3055c5'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:36.882041 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fe72847b-dd50-4d7c-888b-c0b82913a4c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a857ed46558c46d7ad9068111d3055c5'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:36.896663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fe72847b-dd50-4d7c-888b-c0b82913a4c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a857ed46558c46d7ad9068111d3055c5'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:36.896663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fe72847b-dd50-4d7c-888b-c0b82913a4c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a857ed46558c46d7ad9068111d3055c5'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:37.315070 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 873/1754] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:36 2022] POST /identity/v3/users => generated 294 bytes in 623 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:56:37.326401 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0116e28-112a-4719-9657-9e1724d1e84b admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:37.326401 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c0116e28-112a-4719-9657-9e1724d1e84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:37.332407 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0116e28-112a-4719-9657-9e1724d1e84b admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:37.338537 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e75f0-ae92-4804-9099-df2e2d1bdebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:37.339409 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e75f0-ae92-4804-9099-df2e2d1bdebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:37.339684 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e75f0-ae92-4804-9099-df2e2d1bdebb admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:37.339956 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e75f0-ae92-4804-9099-df2e2d1bdebb admin admin] PATH_INFO: `/v3/projects/9414f2a54e1c40cca76e0b14e1035065` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:37.341162 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e75f0-ae92-4804-9099-df2e2d1bdebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9414f2a54e1c40cca76e0b14e1035065)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:37.343045 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e75f0-ae92-4804-9099-df2e2d1bdebb admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:37.353413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 882/1755] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:36 2022] DELETE /identity/v3/users/a857ed46558c46d7ad9068111d3055c5 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:56:37.355200 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72847b-dd50-4d7c-888b-c0b82913a4c1 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:37.358606 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-fe72847b-dd50-4d7c-888b-c0b82913a4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:37.435688 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72847b-dd50-4d7c-888b-c0b82913a4c1 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:37.437893 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69327d28-6462-4b5a-8f16-0e3098f93a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:37.439581 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69327d28-6462-4b5a-8f16-0e3098f93a08 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:37.439876 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69327d28-6462-4b5a-8f16-0e3098f93a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:37.441797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69327d28-6462-4b5a-8f16-0e3098f93a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:37.441797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69327d28-6462-4b5a-8f16-0e3098f93a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:37.442920 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69327d28-6462-4b5a-8f16-0e3098f93a08 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:37.460227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 883/1756] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:37.461855 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69327d28-6462-4b5a-8f16-0e3098f93a08 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:37.476234 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69327d28-6462-4b5a-8f16-0e3098f93a08 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:37.484509 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fec844-bd4f-4227-a19e-98ece4eb5b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:37.486066 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fec844-bd4f-4227-a19e-98ece4eb5b33 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:37.486066 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fec844-bd4f-4227-a19e-98ece4eb5b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:37.486066 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fec844-bd4f-4227-a19e-98ece4eb5b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:37.486971 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fec844-bd4f-4227-a19e-98ece4eb5b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:37.498528 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fec844-bd4f-4227-a19e-98ece4eb5b33 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:37.502767 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 884/1757] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:37.508210 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fec844-bd4f-4227-a19e-98ece4eb5b33 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:37.519545 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fec844-bd4f-4227-a19e-98ece4eb5b33 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:37.527012 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fc21e-c6c3-465e-8697-5545a1d100ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:37.534984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fc21e-c6c3-465e-8697-5545a1d100ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:37.534984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fc21e-c6c3-465e-8697-5545a1d100ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:37.534984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fc21e-c6c3-465e-8697-5545a1d100ec admin admin] PATH_INFO: `/v3/projects/db8d47f6e16e462c9c396cdaaa134220/users/a5ec9d74ea7a416f90b7545d63906784/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:37.549653 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fc21e-c6c3-465e-8697-5545a1d100ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8d47f6e16e462c9c396cdaaa134220, user_id=a5ec9d74ea7a416f90b7545d63906784, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:37.552908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fc21e-c6c3-465e-8697-5545a1d100ec admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:37.691044 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 885/1758] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:37 2022] PUT /identity/v3/projects/db8d47f6e16e462c9c396cdaaa134220/users/a5ec9d74ea7a416f90b7545d63906784/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:37.697280 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-be2e75f0-ae92-4804-9099-df2e2d1bdebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9414f2a54e1c40cca76e0b14e1035065', 'request_id': 'req-be2e75f0-ae92-4804-9099-df2e2d1bdebb'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:37.702060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0cea78-e035-42f7-9c3b-8f71492d96b4 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:37.702351 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0cea78-e035-42f7-9c3b-8f71492d96b4 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:37.702630 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0cea78-e035-42f7-9c3b-8f71492d96b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:37.728515 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-5f0cea78-e035-42f7-9c3b-8f71492d96b4 None None] MFA Rules not processed for user `a5ec9d74ea7a416f90b7545d63906784`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:37.729756 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-5f0cea78-e035-42f7-9c3b-8f71492d96b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:37.798847 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 886/1759] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:56:37.798847 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0cea78-e035-42f7-9c3b-8f71492d96b4 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:37.798847 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-5f0cea78-e035-42f7-9c3b-8f71492d96b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:37.842709 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-be2e75f0-ae92-4804-9099-df2e2d1bdebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9414f2a54e1c40cca76e0b14e1035065', 'request_id': 'req-be2e75f0-ae92-4804-9099-df2e2d1bdebb'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:37.866954 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-be2e75f0-ae92-4804-9099-df2e2d1bdebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9414f2a54e1c40cca76e0b14e1035065', 'request_id': 'req-be2e75f0-ae92-4804-9099-df2e2d1bdebb'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:37.868167 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0cea78-e035-42f7-9c3b-8f71492d96b4 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:37.872728 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-be2e75f0-ae92-4804-9099-df2e2d1bdebb admin admin] The token cache is being invalidate because project 9414f2a54e1c40cca76e0b14e1035065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:37.873017 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-be2e75f0-ae92-4804-9099-df2e2d1bdebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:37.873669 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc07be-f9c4-4e7a-bb86-dc30a4e8b371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:37.873784 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-be2e75f0-ae92-4804-9099-df2e2d1bdebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:37.874448 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc07be-f9c4-4e7a-bb86-dc30a4e8b371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:37.874729 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc07be-f9c4-4e7a-bb86-dc30a4e8b371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:37.875000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc07be-f9c4-4e7a-bb86-dc30a4e8b371 admin admin] PATH_INFO: `/v3/projects/9e503fff72104d7c9744e12477ad9ef6` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:37.878755 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 874/1760] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:37 2022] DELETE /identity/v3/projects/9414f2a54e1c40cca76e0b14e1035065 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:37.878755 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e75f0-ae92-4804-9099-df2e2d1bdebb admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:37.879619 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc07be-f9c4-4e7a-bb86-dc30a4e8b371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e503fff72104d7c9744e12477ad9ef6)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:37.880040 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-be2e75f0-ae92-4804-9099-df2e2d1bdebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:37.882244 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc07be-f9c4-4e7a-bb86-dc30a4e8b371 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:37.945290 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e75f0-ae92-4804-9099-df2e2d1bdebb admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:37.950017 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3895325-5b8e-40a9-b963-3a3b27878e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:37.950717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3895325-5b8e-40a9-b963-3a3b27878e0f admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:37.950993 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3895325-5b8e-40a9-b963-3a3b27878e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:37.951352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3895325-5b8e-40a9-b963-3a3b27878e0f admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:37.952043 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3895325-5b8e-40a9-b963-3a3b27878e0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:37.953983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3895325-5b8e-40a9-b963-3a3b27878e0f admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:38.161260 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 875/1761] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:37 2022] POST /identity/v3/projects => generated 387 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:38.161260 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fadd1a-6213-42d6-8ae7-4d175f553d6a None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:38.161260 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fadd1a-6213-42d6-8ae7-4d175f553d6a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:38.161260 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fadd1a-6213-42d6-8ae7-4d175f553d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:38.169521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5dcc07be-f9c4-4e7a-bb86-dc30a4e8b371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e503fff72104d7c9744e12477ad9ef6', 'request_id': 'req-5dcc07be-f9c4-4e7a-bb86-dc30a4e8b371'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:38.178721 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-e1fadd1a-6213-42d6-8ae7-4d175f553d6a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:38.191168 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e1fadd1a-6213-42d6-8ae7-4d175f553d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:38.237650 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 876/1762] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:38.238472 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fadd1a-6213-42d6-8ae7-4d175f553d6a None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:38.247814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fadd1a-6213-42d6-8ae7-4d175f553d6a None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:38.255644 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1099a3-5490-422d-bf52-acb0b91aad48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:38.255905 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1099a3-5490-422d-bf52-acb0b91aad48 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:38.256226 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1099a3-5490-422d-bf52-acb0b91aad48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:38.256522 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1099a3-5490-422d-bf52-acb0b91aad48 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:38.257291 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1099a3-5490-422d-bf52-acb0b91aad48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:38.259449 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1099a3-5490-422d-bf52-acb0b91aad48 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:38.277776 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5dcc07be-f9c4-4e7a-bb86-dc30a4e8b371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e503fff72104d7c9744e12477ad9ef6', 'request_id': 'req-5dcc07be-f9c4-4e7a-bb86-dc30a4e8b371'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:38.284946 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5dcc07be-f9c4-4e7a-bb86-dc30a4e8b371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e503fff72104d7c9744e12477ad9ef6', 'request_id': 'req-5dcc07be-f9c4-4e7a-bb86-dc30a4e8b371'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:38.298041 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5dcc07be-f9c4-4e7a-bb86-dc30a4e8b371 admin admin] The token cache is being invalidate because project 9e503fff72104d7c9744e12477ad9ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:38.298222 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5dcc07be-f9c4-4e7a-bb86-dc30a4e8b371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:38.299117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5dcc07be-f9c4-4e7a-bb86-dc30a4e8b371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:38.304939 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 887/1763] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:37 2022] DELETE /identity/v3/projects/9e503fff72104d7c9744e12477ad9ef6 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:38.306647 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e309787-1589-4c9c-8e77-6fd954b755e7 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:38.308601 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e309787-1589-4c9c-8e77-6fd954b755e7 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:38.308981 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e309787-1589-4c9c-8e77-6fd954b755e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:38.328117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-5e309787-1589-4c9c-8e77-6fd954b755e7 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:38.329584 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-5e309787-1589-4c9c-8e77-6fd954b755e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:38.339040 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 888/1764] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:38.340436 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc98c8-3eae-4042-aa4a-9bed373ec824 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:38.340830 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc98c8-3eae-4042-aa4a-9bed373ec824 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:38.341161 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc98c8-3eae-4042-aa4a-9bed373ec824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:38.360251 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-e8cc98c8-3eae-4042-aa4a-9bed373ec824 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:38.361708 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e8cc98c8-3eae-4042-aa4a-9bed373ec824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:38.371145 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 889/1765] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:38.371961 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc98c8-3eae-4042-aa4a-9bed373ec824 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:38.383184 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc98c8-3eae-4042-aa4a-9bed373ec824 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:38.388091 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e6c90-bad8-4741-9f6e-7b9a7865d975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:38.388801 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e6c90-bad8-4741-9f6e-7b9a7865d975 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:38.389087 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e6c90-bad8-4741-9f6e-7b9a7865d975 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:38.389363 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e6c90-bad8-4741-9f6e-7b9a7865d975 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:38.390097 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e6c90-bad8-4741-9f6e-7b9a7865d975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:38.390399 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e6c90-bad8-4741-9f6e-7b9a7865d975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:38.392016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e6c90-bad8-4741-9f6e-7b9a7865d975 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:38.403857 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 890/1766] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:38.405170 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05d3e6-768c-4b1e-ab01-de600a7f2101 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:38.405457 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05d3e6-768c-4b1e-ab01-de600a7f2101 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:38.405734 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05d3e6-768c-4b1e-ab01-de600a7f2101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:38.419822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 877/1767] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:38 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:38.419822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1099a3-5490-422d-bf52-acb0b91aad48 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:38.426654 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-0b05d3e6-768c-4b1e-ab01-de600a7f2101 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:38.428474 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-0b05d3e6-768c-4b1e-ab01-de600a7f2101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:38.430686 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1099a3-5490-422d-bf52-acb0b91aad48 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:38.436600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfba86-1814-4239-8d63-363ef69c7517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:38.437639 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfba86-1814-4239-8d63-363ef69c7517 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:38.437919 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfba86-1814-4239-8d63-363ef69c7517 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:38.438190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfba86-1814-4239-8d63-363ef69c7517 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:38.441584 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 891/1768] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:38.441757 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfba86-1814-4239-8d63-363ef69c7517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:38.441846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05d3e6-768c-4b1e-ab01-de600a7f2101 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:38.441918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfba86-1814-4239-8d63-363ef69c7517 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:38.441982 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-0b05d3e6-768c-4b1e-ab01-de600a7f2101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:38.456244 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05d3e6-768c-4b1e-ab01-de600a7f2101 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:38.462824 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581019a-acef-4597-b07b-fc7be08d4bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:38.463618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581019a-acef-4597-b07b-fc7be08d4bfe admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:38.463902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581019a-acef-4597-b07b-fc7be08d4bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:38.464292 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581019a-acef-4597-b07b-fc7be08d4bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:38.465079 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581019a-acef-4597-b07b-fc7be08d4bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:38.466697 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581019a-acef-4597-b07b-fc7be08d4bfe admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:38.484062 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 892/1769] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:38.484062 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581019a-acef-4597-b07b-fc7be08d4bfe admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:38.490638 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581019a-acef-4597-b07b-fc7be08d4bfe admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:38.496973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ae0f9-a776-4d20-ab65-8c6d5936f840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:38.497637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ae0f9-a776-4d20-ab65-8c6d5936f840 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:38.497917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ae0f9-a776-4d20-ab65-8c6d5936f840 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:38.498190 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ae0f9-a776-4d20-ab65-8c6d5936f840 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:38.498919 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ae0f9-a776-4d20-ab65-8c6d5936f840 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:38.499355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ae0f9-a776-4d20-ab65-8c6d5936f840 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:38.501051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ae0f9-a776-4d20-ab65-8c6d5936f840 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:38.513922 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 893/1770] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:38.514784 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ae0f9-a776-4d20-ab65-8c6d5936f840 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:38.541547 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ae0f9-a776-4d20-ab65-8c6d5936f840 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:38.541547 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec32c55-b9de-46f2-9b71-dbf9f1039c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:38.541547 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec32c55-b9de-46f2-9b71-dbf9f1039c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:38.541547 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec32c55-b9de-46f2-9b71-dbf9f1039c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:38.541882 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec32c55-b9de-46f2-9b71-dbf9f1039c16 admin admin] PATH_INFO: `/v3/projects/fc82f3d8ec204afe8e47d33dd40ce03d/users/e4fc54beb1f646aa849c82b49ae66751/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:38.554319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec32c55-b9de-46f2-9b71-dbf9f1039c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc82f3d8ec204afe8e47d33dd40ce03d, user_id=e4fc54beb1f646aa849c82b49ae66751, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:38.557066 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec32c55-b9de-46f2-9b71-dbf9f1039c16 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:38.579439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 878/1771] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:38 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:38.579439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfba86-1814-4239-8d63-363ef69c7517 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:38.655318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfba86-1814-4239-8d63-363ef69c7517 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:38.660822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee12f5-9e14-4e5d-8aeb-6035c87d6653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:38.662034 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee12f5-9e14-4e5d-8aeb-6035c87d6653 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:38.662750 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee12f5-9e14-4e5d-8aeb-6035c87d6653 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:38.663024 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee12f5-9e14-4e5d-8aeb-6035c87d6653 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:38.672635 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee12f5-9e14-4e5d-8aeb-6035c87d6653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:38.672635 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee12f5-9e14-4e5d-8aeb-6035c87d6653 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:38.709702 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 894/1772] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:38 2022] PUT /identity/v3/projects/fc82f3d8ec204afe8e47d33dd40ce03d/users/e4fc54beb1f646aa849c82b49ae66751/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:38.711054 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec32c55-b9de-46f2-9b71-dbf9f1039c16 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:38.811487 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 879/1773] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:38 2022] POST /identity/v3/projects => generated 363 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:38.812602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee12f5-9e14-4e5d-8aeb-6035c87d6653 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:38.841044 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec32c55-b9de-46f2-9b71-dbf9f1039c16 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:38.904145 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee12f5-9e14-4e5d-8aeb-6035c87d6653 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:38.910836 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b459f-e457-46cd-b431-c8d2a3229de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:38.911542 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b459f-e457-46cd-b431-c8d2a3229de7 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:38.912551 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b459f-e457-46cd-b431-c8d2a3229de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:38.912836 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b459f-e457-46cd-b431-c8d2a3229de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:38.913592 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b459f-e457-46cd-b431-c8d2a3229de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:38.915221 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b459f-e457-46cd-b431-c8d2a3229de7 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:38.916350 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec9d99-d26d-4797-b8c2-04aad5be317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:38.917069 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec9d99-d26d-4797-b8c2-04aad5be317a admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:38.917351 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec9d99-d26d-4797-b8c2-04aad5be317a admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:38.923530 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec9d99-d26d-4797-b8c2-04aad5be317a admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:38.923530 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec9d99-d26d-4797-b8c2-04aad5be317a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:38.923530 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec9d99-d26d-4797-b8c2-04aad5be317a admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:38.935257 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 880/1774] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:38.936155 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b459f-e457-46cd-b431-c8d2a3229de7 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:38.946380 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b459f-e457-46cd-b431-c8d2a3229de7 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:38.951327 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f895c23-05b7-464c-a78a-86d6332c5e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:38.954055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f895c23-05b7-464c-a78a-86d6332c5e46 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:38.954055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f895c23-05b7-464c-a78a-86d6332c5e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:38.954055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f895c23-05b7-464c-a78a-86d6332c5e46 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:38.954055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f895c23-05b7-464c-a78a-86d6332c5e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:38.955162 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f895c23-05b7-464c-a78a-86d6332c5e46 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:39.056045 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 895/1775] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:38 2022] POST /identity/v3/users => generated 291 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:39.056992 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec9d99-d26d-4797-b8c2-04aad5be317a admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:39.066743 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec9d99-d26d-4797-b8c2-04aad5be317a admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:39.071775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404a83a-b42e-4984-b310-4638673a7a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:39.072666 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404a83a-b42e-4984-b310-4638673a7a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:39.072947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404a83a-b42e-4984-b310-4638673a7a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:39.073226 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404a83a-b42e-4984-b310-4638673a7a9a admin admin] PATH_INFO: `/v3/projects/fc82f3d8ec204afe8e47d33dd40ce03d/users/e4fc54beb1f646aa849c82b49ae66751/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:39.075238 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404a83a-b42e-4984-b310-4638673a7a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc82f3d8ec204afe8e47d33dd40ce03d, user_id=e4fc54beb1f646aa849c82b49ae66751, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:39.077934 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404a83a-b42e-4984-b310-4638673a7a9a admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:39.108921 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 896/1777] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:39 2022] PUT /identity/v3/projects/fc82f3d8ec204afe8e47d33dd40ce03d/users/e4fc54beb1f646aa849c82b49ae66751/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:39.109264 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 881/1777] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:38 2022] POST /identity/v3/users => generated 282 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:39.109373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404a83a-b42e-4984-b310-4638673a7a9a admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:39.109485 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16538f-e172-4e9d-b9d4-0c367376b377 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:39.109485 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16538f-e172-4e9d-b9d4-0c367376b377 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:39.109485 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16538f-e172-4e9d-b9d4-0c367376b377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:39.132248 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-cd16538f-e172-4e9d-b9d4-0c367376b377 None None] MFA Rules not processed for user `e4fc54beb1f646aa849c82b49ae66751`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:39.133518 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-cd16538f-e172-4e9d-b9d4-0c367376b377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:39.166564 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404a83a-b42e-4984-b310-4638673a7a9a admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:39.171366 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78965f06-db67-4302-a719-c3b7adacee4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:39.177567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78965f06-db67-4302-a719-c3b7adacee4a admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:39.177567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78965f06-db67-4302-a719-c3b7adacee4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:39.177567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78965f06-db67-4302-a719-c3b7adacee4a admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:39.177567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78965f06-db67-4302-a719-c3b7adacee4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:39.177567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78965f06-db67-4302-a719-c3b7adacee4a admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:39.185409 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 897/1778] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:39.186225 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78965f06-db67-4302-a719-c3b7adacee4a admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:39.196200 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78965f06-db67-4302-a719-c3b7adacee4a admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:39.201037 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a2b38-ba42-4c87-9803-a2f9e066b452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:39.201684 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a2b38-ba42-4c87-9803-a2f9e066b452 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:39.201962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a2b38-ba42-4c87-9803-a2f9e066b452 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:39.202232 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a2b38-ba42-4c87-9803-a2f9e066b452 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:39.202945 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a2b38-ba42-4c87-9803-a2f9e066b452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:39.204749 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a2b38-ba42-4c87-9803-a2f9e066b452 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:39.204863 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 882/1779] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:39.205643 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16538f-e172-4e9d-b9d4-0c367376b377 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:39.217293 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16538f-e172-4e9d-b9d4-0c367376b377 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:39.221922 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 898/1780] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:39.221922 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a2b38-ba42-4c87-9803-a2f9e066b452 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:39.222593 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-952a2b38-ba42-4c87-9803-a2f9e066b452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:39.225852 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494ccd3-f419-4531-a964-b118616ecfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:39.226623 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494ccd3-f419-4531-a964-b118616ecfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:39.226907 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494ccd3-f419-4531-a964-b118616ecfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:39.227182 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494ccd3-f419-4531-a964-b118616ecfa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:39.227929 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494ccd3-f419-4531-a964-b118616ecfa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:39.229588 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494ccd3-f419-4531-a964-b118616ecfa6 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:39.246883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 883/1781] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:39.246883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494ccd3-f419-4531-a964-b118616ecfa6 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:39.259128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494ccd3-f419-4531-a964-b118616ecfa6 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:39.265733 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff9a28-fc1c-4567-9308-b17a42f24b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:39.286461 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff9a28-fc1c-4567-9308-b17a42f24b7a admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:39.286461 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff9a28-fc1c-4567-9308-b17a42f24b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:39.286461 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff9a28-fc1c-4567-9308-b17a42f24b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:39.286461 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff9a28-fc1c-4567-9308-b17a42f24b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:39.286461 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff9a28-fc1c-4567-9308-b17a42f24b7a admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:39.286461 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 884/1782] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:39.287634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff9a28-fc1c-4567-9308-b17a42f24b7a admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:39.294971 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a2b38-ba42-4c87-9803-a2f9e066b452 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:39.298304 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff9a28-fc1c-4567-9308-b17a42f24b7a admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:39.298928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56ec8e-0be8-43cb-bd87-c331b3526a2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:39.299810 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56ec8e-0be8-43cb-bd87-c331b3526a2e service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:39.300187 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56ec8e-0be8-43cb-bd87-c331b3526a2e service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:39.300498 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56ec8e-0be8-43cb-bd87-c331b3526a2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:39.304147 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c540a-2269-4744-81db-ea69036f1b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:39.304998 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c540a-2269-4744-81db-ea69036f1b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:39.305600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c540a-2269-4744-81db-ea69036f1b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:39.305710 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c540a-2269-4744-81db-ea69036f1b78 admin admin] PATH_INFO: `/v3/projects/9b0c402f9964411cabaa6f1d907a4967/users/0f6b4ed1e27f4782bd883d4011d005bf/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:39.312420 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56ec8e-0be8-43cb-bd87-c331b3526a2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:39.314042 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56ec8e-0be8-43cb-bd87-c331b3526a2e service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:39.324250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c540a-2269-4744-81db-ea69036f1b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b0c402f9964411cabaa6f1d907a4967, user_id=0f6b4ed1e27f4782bd883d4011d005bf, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:39.326411 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 899/1783] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:56:39.326637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56ec8e-0be8-43cb-bd87-c331b3526a2e service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:39.327097 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c540a-2269-4744-81db-ea69036f1b78 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:39.342188 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56ec8e-0be8-43cb-bd87-c331b3526a2e service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:39.350535 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a579b-d03f-436c-99ac-02d954ced02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:39.351652 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a579b-d03f-436c-99ac-02d954ced02d admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:39.352114 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a579b-d03f-436c-99ac-02d954ced02d admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:39.354894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a579b-d03f-436c-99ac-02d954ced02d admin admin] PATH_INFO: `/v3/projects/4e3689ab82fa4669a09265abe7bcb087/users/514245096a0347f2b8d7b08b343687d1/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:39.370943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a579b-d03f-436c-99ac-02d954ced02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3689ab82fa4669a09265abe7bcb087, user_id=514245096a0347f2b8d7b08b343687d1, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:39.374429 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a579b-d03f-436c-99ac-02d954ced02d admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:39.424661 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 885/1784] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:39 2022] PUT /identity/v3/projects/9b0c402f9964411cabaa6f1d907a4967/users/0f6b4ed1e27f4782bd883d4011d005bf/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:39.427127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f529c-8b44-4b45-a1d8-925c5178eb5a None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:39.427127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f529c-8b44-4b45-a1d8-925c5178eb5a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:39.427499 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f529c-8b44-4b45-a1d8-925c5178eb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:39.471165 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-f43f529c-8b44-4b45-a1d8-925c5178eb5a None None] MFA Rules not processed for user `0f6b4ed1e27f4782bd883d4011d005bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:39.472218 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 900/1785] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:39 2022] PUT /identity/v3/projects/4e3689ab82fa4669a09265abe7bcb087/users/514245096a0347f2b8d7b08b343687d1/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:39.472791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f43f529c-8b44-4b45-a1d8-925c5178eb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:39.493319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a579b-d03f-436c-99ac-02d954ced02d admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:39.591064 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 886/1786] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:39.605176 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c7f93-8a86-4645-bac0-9613745dedf5 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:39.605524 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c7f93-8a86-4645-bac0-9613745dedf5 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:39.605826 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c7f93-8a86-4645-bac0-9613745dedf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:39.632692 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a579b-d03f-436c-99ac-02d954ced02d admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:39.638315 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-0f4c7f93-8a86-4645-bac0-9613745dedf5 None None] MFA Rules not processed for user `514245096a0347f2b8d7b08b343687d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:39.639574 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-0f4c7f93-8a86-4645-bac0-9613745dedf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:39.639844 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dd14f-3663-4bfd-9e5e-65f4475fdc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:39.640930 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dd14f-3663-4bfd-9e5e-65f4475fdc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:39.641112 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dd14f-3663-4bfd-9e5e-65f4475fdc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:39.641283 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dd14f-3663-4bfd-9e5e-65f4475fdc82 admin admin] PATH_INFO: `/v3/users/a5ec9d74ea7a416f90b7545d63906784` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:39.643280 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333dd14f-3663-4bfd-9e5e-65f4475fdc82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ec9d74ea7a416f90b7545d63906784)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:39.644904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333dd14f-3663-4bfd-9e5e-65f4475fdc82 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:39.714514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 887/1787] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:39.715493 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c7f93-8a86-4645-bac0-9613745dedf5 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:39.731451 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c7f93-8a86-4645-bac0-9613745dedf5 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:39.740512 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96413cb8-7971-4276-b95b-791292f1de90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:39.741307 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413cb8-7971-4276-b95b-791292f1de90 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:39.741596 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413cb8-7971-4276-b95b-791292f1de90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:39.741844 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413cb8-7971-4276-b95b-791292f1de90 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:39.742903 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96413cb8-7971-4276-b95b-791292f1de90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:39.744717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96413cb8-7971-4276-b95b-791292f1de90 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:39.968313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-333dd14f-3663-4bfd-9e5e-65f4475fdc82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ec9d74ea7a416f90b7545d63906784'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:39.969423 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-333dd14f-3663-4bfd-9e5e-65f4475fdc82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ec9d74ea7a416f90b7545d63906784'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:39.986310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 888/1788] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:39 2022] POST /identity/v3/projects => generated 379 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:39.986310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96413cb8-7971-4276-b95b-791292f1de90 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:39.992289 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-96413cb8-7971-4276-b95b-791292f1de90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:39.995887 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-333dd14f-3663-4bfd-9e5e-65f4475fdc82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ec9d74ea7a416f90b7545d63906784'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:40.008901 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-333dd14f-3663-4bfd-9e5e-65f4475fdc82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ec9d74ea7a416f90b7545d63906784'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:40.008901 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-333dd14f-3663-4bfd-9e5e-65f4475fdc82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ec9d74ea7a416f90b7545d63906784'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:40.107514 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 901/1789] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:39 2022] DELETE /identity/v3/users/a5ec9d74ea7a416f90b7545d63906784 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:40.111011 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dd14f-3663-4bfd-9e5e-65f4475fdc82 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:40.111011 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-333dd14f-3663-4bfd-9e5e-65f4475fdc82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:40.112142 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96413cb8-7971-4276-b95b-791292f1de90 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:40.237521 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b260bb-873b-4cb6-8695-fa74e4a1db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:40.238479 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b260bb-873b-4cb6-8695-fa74e4a1db17 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:40.238924 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b260bb-873b-4cb6-8695-fa74e4a1db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:40.239359 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b260bb-873b-4cb6-8695-fa74e4a1db17 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:40.241104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b260bb-873b-4cb6-8695-fa74e4a1db17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:40.243420 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b260bb-873b-4cb6-8695-fa74e4a1db17 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:40.249486 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dd14f-3663-4bfd-9e5e-65f4475fdc82 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:40.254450 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf76e2-abe8-4ecc-9f19-1ae2beecdd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:40.255485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf76e2-abe8-4ecc-9f19-1ae2beecdd0b admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:40.255704 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf76e2-abe8-4ecc-9f19-1ae2beecdd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:40.255973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf76e2-abe8-4ecc-9f19-1ae2beecdd0b admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:40.257295 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf76e2-abe8-4ecc-9f19-1ae2beecdd0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:40.258726 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf76e2-abe8-4ecc-9f19-1ae2beecdd0b admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:40.377592 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 902/1790] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:40 2022] POST /identity/v3/users => generated 296 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:40.378657 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf3b10-1d37-40a7-85f9-c9ddde265beb None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:40.378993 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf3b10-1d37-40a7-85f9-c9ddde265beb None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:40.379825 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf3b10-1d37-40a7-85f9-c9ddde265beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:40.381804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 889/1791] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:39 2022] POST /identity/v3/projects => generated 365 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:40.383003 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b260bb-873b-4cb6-8695-fa74e4a1db17 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:40.385175 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-19b260bb-873b-4cb6-8695-fa74e4a1db17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:40.418626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-99cf3b10-1d37-40a7-85f9-c9ddde265beb None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:40.418626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-99cf3b10-1d37-40a7-85f9-c9ddde265beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:40.467448 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b260bb-873b-4cb6-8695-fa74e4a1db17 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:40.472128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e08535-8624-4fe4-980a-9509048d5074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:40.475919 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e08535-8624-4fe4-980a-9509048d5074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:40.476043 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 903/1792] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:40.476122 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e08535-8624-4fe4-980a-9509048d5074 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:40.476122 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e08535-8624-4fe4-980a-9509048d5074 admin admin] PATH_INFO: `/v3/users/fab57dc77aaf4f9dbecef9c71748fde7` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:40.476243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf3b10-1d37-40a7-85f9-c9ddde265beb None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:40.476328 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e08535-8624-4fe4-980a-9509048d5074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fab57dc77aaf4f9dbecef9c71748fde7)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:40.478616 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e08535-8624-4fe4-980a-9509048d5074 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:40.486070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf3b10-1d37-40a7-85f9-c9ddde265beb None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:40.492084 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b3c69-06cc-40c1-abb3-9a88419b12c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:40.492793 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b3c69-06cc-40c1-abb3-9a88419b12c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:40.493078 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b3c69-06cc-40c1-abb3-9a88419b12c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:40.493356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b3c69-06cc-40c1-abb3-9a88419b12c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:40.494174 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b3c69-06cc-40c1-abb3-9a88419b12c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:40.495796 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b3c69-06cc-40c1-abb3-9a88419b12c8 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:40.508527 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 904/1793] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:40.509242 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b3c69-06cc-40c1-abb3-9a88419b12c8 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:40.519366 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b3c69-06cc-40c1-abb3-9a88419b12c8 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:40.524897 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0e993-900a-420f-bee3-b4126efe4013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:40.526227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0e993-900a-420f-bee3-b4126efe4013 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:40.526227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0e993-900a-420f-bee3-b4126efe4013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:40.526227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0e993-900a-420f-bee3-b4126efe4013 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:40.526892 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0e993-900a-420f-bee3-b4126efe4013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:40.528789 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0e993-900a-420f-bee3-b4126efe4013 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:40.628465 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 905/1794] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:40 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:40.629573 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0e993-900a-420f-bee3-b4126efe4013 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:40.631653 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-9fc0e993-900a-420f-bee3-b4126efe4013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:40.703439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0e993-900a-420f-bee3-b4126efe4013 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:40.730719 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b21ee1-10b2-49c4-922f-e7a29f9be2d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:40.731596 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b21ee1-10b2-49c4-922f-e7a29f9be2d2 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:40.731889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b21ee1-10b2-49c4-922f-e7a29f9be2d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:40.732374 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b21ee1-10b2-49c4-922f-e7a29f9be2d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:40.741063 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-80e08535-8624-4fe4-980a-9509048d5074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fab57dc77aaf4f9dbecef9c71748fde7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:40.741831 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-80e08535-8624-4fe4-980a-9509048d5074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fab57dc77aaf4f9dbecef9c71748fde7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:40.744307 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b21ee1-10b2-49c4-922f-e7a29f9be2d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:40.745943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b21ee1-10b2-49c4-922f-e7a29f9be2d2 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:40.758745 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-80e08535-8624-4fe4-980a-9509048d5074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fab57dc77aaf4f9dbecef9c71748fde7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:40.767787 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-80e08535-8624-4fe4-980a-9509048d5074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fab57dc77aaf4f9dbecef9c71748fde7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:40.768665 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-80e08535-8624-4fe4-980a-9509048d5074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fab57dc77aaf4f9dbecef9c71748fde7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:40.772823 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 906/1795] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:40.774103 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b21ee1-10b2-49c4-922f-e7a29f9be2d2 service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:40.784789 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b21ee1-10b2-49c4-922f-e7a29f9be2d2 service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:40.791548 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4407-31ba-4403-b39b-65fc91ac1f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:40.791548 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4407-31ba-4403-b39b-65fc91ac1f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:40.791548 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4407-31ba-4403-b39b-65fc91ac1f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:40.791831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4407-31ba-4403-b39b-65fc91ac1f52 admin admin] PATH_INFO: `/v3/projects/a52d58374fe24b2c8a522a37e7c9cb53/users/e0cd507d989546118d2d13cd6c6abb43/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:40.809500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb4407-31ba-4403-b39b-65fc91ac1f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a52d58374fe24b2c8a522a37e7c9cb53, user_id=e0cd507d989546118d2d13cd6c6abb43, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:40.812014 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb4407-31ba-4403-b39b-65fc91ac1f52 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:40.858748 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 890/1796] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:40 2022] DELETE /identity/v3/users/fab57dc77aaf4f9dbecef9c71748fde7 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:40.864248 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e08535-8624-4fe4-980a-9509048d5074 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:40.866616 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-80e08535-8624-4fe4-980a-9509048d5074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:40.941690 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 907/1797] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:40 2022] PUT /identity/v3/projects/a52d58374fe24b2c8a522a37e7c9cb53/users/e0cd507d989546118d2d13cd6c6abb43/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:40.949084 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ee1c5-41de-47a0-9749-97f7367d5003 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:40.949581 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ee1c5-41de-47a0-9749-97f7367d5003 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:40.950064 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ee1c5-41de-47a0-9749-97f7367d5003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:40.967154 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e08535-8624-4fe4-980a-9509048d5074 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:40.978883 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-429ee1c5-41de-47a0-9749-97f7367d5003 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:40.980955 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-429ee1c5-41de-47a0-9749-97f7367d5003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:41.070696 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 908/1798] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:41.075172 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ee1c5-41de-47a0-9749-97f7367d5003 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:41.076749 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-429ee1c5-41de-47a0-9749-97f7367d5003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:41.091723 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ee1c5-41de-47a0-9749-97f7367d5003 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:41.096721 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375681c8-86de-45de-88b0-5b972f01d820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:41.097515 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375681c8-86de-45de-88b0-5b972f01d820 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:41.097801 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375681c8-86de-45de-88b0-5b972f01d820 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:41.098078 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375681c8-86de-45de-88b0-5b972f01d820 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:41.098847 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375681c8-86de-45de-88b0-5b972f01d820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:41.100538 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375681c8-86de-45de-88b0-5b972f01d820 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:41.104967 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8699c5-4d60-4a20-8962-532ba0d1644f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:41.105728 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8699c5-4d60-4a20-8962-532ba0d1644f admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:41.106594 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8699c5-4d60-4a20-8962-532ba0d1644f admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:41.106594 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8699c5-4d60-4a20-8962-532ba0d1644f admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:41.107183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8699c5-4d60-4a20-8962-532ba0d1644f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:41.108875 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8699c5-4d60-4a20-8962-532ba0d1644f admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:41.115315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 909/1799] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:41.115315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375681c8-86de-45de-88b0-5b972f01d820 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:41.117215 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-375681c8-86de-45de-88b0-5b972f01d820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:41.125130 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 891/1800] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:41.125130 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8699c5-4d60-4a20-8962-532ba0d1644f admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:41.136398 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8699c5-4d60-4a20-8962-532ba0d1644f admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:41.141770 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a257d-475e-4592-ae1f-b909c3994d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:41.143345 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a257d-475e-4592-ae1f-b909c3994d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:41.143345 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a257d-475e-4592-ae1f-b909c3994d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:41.143345 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a257d-475e-4592-ae1f-b909c3994d03 admin admin] PATH_INFO: `/v3/projects/a52d58374fe24b2c8a522a37e7c9cb53/users/e0cd507d989546118d2d13cd6c6abb43/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:41.145314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a257d-475e-4592-ae1f-b909c3994d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a52d58374fe24b2c8a522a37e7c9cb53, user_id=e0cd507d989546118d2d13cd6c6abb43, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:41.148080 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a257d-475e-4592-ae1f-b909c3994d03 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:41.169091 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 892/1801] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:41 2022] PUT /identity/v3/projects/a52d58374fe24b2c8a522a37e7c9cb53/users/e0cd507d989546118d2d13cd6c6abb43/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:41.169091 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a257d-475e-4592-ae1f-b909c3994d03 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:41.199561 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375681c8-86de-45de-88b0-5b972f01d820 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:41.238363 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a257d-475e-4592-ae1f-b909c3994d03 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:41.243856 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc3f10-013f-4326-a030-1c35398cc918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:41.244783 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc3f10-013f-4326-a030-1c35398cc918 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:41.245063 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc3f10-013f-4326-a030-1c35398cc918 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:41.245335 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc3f10-013f-4326-a030-1c35398cc918 admin admin] PATH_INFO: `/v3/projects/0f3bff3c482c405f9c82e96482450be5/users/369bc7ccfd9c482a8e8b0c236192ccbd/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:41.257910 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c3ecf-850e-4238-84dd-19089bc44d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:41.263771 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c3ecf-850e-4238-84dd-19089bc44d18 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:41.263771 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c3ecf-850e-4238-84dd-19089bc44d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:41.263771 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c3ecf-850e-4238-84dd-19089bc44d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:41.264157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc3f10-013f-4326-a030-1c35398cc918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3bff3c482c405f9c82e96482450be5, user_id=369bc7ccfd9c482a8e8b0c236192ccbd, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:41.266067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc3f10-013f-4326-a030-1c35398cc918 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:41.274444 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c3ecf-850e-4238-84dd-19089bc44d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:41.276007 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c3ecf-850e-4238-84dd-19089bc44d18 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:41.288410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 910/1802] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:41.289815 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3c08f-8608-4cd4-9547-5b85d478395a None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:41.292332 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3c08f-8608-4cd4-9547-5b85d478395a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:41.292332 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3c08f-8608-4cd4-9547-5b85d478395a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:41.323707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-c6d3c08f-8608-4cd4-9547-5b85d478395a None None] MFA Rules not processed for user `e0cd507d989546118d2d13cd6c6abb43`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:41.325449 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c6d3c08f-8608-4cd4-9547-5b85d478395a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:41.412901 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 911/1803] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:41.420536 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3c08f-8608-4cd4-9547-5b85d478395a None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:41.422096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c6d3c08f-8608-4cd4-9547-5b85d478395a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:41.422920 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 893/1804] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:41 2022] PUT /identity/v3/projects/0f3bff3c482c405f9c82e96482450be5/users/369bc7ccfd9c482a8e8b0c236192ccbd/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:41.426804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc3f10-013f-4326-a030-1c35398cc918 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:41.448500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3c08f-8608-4cd4-9547-5b85d478395a None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:41.563685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe42ba8-226f-48b3-afb5-5d85bec6c951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:41.564262 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc3f10-013f-4326-a030-1c35398cc918 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:41.564588 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe42ba8-226f-48b3-afb5-5d85bec6c951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:41.565130 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe42ba8-226f-48b3-afb5-5d85bec6c951 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:41.565419 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe42ba8-226f-48b3-afb5-5d85bec6c951 admin admin] PATH_INFO: `/v3/projects/db8d47f6e16e462c9c396cdaaa134220` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:41.568425 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe42ba8-226f-48b3-afb5-5d85bec6c951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db8d47f6e16e462c9c396cdaaa134220)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:41.571222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439e0c2-e026-4121-b8d6-4febb82c1dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:41.571367 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe42ba8-226f-48b3-afb5-5d85bec6c951 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:41.572207 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439e0c2-e026-4121-b8d6-4febb82c1dbd admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:41.572877 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439e0c2-e026-4121-b8d6-4febb82c1dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:41.573263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439e0c2-e026-4121-b8d6-4febb82c1dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:41.577858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439e0c2-e026-4121-b8d6-4febb82c1dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:41.577858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439e0c2-e026-4121-b8d6-4febb82c1dbd admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:41.590080 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 894/1805] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:56:41.591855 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439e0c2-e026-4121-b8d6-4febb82c1dbd admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:41.598637 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a439e0c2-e026-4121-b8d6-4febb82c1dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:41.674438 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439e0c2-e026-4121-b8d6-4febb82c1dbd admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:41.679181 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963eccf-0a78-4152-9870-20025205185c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:41.680622 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963eccf-0a78-4152-9870-20025205185c service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:41.680729 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963eccf-0a78-4152-9870-20025205185c service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:41.681016 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963eccf-0a78-4152-9870-20025205185c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:41.726881 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4fe42ba8-226f-48b3-afb5-5d85bec6c951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db8d47f6e16e462c9c396cdaaa134220', 'request_id': 'req-4fe42ba8-226f-48b3-afb5-5d85bec6c951'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:41.778421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963eccf-0a78-4152-9870-20025205185c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:41.780362 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963eccf-0a78-4152-9870-20025205185c service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:41.792674 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 895/1806] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:41.793644 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963eccf-0a78-4152-9870-20025205185c service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:41.806059 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963eccf-0a78-4152-9870-20025205185c service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:41.873065 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959762f-eae9-4f6d-b830-064604cc8dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:41.873994 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959762f-eae9-4f6d-b830-064604cc8dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:41.874277 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959762f-eae9-4f6d-b830-064604cc8dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:41.874553 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959762f-eae9-4f6d-b830-064604cc8dbc admin admin] PATH_INFO: `/v3/projects/0f3bff3c482c405f9c82e96482450be5/users/369bc7ccfd9c482a8e8b0c236192ccbd/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:41.876589 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959762f-eae9-4f6d-b830-064604cc8dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3bff3c482c405f9c82e96482450be5, user_id=369bc7ccfd9c482a8e8b0c236192ccbd, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:41.879419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959762f-eae9-4f6d-b830-064604cc8dbc admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:41.888308 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4fe42ba8-226f-48b3-afb5-5d85bec6c951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db8d47f6e16e462c9c396cdaaa134220', 'request_id': 'req-4fe42ba8-226f-48b3-afb5-5d85bec6c951'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:41.894147 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 896/1807] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:41 2022] PUT /identity/v3/projects/0f3bff3c482c405f9c82e96482450be5/users/369bc7ccfd9c482a8e8b0c236192ccbd/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:41.897616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4fe42ba8-226f-48b3-afb5-5d85bec6c951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db8d47f6e16e462c9c396cdaaa134220', 'request_id': 'req-4fe42ba8-226f-48b3-afb5-5d85bec6c951'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:41.914522 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c74f4-3fca-431b-be56-c2dce2034073 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:41.914767 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4fe42ba8-226f-48b3-afb5-5d85bec6c951 admin admin] The token cache is being invalidate because project db8d47f6e16e462c9c396cdaaa134220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:41.914986 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4fe42ba8-226f-48b3-afb5-5d85bec6c951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:41.915875 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c74f4-3fca-431b-be56-c2dce2034073 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:41.915990 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4fe42ba8-226f-48b3-afb5-5d85bec6c951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:41.916556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c74f4-3fca-431b-be56-c2dce2034073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:41.917549 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 912/1808] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:41 2022] DELETE /identity/v3/projects/db8d47f6e16e462c9c396cdaaa134220 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:41.921338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe42ba8-226f-48b3-afb5-5d85bec6c951 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:41.922876 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-4fe42ba8-226f-48b3-afb5-5d85bec6c951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:41.948316 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe42ba8-226f-48b3-afb5-5d85bec6c951 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:41.965549 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-685c74f4-3fca-431b-be56-c2dce2034073 None None] MFA Rules not processed for user `369bc7ccfd9c482a8e8b0c236192ccbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:41.967072 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-685c74f4-3fca-431b-be56-c2dce2034073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:42.019012 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e9410-9c7c-48b1-816e-76d113706d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:42.019896 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e9410-9c7c-48b1-816e-76d113706d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:42.020182 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e9410-9c7c-48b1-816e-76d113706d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:42.020459 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e9410-9c7c-48b1-816e-76d113706d6d admin admin] PATH_INFO: `/v3/users/e4fc54beb1f646aa849c82b49ae66751` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:42.022301 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e9410-9c7c-48b1-816e-76d113706d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4fc54beb1f646aa849c82b49ae66751)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:42.024266 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e9410-9c7c-48b1-816e-76d113706d6d admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:42.066978 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 897/1809] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:56:42.068026 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c74f4-3fca-431b-be56-c2dce2034073 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:42.069724 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-685c74f4-3fca-431b-be56-c2dce2034073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:42.084713 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c74f4-3fca-431b-be56-c2dce2034073 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:42.096259 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0ce66-4102-47ae-ba81-fd76d5090973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:42.097556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0ce66-4102-47ae-ba81-fd76d5090973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:42.097830 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0ce66-4102-47ae-ba81-fd76d5090973 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:42.098252 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0ce66-4102-47ae-ba81-fd76d5090973 admin admin] PATH_INFO: `/v3/projects/7e0b6448a5a342878ed1efe57c690efb` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:42.100920 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0ce66-4102-47ae-ba81-fd76d5090973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0b6448a5a342878ed1efe57c690efb)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:42.104261 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0ce66-4102-47ae-ba81-fd76d5090973 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:42.260092 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-be2e9410-9c7c-48b1-816e-76d113706d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4fc54beb1f646aa849c82b49ae66751'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:42.260740 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9ec0ce66-4102-47ae-ba81-fd76d5090973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0b6448a5a342878ed1efe57c690efb', 'request_id': 'req-9ec0ce66-4102-47ae-ba81-fd76d5090973'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:42.261210 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-be2e9410-9c7c-48b1-816e-76d113706d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4fc54beb1f646aa849c82b49ae66751'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:42.273838 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-be2e9410-9c7c-48b1-816e-76d113706d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4fc54beb1f646aa849c82b49ae66751'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:42.280463 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-be2e9410-9c7c-48b1-816e-76d113706d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4fc54beb1f646aa849c82b49ae66751'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:42.281862 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-be2e9410-9c7c-48b1-816e-76d113706d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4fc54beb1f646aa849c82b49ae66751'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:42.352197 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9ec0ce66-4102-47ae-ba81-fd76d5090973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0b6448a5a342878ed1efe57c690efb', 'request_id': 'req-9ec0ce66-4102-47ae-ba81-fd76d5090973'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:42.359188 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9ec0ce66-4102-47ae-ba81-fd76d5090973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0b6448a5a342878ed1efe57c690efb', 'request_id': 'req-9ec0ce66-4102-47ae-ba81-fd76d5090973'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:42.369655 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9ec0ce66-4102-47ae-ba81-fd76d5090973 admin admin] The token cache is being invalidate because project 7e0b6448a5a342878ed1efe57c690efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:42.369939 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9ec0ce66-4102-47ae-ba81-fd76d5090973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:42.370608 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9ec0ce66-4102-47ae-ba81-fd76d5090973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:42.372172 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 898/1810] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:42 2022] DELETE /identity/v3/projects/7e0b6448a5a342878ed1efe57c690efb => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:42.372970 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0ce66-4102-47ae-ba81-fd76d5090973 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:42.374277 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9ec0ce66-4102-47ae-ba81-fd76d5090973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:42.449837 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0ce66-4102-47ae-ba81-fd76d5090973 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:42.453735 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc6c8f-af4f-4fb0-bedd-2131f9314a2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:42.454390 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc6c8f-af4f-4fb0-bedd-2131f9314a2a service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:42.454674 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc6c8f-af4f-4fb0-bedd-2131f9314a2a service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:42.454953 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc6c8f-af4f-4fb0-bedd-2131f9314a2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:42.456783 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-21bc6c8f-af4f-4fb0-bedd-2131f9314a2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:42.548375 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc6c8f-af4f-4fb0-bedd-2131f9314a2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:42.548375 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc6c8f-af4f-4fb0-bedd-2131f9314a2a service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:42.548375 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 899/1811] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:42.548375 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc6c8f-af4f-4fb0-bedd-2131f9314a2a service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:42.548375 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-21bc6c8f-af4f-4fb0-bedd-2131f9314a2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:42.622318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc6c8f-af4f-4fb0-bedd-2131f9314a2a service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:42.626997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b3764-923d-408f-af5e-be41c6516450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:42.628040 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b3764-923d-408f-af5e-be41c6516450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:42.628328 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b3764-923d-408f-af5e-be41c6516450 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:42.628626 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b3764-923d-408f-af5e-be41c6516450 admin admin] PATH_INFO: `/v3/users/756ba34f71d544f281b64d9f50fb384e` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:42.629839 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b3764-923d-408f-af5e-be41c6516450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=756ba34f71d544f281b64d9f50fb384e)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:42.632761 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b3764-923d-408f-af5e-be41c6516450 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:42.970792 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 913/1812] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:41 2022] DELETE /identity/v3/users/e4fc54beb1f646aa849c82b49ae66751 => generated 0 bytes in 1050 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:56:43.608680 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e9410-9c7c-48b1-816e-76d113706d6d admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:43.611391 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-be2e9410-9c7c-48b1-816e-76d113706d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:43.714557 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-f91b3764-923d-408f-af5e-be41c6516450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756ba34f71d544f281b64d9f50fb384e'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:43.715851 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-f91b3764-923d-408f-af5e-be41c6516450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756ba34f71d544f281b64d9f50fb384e'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:43.744407 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-f91b3764-923d-408f-af5e-be41c6516450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756ba34f71d544f281b64d9f50fb384e'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:43.766453 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-f91b3764-923d-408f-af5e-be41c6516450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756ba34f71d544f281b64d9f50fb384e'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:43.769079 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-f91b3764-923d-408f-af5e-be41c6516450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756ba34f71d544f281b64d9f50fb384e'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:43.833373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e9410-9c7c-48b1-816e-76d113706d6d admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:43.842452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb8bbb-6df2-4009-878c-f581f12468e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:43.843410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb8bbb-6df2-4009-878c-f581f12468e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:43.843750 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb8bbb-6df2-4009-878c-f581f12468e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:43.844034 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb8bbb-6df2-4009-878c-f581f12468e6 admin admin] PATH_INFO: `/v3/users/4b55cfb05b0f4de5b5d8c95d96d94d52` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:43.845627 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb8bbb-6df2-4009-878c-f581f12468e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b55cfb05b0f4de5b5d8c95d96d94d52)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:43.869448 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb8bbb-6df2-4009-878c-f581f12468e6 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:43.918531 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 900/1813] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:42 2022] DELETE /identity/v3/users/756ba34f71d544f281b64d9f50fb384e => generated 0 bytes in 1381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:44.027807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b3764-923d-408f-af5e-be41c6516450 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:44.027807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f91b3764-923d-408f-af5e-be41c6516450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:44.116956 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b3764-923d-408f-af5e-be41c6516450 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:44.120078 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-22cb8bbb-6df2-4009-878c-f581f12468e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b55cfb05b0f4de5b5d8c95d96d94d52'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:44.121114 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-22cb8bbb-6df2-4009-878c-f581f12468e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b55cfb05b0f4de5b5d8c95d96d94d52'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:44.132152 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62d3f4-18fa-435c-85bd-59b7f88598ae tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd507d989546118d2d13cd6c6abb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a52d58374fe24b2c8a522a37e7c9cb53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:44.136614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d3f4-18fa-435c-85bd-59b7f88598ae tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:44.136614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d3f4-18fa-435c-85bd-59b7f88598ae tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:44.136614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d3f4-18fa-435c-85bd-59b7f88598ae tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:44.136614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62d3f4-18fa-435c-85bd-59b7f88598ae tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:44.136614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62d3f4-18fa-435c-85bd-59b7f88598ae tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:44.141884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62d3f4-18fa-435c-85bd-59b7f88598ae tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:44.163457 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-22cb8bbb-6df2-4009-878c-f581f12468e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b55cfb05b0f4de5b5d8c95d96d94d52'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:44.166124 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 901/1814] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:44.173340 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62d3f4-18fa-435c-85bd-59b7f88598ae tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:44.178636 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-22cb8bbb-6df2-4009-878c-f581f12468e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b55cfb05b0f4de5b5d8c95d96d94d52'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:44.180722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-22cb8bbb-6df2-4009-878c-f581f12468e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b55cfb05b0f4de5b5d8c95d96d94d52'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:44.185982 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-7c62d3f4-18fa-435c-85bd-59b7f88598ae tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:44.212012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62d3f4-18fa-435c-85bd-59b7f88598ae tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:44.228909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f4592-8319-4001-9b1a-c98a6b97cecd tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd507d989546118d2d13cd6c6abb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a52d58374fe24b2c8a522a37e7c9cb53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:44.229714 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f4592-8319-4001-9b1a-c98a6b97cecd tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:44.230115 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f4592-8319-4001-9b1a-c98a6b97cecd tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:44.230777 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f4592-8319-4001-9b1a-c98a6b97cecd tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:44.231576 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f4592-8319-4001-9b1a-c98a6b97cecd tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:44.233630 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f4592-8319-4001-9b1a-c98a6b97cecd tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:44.296725 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 914/1815] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:43 2022] DELETE /identity/v3/users/4b55cfb05b0f4de5b5d8c95d96d94d52 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:56:44.303043 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d30be-e139-47f6-8987-dcd2e08e0cae None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:44.304713 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d30be-e139-47f6-8987-dcd2e08e0cae None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:44.305121 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d30be-e139-47f6-8987-dcd2e08e0cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:44.334613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-425d30be-e139-47f6-8987-dcd2e08e0cae None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:44.338267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-425d30be-e139-47f6-8987-dcd2e08e0cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:44.368988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 902/1816] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:44 2022] POST /identity/v3/projects => generated 354 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:44.373457 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f4592-8319-4001-9b1a-c98a6b97cecd tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:44.446295 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 915/1817] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:56:44.462861 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d30be-e139-47f6-8987-dcd2e08e0cae None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:44.466633 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-425d30be-e139-47f6-8987-dcd2e08e0cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:44.490737 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f4592-8319-4001-9b1a-c98a6b97cecd tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:44.504494 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf4a8d-0ce3-45eb-be0d-715f7384dd6b tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd507d989546118d2d13cd6c6abb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a52d58374fe24b2c8a522a37e7c9cb53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:44.505123 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf4a8d-0ce3-45eb-be0d-715f7384dd6b tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:44.507563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf4a8d-0ce3-45eb-be0d-715f7384dd6b tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:44.507886 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf4a8d-0ce3-45eb-be0d-715f7384dd6b tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:44.510900 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf4a8d-0ce3-45eb-be0d-715f7384dd6b tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:44.513798 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf4a8d-0ce3-45eb-be0d-715f7384dd6b tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:44.522699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf4a8d-0ce3-45eb-be0d-715f7384dd6b tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:44.553473 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 903/1818] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:56:44.605404 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf4a8d-0ce3-45eb-be0d-715f7384dd6b tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:44.610215 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d30be-e139-47f6-8987-dcd2e08e0cae None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:44.619478 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf4a8d-0ce3-45eb-be0d-715f7384dd6b tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:44.626306 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95931729-6e3f-40bf-93c2-cb920e9595ea tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd507d989546118d2d13cd6c6abb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a52d58374fe24b2c8a522a37e7c9cb53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:44.627346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95931729-6e3f-40bf-93c2-cb920e9595ea tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:44.627784 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95931729-6e3f-40bf-93c2-cb920e9595ea tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:44.628065 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95931729-6e3f-40bf-93c2-cb920e9595ea tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] PATH_INFO: `/v3/projects/c4bc41833f2040aebedcf4b87a2ec9cd` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:44.629614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95931729-6e3f-40bf-93c2-cb920e9595ea tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c4bc41833f2040aebedcf4b87a2ec9cd)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:44.632876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95931729-6e3f-40bf-93c2-cb920e9595ea tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:44.704081 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94391dfb-fa90-4462-b450-85cc1874a9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:44.705037 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94391dfb-fa90-4462-b450-85cc1874a9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:44.721003 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94391dfb-fa90-4462-b450-85cc1874a9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:44.721003 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94391dfb-fa90-4462-b450-85cc1874a9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:44.787532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-95931729-6e3f-40bf-93c2-cb920e9595ea tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4bc41833f2040aebedcf4b87a2ec9cd', 'request_id': 'req-95931729-6e3f-40bf-93c2-cb920e9595ea'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:44.814026 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94391dfb-fa90-4462-b450-85cc1874a9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:44.818361 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94391dfb-fa90-4462-b450-85cc1874a9e2 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:44.828483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 916/1819] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:44.829711 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94391dfb-fa90-4462-b450-85cc1874a9e2 service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:44.831182 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-94391dfb-fa90-4462-b450-85cc1874a9e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:44.852200 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94391dfb-fa90-4462-b450-85cc1874a9e2 service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:44.930256 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-95931729-6e3f-40bf-93c2-cb920e9595ea tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4bc41833f2040aebedcf4b87a2ec9cd', 'request_id': 'req-95931729-6e3f-40bf-93c2-cb920e9595ea'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:44.938272 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-95931729-6e3f-40bf-93c2-cb920e9595ea tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4bc41833f2040aebedcf4b87a2ec9cd', 'request_id': 'req-95931729-6e3f-40bf-93c2-cb920e9595ea'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:44.978624 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-95931729-6e3f-40bf-93c2-cb920e9595ea tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] The token cache is being invalidate because project c4bc41833f2040aebedcf4b87a2ec9cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:44.979062 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-95931729-6e3f-40bf-93c2-cb920e9595ea tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:44.983864 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:44.987368 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-95931729-6e3f-40bf-93c2-cb920e9595ea tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:44.989445 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:44.991674 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:44.993130 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d admin admin] PATH_INFO: `/v3/projects/fc82f3d8ec204afe8e47d33dd40ce03d` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:44.996110 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 904/1820] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:44 2022] DELETE /identity/v3/projects/c4bc41833f2040aebedcf4b87a2ec9cd => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:45.016040 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc82f3d8ec204afe8e47d33dd40ce03d)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:45.028757 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:45.041809 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95931729-6e3f-40bf-93c2-cb920e9595ea tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:45.044150 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-95931729-6e3f-40bf-93c2-cb920e9595ea tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:45.115517 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95931729-6e3f-40bf-93c2-cb920e9595ea tempest-VolumeQuotaClassesTest-424985837 tempest-VolumeQuotaClassesTest-424985837-project-admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:45.132951 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2be104-e448-406b-985f-1c0a0bd2c8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:45.133668 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2be104-e448-406b-985f-1c0a0bd2c8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:45.133950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2be104-e448-406b-985f-1c0a0bd2c8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:45.134228 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2be104-e448-406b-985f-1c0a0bd2c8f2 admin admin] PATH_INFO: `/v3/users/514245096a0347f2b8d7b08b343687d1` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:45.137398 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2be104-e448-406b-985f-1c0a0bd2c8f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=514245096a0347f2b8d7b08b343687d1)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:45.139926 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2be104-e448-406b-985f-1c0a0bd2c8f2 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:45.260165 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc82f3d8ec204afe8e47d33dd40ce03d', 'request_id': 'req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:45.347994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc82f3d8ec204afe8e47d33dd40ce03d', 'request_id': 'req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:45.370023 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc82f3d8ec204afe8e47d33dd40ce03d', 'request_id': 'req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:45.372734 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-4b2be104-e448-406b-985f-1c0a0bd2c8f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '514245096a0347f2b8d7b08b343687d1'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:45.373749 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-4b2be104-e448-406b-985f-1c0a0bd2c8f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '514245096a0347f2b8d7b08b343687d1'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:45.387767 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d admin admin] The token cache is being invalidate because project fc82f3d8ec204afe8e47d33dd40ce03d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:45.387767 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:45.387767 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:45.389822 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 917/1821] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:44 2022] DELETE /identity/v3/projects/fc82f3d8ec204afe8e47d33dd40ce03d => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:45.394992 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:45.398677 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:45.408561 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-4b2be104-e448-406b-985f-1c0a0bd2c8f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '514245096a0347f2b8d7b08b343687d1'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:45.426613 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-4b2be104-e448-406b-985f-1c0a0bd2c8f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '514245096a0347f2b8d7b08b343687d1'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:45.427510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-4b2be104-e448-406b-985f-1c0a0bd2c8f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '514245096a0347f2b8d7b08b343687d1'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:45.494973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d2cfd-d8e9-4156-9d6e-77b0903d1b0d admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:45.501804 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2cf33-9726-484d-b54b-deb2ed03aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:45.503072 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2cf33-9726-484d-b54b-deb2ed03aa89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:45.504362 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2cf33-9726-484d-b54b-deb2ed03aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:45.505821 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2cf33-9726-484d-b54b-deb2ed03aa89 admin admin] PATH_INFO: `/v3/projects/1b5ae3ae3ccd4e43b31fd8fcdc2c1e91` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:45.507939 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2cf33-9726-484d-b54b-deb2ed03aa89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5ae3ae3ccd4e43b31fd8fcdc2c1e91)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:45.512536 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2cf33-9726-484d-b54b-deb2ed03aa89 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:45.547215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 905/1822] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:45 2022] DELETE /identity/v3/users/514245096a0347f2b8d7b08b343687d1 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:45.548639 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5defd0-3b4a-43f3-aa71-6f0f485759da None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:45.548928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5defd0-3b4a-43f3-aa71-6f0f485759da None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:45.549204 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5defd0-3b4a-43f3-aa71-6f0f485759da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:45.577775 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-1b5defd0-3b4a-43f3-aa71-6f0f485759da None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:45.579231 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1b5defd0-3b4a-43f3-aa71-6f0f485759da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:45.659952 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 906/1823] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:45.662131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36859279-0ef7-437e-ab2b-e461fa5b38de None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:45.662603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36859279-0ef7-437e-ab2b-e461fa5b38de None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:45.663015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36859279-0ef7-437e-ab2b-e461fa5b38de None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:45.665262 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 907/1824] 10.222.0.52 () {54 vars in 921 bytes} [Thu Apr 14 21:56:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:56:45.666582 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cae31-4c18-46e3-82f4-a5e47bdb53a2 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:45.667148 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cae31-4c18-46e3-82f4-a5e47bdb53a2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:45.667590 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cae31-4c18-46e3-82f4-a5e47bdb53a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:45.694725 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-961cae31-4c18-46e3-82f4-a5e47bdb53a2 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:45.697191 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-961cae31-4c18-46e3-82f4-a5e47bdb53a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:45.748890 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f0d2cf33-9726-484d-b54b-deb2ed03aa89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5ae3ae3ccd4e43b31fd8fcdc2c1e91', 'request_id': 'req-f0d2cf33-9726-484d-b54b-deb2ed03aa89'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:45.777475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 908/1825] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:45.785500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb42d22-f669-45bb-91e9-8b47d889e7fe None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:45.785500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb42d22-f669-45bb-91e9-8b47d889e7fe None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:45.785500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb42d22-f669-45bb-91e9-8b47d889e7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:45.822658 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-afb42d22-f669-45bb-91e9-8b47d889e7fe None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:45.826950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-afb42d22-f669-45bb-91e9-8b47d889e7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:45.846530 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 909/1826] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:45.848792 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c136bed-8c15-41a8-90a7-4b5732f6df28 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:45.851004 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c136bed-8c15-41a8-90a7-4b5732f6df28 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:45.852073 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c136bed-8c15-41a8-90a7-4b5732f6df28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:45.882770 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f0d2cf33-9726-484d-b54b-deb2ed03aa89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5ae3ae3ccd4e43b31fd8fcdc2c1e91', 'request_id': 'req-f0d2cf33-9726-484d-b54b-deb2ed03aa89'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:45.890032 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-5c136bed-8c15-41a8-90a7-4b5732f6df28 None None] MFA Rules not processed for user `e7f3ea629181433eb8c6d5dbc354c141`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:45.892489 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f0d2cf33-9726-484d-b54b-deb2ed03aa89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5ae3ae3ccd4e43b31fd8fcdc2c1e91', 'request_id': 'req-f0d2cf33-9726-484d-b54b-deb2ed03aa89'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:45.892637 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5c136bed-8c15-41a8-90a7-4b5732f6df28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:45.918483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f0d2cf33-9726-484d-b54b-deb2ed03aa89 admin admin] The token cache is being invalidate because project 1b5ae3ae3ccd4e43b31fd8fcdc2c1e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:45.918483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f0d2cf33-9726-484d-b54b-deb2ed03aa89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:45.919284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f0d2cf33-9726-484d-b54b-deb2ed03aa89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:45.921205 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 918/1827] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:45 2022] DELETE /identity/v3/projects/1b5ae3ae3ccd4e43b31fd8fcdc2c1e91 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:45.921969 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2cf33-9726-484d-b54b-deb2ed03aa89 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:45.925370 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f0d2cf33-9726-484d-b54b-deb2ed03aa89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:46.024836 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 910/1828] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Apr 14 21:56:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:46.026542 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c136bed-8c15-41a8-90a7-4b5732f6df28 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:46.030093 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5c136bed-8c15-41a8-90a7-4b5732f6df28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:46.046346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c136bed-8c15-41a8-90a7-4b5732f6df28 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:46.061499 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad6e31-dcda-48da-aca1-15c19b2498e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:46.065921 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad6e31-dcda-48da-aca1-15c19b2498e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:46.066332 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad6e31-dcda-48da-aca1-15c19b2498e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:46.066706 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad6e31-dcda-48da-aca1-15c19b2498e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:46.068991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad6e31-dcda-48da-aca1-15c19b2498e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:46.069746 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad6e31-dcda-48da-aca1-15c19b2498e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:46.072177 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad6e31-dcda-48da-aca1-15c19b2498e2 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:46.091548 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2cf33-9726-484d-b54b-deb2ed03aa89 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:46.091640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 911/1829] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:46.091640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad6e31-dcda-48da-aca1-15c19b2498e2 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:46.094529 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-18ad6e31-dcda-48da-aca1-15c19b2498e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:46.094666 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b5878-cad6-43ce-9638-4075b5fa3a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:46.095457 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b5878-cad6-43ce-9638-4075b5fa3a79 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:46.095820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b5878-cad6-43ce-9638-4075b5fa3a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:46.096171 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b5878-cad6-43ce-9638-4075b5fa3a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:46.100929 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ca5b5878-cad6-43ce-9638-4075b5fa3a79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:46.118845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b5878-cad6-43ce-9638-4075b5fa3a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:46.120446 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b5878-cad6-43ce-9638-4075b5fa3a79 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:46.130872 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad6e31-dcda-48da-aca1-15c19b2498e2 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:46.136730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 919/1830] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:46.137242 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7689e1-e498-4733-b617-93a00001370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:46.138473 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd603d-1a42-40a3-86a9-38e71431db8b None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:46.138838 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd603d-1a42-40a3-86a9-38e71431db8b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:46.139209 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd603d-1a42-40a3-86a9-38e71431db8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:46.139333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7689e1-e498-4733-b617-93a00001370f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:46.139609 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7689e1-e498-4733-b617-93a00001370f admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:46.139890 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7689e1-e498-4733-b617-93a00001370f admin admin] PATH_INFO: `/v3/projects/4c46e95c051b41ab871c99dd81834533` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:46.141346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7689e1-e498-4733-b617-93a00001370f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c46e95c051b41ab871c99dd81834533)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:46.148875 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7689e1-e498-4733-b617-93a00001370f admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:46.172876 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-89bd603d-1a42-40a3-86a9-38e71431db8b None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:46.174381 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-89bd603d-1a42-40a3-86a9-38e71431db8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:46.184105 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 920/1831] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:46.185297 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd603d-1a42-40a3-86a9-38e71431db8b None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:46.186868 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-89bd603d-1a42-40a3-86a9-38e71431db8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:46.209807 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd603d-1a42-40a3-86a9-38e71431db8b None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:46.218979 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad900f0-ab59-438f-b0b0-e07b4ff125e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:46.219984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad900f0-ab59-438f-b0b0-e07b4ff125e5 service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:46.220806 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad900f0-ab59-438f-b0b0-e07b4ff125e5 service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:46.221361 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad900f0-ab59-438f-b0b0-e07b4ff125e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:46.233953 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad900f0-ab59-438f-b0b0-e07b4ff125e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:46.236087 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad900f0-ab59-438f-b0b0-e07b4ff125e5 service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:46.251920 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 921/1832] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:46.252895 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad900f0-ab59-438f-b0b0-e07b4ff125e5 service nova] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:46.254894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-1ad900f0-ab59-438f-b0b0-e07b4ff125e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:46.272977 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad900f0-ab59-438f-b0b0-e07b4ff125e5 service nova] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:46.278507 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8a8f-5904-47bd-ae38-ba60d9f4bfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:46.279552 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8a8f-5904-47bd-ae38-ba60d9f4bfbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:46.279901 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8a8f-5904-47bd-ae38-ba60d9f4bfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:46.280178 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8a8f-5904-47bd-ae38-ba60d9f4bfbc admin admin] PATH_INFO: `/v3/users/0f6b4ed1e27f4782bd883d4011d005bf` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:46.281604 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f8a8f-5904-47bd-ae38-ba60d9f4bfbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f6b4ed1e27f4782bd883d4011d005bf)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:46.283724 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f8a8f-5904-47bd-ae38-ba60d9f4bfbc admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:46.359884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ca7689e1-e498-4733-b617-93a00001370f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c46e95c051b41ab871c99dd81834533', 'request_id': 'req-ca7689e1-e498-4733-b617-93a00001370f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:46.447291 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ca7689e1-e498-4733-b617-93a00001370f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c46e95c051b41ab871c99dd81834533', 'request_id': 'req-ca7689e1-e498-4733-b617-93a00001370f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:46.454826 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ca7689e1-e498-4733-b617-93a00001370f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c46e95c051b41ab871c99dd81834533', 'request_id': 'req-ca7689e1-e498-4733-b617-93a00001370f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:46.468025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ca7689e1-e498-4733-b617-93a00001370f admin admin] The token cache is being invalidate because project 4c46e95c051b41ab871c99dd81834533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:46.468317 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ca7689e1-e498-4733-b617-93a00001370f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:46.469033 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ca7689e1-e498-4733-b617-93a00001370f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:46.471147 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 912/1833] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:46 2022] DELETE /identity/v3/projects/4c46e95c051b41ab871c99dd81834533 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:46.472061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7689e1-e498-4733-b617-93a00001370f admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:46.473530 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ca7689e1-e498-4733-b617-93a00001370f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:46.501253 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-070f8a8f-5904-47bd-ae38-ba60d9f4bfbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f6b4ed1e27f4782bd883d4011d005bf'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:46.502038 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-070f8a8f-5904-47bd-ae38-ba60d9f4bfbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f6b4ed1e27f4782bd883d4011d005bf'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:46.527284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-070f8a8f-5904-47bd-ae38-ba60d9f4bfbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f6b4ed1e27f4782bd883d4011d005bf'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:46.535896 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-070f8a8f-5904-47bd-ae38-ba60d9f4bfbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f6b4ed1e27f4782bd883d4011d005bf'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:46.537501 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-070f8a8f-5904-47bd-ae38-ba60d9f4bfbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f6b4ed1e27f4782bd883d4011d005bf'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:46.569249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7689e1-e498-4733-b617-93a00001370f admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:46.574494 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d8e81-44cb-4a6d-bc55-90cede9af7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:46.575174 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d8e81-44cb-4a6d-bc55-90cede9af7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:46.575458 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d8e81-44cb-4a6d-bc55-90cede9af7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:46.575734 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d8e81-44cb-4a6d-bc55-90cede9af7f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:46.576450 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d8e81-44cb-4a6d-bc55-90cede9af7f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:46.578469 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d8e81-44cb-4a6d-bc55-90cede9af7f9 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:46.633588 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 922/1834] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:46 2022] DELETE /identity/v3/users/0f6b4ed1e27f4782bd883d4011d005bf => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:46.634757 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44ebdf-6d0d-4933-82d2-909ded2439f3 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:46.635122 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44ebdf-6d0d-4933-82d2-909ded2439f3 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:46.636153 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44ebdf-6d0d-4933-82d2-909ded2439f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:46.658529 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-8f44ebdf-6d0d-4933-82d2-909ded2439f3 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:46.660511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8f44ebdf-6d0d-4933-82d2-909ded2439f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:46.694071 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 913/1835] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:46 2022] POST /identity/v3/projects => generated 387 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:46.696564 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d8e81-44cb-4a6d-bc55-90cede9af7f9 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:46.701319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d79d8e81-44cb-4a6d-bc55-90cede9af7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:46.763862 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 923/1836] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:46.767953 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895ee11-65ea-4df7-9ef7-c68266547bbf None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:46.768248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895ee11-65ea-4df7-9ef7-c68266547bbf None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:46.768530 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895ee11-65ea-4df7-9ef7-c68266547bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:46.796264 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-c895ee11-65ea-4df7-9ef7-c68266547bbf None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:46.797649 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c895ee11-65ea-4df7-9ef7-c68266547bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:46.816526 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 924/1837] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:46.817282 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895ee11-65ea-4df7-9ef7-c68266547bbf None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:46.819960 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c895ee11-65ea-4df7-9ef7-c68266547bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:46.825322 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d8e81-44cb-4a6d-bc55-90cede9af7f9 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:46.836370 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d639b5-6d0e-40c9-85d4-c526130cca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:46.837577 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d639b5-6d0e-40c9-85d4-c526130cca65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:46.837859 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d639b5-6d0e-40c9-85d4-c526130cca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:46.838133 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d639b5-6d0e-40c9-85d4-c526130cca65 admin admin] PATH_INFO: `/v3/users/a50c2c14c614409da4191e58187a4385` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:46.839412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d639b5-6d0e-40c9-85d4-c526130cca65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a50c2c14c614409da4191e58187a4385)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:46.841209 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895ee11-65ea-4df7-9ef7-c68266547bbf None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:46.841471 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d639b5-6d0e-40c9-85d4-c526130cca65 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:46.850197 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cd27a-76ec-4ffc-b6a7-3b076aa00126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:46.851024 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cd27a-76ec-4ffc-b6a7-3b076aa00126 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:46.851306 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cd27a-76ec-4ffc-b6a7-3b076aa00126 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:46.851589 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cd27a-76ec-4ffc-b6a7-3b076aa00126 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:46.852281 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cd27a-76ec-4ffc-b6a7-3b076aa00126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:46.854901 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cd27a-76ec-4ffc-b6a7-3b076aa00126 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:47.007654 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 925/1838] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:46 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:47.007654 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cd27a-76ec-4ffc-b6a7-3b076aa00126 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:47.009453 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-fd7cd27a-76ec-4ffc-b6a7-3b076aa00126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:47.032184 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cd27a-76ec-4ffc-b6a7-3b076aa00126 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:47.040010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32154b14-0600-487e-83a4-666af82cb7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:47.041203 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32154b14-0600-487e-83a4-666af82cb7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:47.041665 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32154b14-0600-487e-83a4-666af82cb7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:47.042529 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32154b14-0600-487e-83a4-666af82cb7e7 admin admin] PATH_INFO: `/v3/projects/4e3689ab82fa4669a09265abe7bcb087` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:47.044623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32154b14-0600-487e-83a4-666af82cb7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3689ab82fa4669a09265abe7bcb087)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:47.047102 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32154b14-0600-487e-83a4-666af82cb7e7 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:47.112654 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-06d639b5-6d0e-40c9-85d4-c526130cca65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a50c2c14c614409da4191e58187a4385'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:47.117425 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-06d639b5-6d0e-40c9-85d4-c526130cca65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a50c2c14c614409da4191e58187a4385'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:47.144725 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-06d639b5-6d0e-40c9-85d4-c526130cca65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a50c2c14c614409da4191e58187a4385'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:47.155310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-06d639b5-6d0e-40c9-85d4-c526130cca65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a50c2c14c614409da4191e58187a4385'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:47.156220 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-06d639b5-6d0e-40c9-85d4-c526130cca65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a50c2c14c614409da4191e58187a4385'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:47.188978 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-32154b14-0600-487e-83a4-666af82cb7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3689ab82fa4669a09265abe7bcb087', 'request_id': 'req-32154b14-0600-487e-83a4-666af82cb7e7'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:47.240170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 914/1839] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:46 2022] DELETE /identity/v3/users/a50c2c14c614409da4191e58187a4385 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:47.240170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d639b5-6d0e-40c9-85d4-c526130cca65 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:47.241696 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-06d639b5-6d0e-40c9-85d4-c526130cca65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:47.313332 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-32154b14-0600-487e-83a4-666af82cb7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3689ab82fa4669a09265abe7bcb087', 'request_id': 'req-32154b14-0600-487e-83a4-666af82cb7e7'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:47.325843 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-32154b14-0600-487e-83a4-666af82cb7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3689ab82fa4669a09265abe7bcb087', 'request_id': 'req-32154b14-0600-487e-83a4-666af82cb7e7'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:47.360739 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d639b5-6d0e-40c9-85d4-c526130cca65 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:47.368117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-32154b14-0600-487e-83a4-666af82cb7e7 admin admin] The token cache is being invalidate because project 4e3689ab82fa4669a09265abe7bcb087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:47.368417 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-32154b14-0600-487e-83a4-666af82cb7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:47.368663 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd3ecd-1a36-49c6-997a-41d1a759267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:47.369276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd3ecd-1a36-49c6-997a-41d1a759267c admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:47.370420 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd3ecd-1a36-49c6-997a-41d1a759267c admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:47.370807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd3ecd-1a36-49c6-997a-41d1a759267c admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:47.371636 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-32154b14-0600-487e-83a4-666af82cb7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:47.372277 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd3ecd-1a36-49c6-997a-41d1a759267c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:47.372615 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd3ecd-1a36-49c6-997a-41d1a759267c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:47.374247 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd3ecd-1a36-49c6-997a-41d1a759267c admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:47.375623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 926/1840] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:47 2022] DELETE /identity/v3/projects/4e3689ab82fa4669a09265abe7bcb087 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:47.376712 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32154b14-0600-487e-83a4-666af82cb7e7 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:47.381592 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-32154b14-0600-487e-83a4-666af82cb7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:47.389872 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 915/1841] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:47.390816 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd3ecd-1a36-49c6-997a-41d1a759267c admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:47.401744 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-08cd3ecd-1a36-49c6-997a-41d1a759267c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:47.422729 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd3ecd-1a36-49c6-997a-41d1a759267c admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:47.432638 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91866972-d0ac-4128-8ed3-2691723f1313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:47.433338 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91866972-d0ac-4128-8ed3-2691723f1313 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:47.433617 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91866972-d0ac-4128-8ed3-2691723f1313 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:47.433885 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91866972-d0ac-4128-8ed3-2691723f1313 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:47.434636 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91866972-d0ac-4128-8ed3-2691723f1313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:47.437008 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91866972-d0ac-4128-8ed3-2691723f1313 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:47.480281 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 916/1842] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:47.481534 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91866972-d0ac-4128-8ed3-2691723f1313 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:47.484311 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-91866972-d0ac-4128-8ed3-2691723f1313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:47.511602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91866972-d0ac-4128-8ed3-2691723f1313 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:47.519140 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2707231-f149-45ea-9077-de1c82716a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:47.532510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2707231-f149-45ea-9077-de1c82716a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:47.532510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2707231-f149-45ea-9077-de1c82716a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:47.532510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2707231-f149-45ea-9077-de1c82716a35 admin admin] PATH_INFO: `/v3/users/369bc7ccfd9c482a8e8b0c236192ccbd` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:47.532510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2707231-f149-45ea-9077-de1c82716a35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=369bc7ccfd9c482a8e8b0c236192ccbd)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:47.532510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2707231-f149-45ea-9077-de1c82716a35 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:47.533115 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32154b14-0600-487e-83a4-666af82cb7e7 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:47.597096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc3792-352d-4273-865d-dbdd7ceff3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:47.597762 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3792-352d-4273-865d-dbdd7ceff3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:47.598045 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3792-352d-4273-865d-dbdd7ceff3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:47.598316 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3792-352d-4273-865d-dbdd7ceff3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:47.600746 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-35bc3792-352d-4273-865d-dbdd7ceff3d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:47.613685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc3792-352d-4273-865d-dbdd7ceff3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:47.615805 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc3792-352d-4273-865d-dbdd7ceff3d5 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:47.625930 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 927/1843] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:47.626914 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc3792-352d-4273-865d-dbdd7ceff3d5 service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:47.628180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-35bc3792-352d-4273-865d-dbdd7ceff3d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:47.640269 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc3792-352d-4273-865d-dbdd7ceff3d5 service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:47.645347 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0e971-f8eb-4e4c-9672-13a4219c61ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:47.646189 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0e971-f8eb-4e4c-9672-13a4219c61ec admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:47.646347 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0e971-f8eb-4e4c-9672-13a4219c61ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:47.646627 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0e971-f8eb-4e4c-9672-13a4219c61ec admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:47.647998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0e971-f8eb-4e4c-9672-13a4219c61ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:47.649455 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0e971-f8eb-4e4c-9672-13a4219c61ec admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:47.763667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 928/1844] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:47 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:47.764562 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0e971-f8eb-4e4c-9672-13a4219c61ec admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:47.815939 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-a2707231-f149-45ea-9077-de1c82716a35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '369bc7ccfd9c482a8e8b0c236192ccbd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:47.816804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-a2707231-f149-45ea-9077-de1c82716a35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '369bc7ccfd9c482a8e8b0c236192ccbd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:47.841625 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-a2707231-f149-45ea-9077-de1c82716a35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '369bc7ccfd9c482a8e8b0c236192ccbd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:47.851788 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-a2707231-f149-45ea-9077-de1c82716a35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '369bc7ccfd9c482a8e8b0c236192ccbd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:47.852839 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-a2707231-f149-45ea-9077-de1c82716a35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '369bc7ccfd9c482a8e8b0c236192ccbd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:47.853872 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0e971-f8eb-4e4c-9672-13a4219c61ec admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:47.863775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe3a01-ca6a-469a-8aa6-4dc313ef7ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:47.864470 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe3a01-ca6a-469a-8aa6-4dc313ef7ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:47.865755 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe3a01-ca6a-469a-8aa6-4dc313ef7ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:47.866047 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe3a01-ca6a-469a-8aa6-4dc313ef7ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:47.866831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe3a01-ca6a-469a-8aa6-4dc313ef7ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:47.868457 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe3a01-ca6a-469a-8aa6-4dc313ef7ac4 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:47.878886 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 929/1845] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:47.879996 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe3a01-ca6a-469a-8aa6-4dc313ef7ac4 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:47.882341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-aafe3a01-ca6a-469a-8aa6-4dc313ef7ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:47.900685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe3a01-ca6a-469a-8aa6-4dc313ef7ac4 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:47.905671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fc09b-56fe-45e4-b1db-70a140d0e6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:47.906346 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fc09b-56fe-45e4-b1db-70a140d0e6ef admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:47.906632 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fc09b-56fe-45e4-b1db-70a140d0e6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:47.906908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fc09b-56fe-45e4-b1db-70a140d0e6ef admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:47.907856 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169fc09b-56fe-45e4-b1db-70a140d0e6ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:47.909945 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169fc09b-56fe-45e4-b1db-70a140d0e6ef admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:47.983555 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 917/1846] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:47 2022] DELETE /identity/v3/users/369bc7ccfd9c482a8e8b0c236192ccbd => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:47.988830 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2707231-f149-45ea-9077-de1c82716a35 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:47.990661 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a2707231-f149-45ea-9077-de1c82716a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:48.045151 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 930/1847] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:47 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:48.047233 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fc09b-56fe-45e4-b1db-70a140d0e6ef admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:48.051373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-169fc09b-56fe-45e4-b1db-70a140d0e6ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:48.073970 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2707231-f149-45ea-9077-de1c82716a35 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:48.080094 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6989de-46c6-4a03-83c3-21a215be893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:48.082933 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6989de-46c6-4a03-83c3-21a215be893d admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:48.083926 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6989de-46c6-4a03-83c3-21a215be893d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:48.085070 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6989de-46c6-4a03-83c3-21a215be893d admin admin] PATH_INFO: `/v3/projects/f21b141486fa4e5581b5416a25be3c3b/users/6beffd101ec04e9488378f1713b5c16c/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:48.109126 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6989de-46c6-4a03-83c3-21a215be893d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f21b141486fa4e5581b5416a25be3c3b, user_id=6beffd101ec04e9488378f1713b5c16c, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:48.111830 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fc09b-56fe-45e4-b1db-70a140d0e6ef admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:48.112315 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6989de-46c6-4a03-83c3-21a215be893d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:48.121698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1c166-76aa-4530-b463-a0806a9d1714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:48.122582 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1c166-76aa-4530-b463-a0806a9d1714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:48.122854 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1c166-76aa-4530-b463-a0806a9d1714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:48.123127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1c166-76aa-4530-b463-a0806a9d1714 admin admin] PATH_INFO: `/v3/projects/e51942938cab47e691a09e7839e732be` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:48.124309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1c166-76aa-4530-b463-a0806a9d1714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e51942938cab47e691a09e7839e732be)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:48.126246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1c166-76aa-4530-b463-a0806a9d1714 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:48.225273 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 918/1848] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:47 2022] PUT /identity/v3/projects/f21b141486fa4e5581b5416a25be3c3b/users/6beffd101ec04e9488378f1713b5c16c/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:48.229694 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6989de-46c6-4a03-83c3-21a215be893d admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:48.315617 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b8e1c166-76aa-4530-b463-a0806a9d1714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e51942938cab47e691a09e7839e732be', 'request_id': 'req-b8e1c166-76aa-4530-b463-a0806a9d1714'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:48.348685 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6989de-46c6-4a03-83c3-21a215be893d admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:48.416934 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b8e1c166-76aa-4530-b463-a0806a9d1714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e51942938cab47e691a09e7839e732be', 'request_id': 'req-b8e1c166-76aa-4530-b463-a0806a9d1714'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:48.424780 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3a286-b6f1-47ba-a88e-8689d00c2fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:48.425764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3a286-b6f1-47ba-a88e-8689d00c2fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:48.426291 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3a286-b6f1-47ba-a88e-8689d00c2fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:48.426568 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b8e1c166-76aa-4530-b463-a0806a9d1714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e51942938cab47e691a09e7839e732be', 'request_id': 'req-b8e1c166-76aa-4530-b463-a0806a9d1714'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:48.426777 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3a286-b6f1-47ba-a88e-8689d00c2fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:48.428622 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3a286-b6f1-47ba-a88e-8689d00c2fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:48.432141 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3a286-b6f1-47ba-a88e-8689d00c2fc9 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:48.441782 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b8e1c166-76aa-4530-b463-a0806a9d1714 admin admin] The token cache is being invalidate because project e51942938cab47e691a09e7839e732be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:48.442279 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b8e1c166-76aa-4530-b463-a0806a9d1714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:48.444421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b8e1c166-76aa-4530-b463-a0806a9d1714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:48.450617 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 919/1850] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:48.451688 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 931/1850] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:48 2022] DELETE /identity/v3/projects/e51942938cab47e691a09e7839e732be => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:48.452107 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc5e9b-4ab4-41ee-a4bd-6577b5169b10 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:48.452395 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc5e9b-4ab4-41ee-a4bd-6577b5169b10 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:48.452700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc5e9b-4ab4-41ee-a4bd-6577b5169b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:48.453348 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1c166-76aa-4530-b463-a0806a9d1714 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:48.454944 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b8e1c166-76aa-4530-b463-a0806a9d1714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:48.472449 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1c166-76aa-4530-b463-a0806a9d1714 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:48.479584 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d5eab-cdd6-457a-86a0-46583f66e69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:48.480982 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d5eab-cdd6-457a-86a0-46583f66e69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:48.481619 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d5eab-cdd6-457a-86a0-46583f66e69a admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:48.481952 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d5eab-cdd6-457a-86a0-46583f66e69a admin admin] PATH_INFO: `/v3/projects/9b0c402f9964411cabaa6f1d907a4967` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:48.483574 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d5eab-cdd6-457a-86a0-46583f66e69a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b0c402f9964411cabaa6f1d907a4967)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:48.485850 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-b3fc5e9b-4ab4-41ee-a4bd-6577b5169b10 None None] MFA Rules not processed for user `6beffd101ec04e9488378f1713b5c16c`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:48.486897 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d5eab-cdd6-457a-86a0-46583f66e69a admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:48.487522 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b3fc5e9b-4ab4-41ee-a4bd-6577b5169b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:48.590569 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 920/1851] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:48.612219 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc5e9b-4ab4-41ee-a4bd-6577b5169b10 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:48.615466 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b3fc5e9b-4ab4-41ee-a4bd-6577b5169b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:48.630800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc5e9b-4ab4-41ee-a4bd-6577b5169b10 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:48.636160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc6612-5dd1-4ad4-b387-ed1579a74d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:48.636914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc6612-5dd1-4ad4-b387-ed1579a74d16 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:48.637220 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc6612-5dd1-4ad4-b387-ed1579a74d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:48.637552 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc6612-5dd1-4ad4-b387-ed1579a74d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:48.638293 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc6612-5dd1-4ad4-b387-ed1579a74d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:48.639900 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc6612-5dd1-4ad4-b387-ed1579a74d16 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:48.654768 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 921/1852] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:48.654768 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d571ec-9a65-4803-8341-fda88a72ee2e None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:48.654768 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d571ec-9a65-4803-8341-fda88a72ee2e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:48.654768 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d571ec-9a65-4803-8341-fda88a72ee2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:48.672430 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-84d571ec-9a65-4803-8341-fda88a72ee2e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:48.673691 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-84d571ec-9a65-4803-8341-fda88a72ee2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:48.685036 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 922/1853] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:48.685889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d571ec-9a65-4803-8341-fda88a72ee2e None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:48.694942 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-84d571ec-9a65-4803-8341-fda88a72ee2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:48.729871 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-512d5eab-cdd6-457a-86a0-46583f66e69a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b0c402f9964411cabaa6f1d907a4967', 'request_id': 'req-512d5eab-cdd6-457a-86a0-46583f66e69a'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:48.731743 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d571ec-9a65-4803-8341-fda88a72ee2e None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:48.805328 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-512d5eab-cdd6-457a-86a0-46583f66e69a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b0c402f9964411cabaa6f1d907a4967', 'request_id': 'req-512d5eab-cdd6-457a-86a0-46583f66e69a'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:48.815581 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-512d5eab-cdd6-457a-86a0-46583f66e69a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b0c402f9964411cabaa6f1d907a4967', 'request_id': 'req-512d5eab-cdd6-457a-86a0-46583f66e69a'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:48.833692 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-512d5eab-cdd6-457a-86a0-46583f66e69a admin admin] The token cache is being invalidate because project 9b0c402f9964411cabaa6f1d907a4967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:48.833983 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-512d5eab-cdd6-457a-86a0-46583f66e69a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:48.834851 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-512d5eab-cdd6-457a-86a0-46583f66e69a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:48.835030 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e7978-432f-4ac4-9c33-e3c5ddcfdbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:48.835969 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e7978-432f-4ac4-9c33-e3c5ddcfdbdd admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:48.836322 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e7978-432f-4ac4-9c33-e3c5ddcfdbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:48.839669 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e7978-432f-4ac4-9c33-e3c5ddcfdbdd admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:48.839828 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 932/1854] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:48 2022] DELETE /identity/v3/projects/9b0c402f9964411cabaa6f1d907a4967 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:48.839906 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e7978-432f-4ac4-9c33-e3c5ddcfdbdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:48.840000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d5eab-cdd6-457a-86a0-46583f66e69a admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:48.840000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-512d5eab-cdd6-457a-86a0-46583f66e69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:48.840503 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e7978-432f-4ac4-9c33-e3c5ddcfdbdd admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:48.857340 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d5eab-cdd6-457a-86a0-46583f66e69a admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:48.868563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68068e6-9fd5-4ef2-872e-4e8467dab48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:48.869661 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68068e6-9fd5-4ef2-872e-4e8467dab48f admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:48.870107 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68068e6-9fd5-4ef2-872e-4e8467dab48f admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:48.870511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68068e6-9fd5-4ef2-872e-4e8467dab48f admin admin] PATH_INFO: `/v3/projects/305c41ea276f49cf92de0d997322f130/users/f12c518350e249f4945253f49e09c14f/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:48.897905 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68068e6-9fd5-4ef2-872e-4e8467dab48f admin admin] RBAC: Authorizing `identity:create_grant(project_id=305c41ea276f49cf92de0d997322f130, user_id=f12c518350e249f4945253f49e09c14f, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:48.900843 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68068e6-9fd5-4ef2-872e-4e8467dab48f admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:48.992136 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 923/1855] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:48 2022] POST /identity/v3/projects => generated 387 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:48.993580 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9d912-eaaa-4934-bf0d-bac864e6502f None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:48.993814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9d912-eaaa-4934-bf0d-bac864e6502f None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:48.994821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9d912-eaaa-4934-bf0d-bac864e6502f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:49.011853 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 933/1856] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:48 2022] PUT /identity/v3/projects/305c41ea276f49cf92de0d997322f130/users/f12c518350e249f4945253f49e09c14f/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:49.012937 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68068e6-9fd5-4ef2-872e-4e8467dab48f admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:49.028673 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d68068e6-9fd5-4ef2-872e-4e8467dab48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:49.028840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-09d9d912-eaaa-4934-bf0d-bac864e6502f None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:49.028840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-09d9d912-eaaa-4934-bf0d-bac864e6502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:49.092010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68068e6-9fd5-4ef2-872e-4e8467dab48f admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:49.092712 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 924/1857] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:49.093776 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9d912-eaaa-4934-bf0d-bac864e6502f None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:49.095039 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-09d9d912-eaaa-4934-bf0d-bac864e6502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:49.096900 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ba817-89da-4713-8812-8d0442a425ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:49.097762 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ba817-89da-4713-8812-8d0442a425ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:49.098043 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ba817-89da-4713-8812-8d0442a425ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:49.098322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ba817-89da-4713-8812-8d0442a425ef admin admin] PATH_INFO: `/v3/projects/0f3bff3c482c405f9c82e96482450be5` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:49.100076 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ba817-89da-4713-8812-8d0442a425ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f3bff3c482c405f9c82e96482450be5)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:49.102115 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ba817-89da-4713-8812-8d0442a425ef admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:49.107423 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9d912-eaaa-4934-bf0d-bac864e6502f None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:49.113553 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb225af9-3082-4302-a529-16fa0ea739b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:49.114420 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb225af9-3082-4302-a529-16fa0ea739b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:49.115321 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb225af9-3082-4302-a529-16fa0ea739b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:49.115602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb225af9-3082-4302-a529-16fa0ea739b6 admin admin] PATH_INFO: `/v3/users/e0cd507d989546118d2d13cd6c6abb43` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:49.116869 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb225af9-3082-4302-a529-16fa0ea739b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0cd507d989546118d2d13cd6c6abb43)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:49.118865 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb225af9-3082-4302-a529-16fa0ea739b6 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:49.259953 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-2f3ba817-89da-4713-8812-8d0442a425ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f3bff3c482c405f9c82e96482450be5', 'request_id': 'req-2f3ba817-89da-4713-8812-8d0442a425ef'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:49.346601 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-2f3ba817-89da-4713-8812-8d0442a425ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f3bff3c482c405f9c82e96482450be5', 'request_id': 'req-2f3ba817-89da-4713-8812-8d0442a425ef'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:49.353889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-2f3ba817-89da-4713-8812-8d0442a425ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f3bff3c482c405f9c82e96482450be5', 'request_id': 'req-2f3ba817-89da-4713-8812-8d0442a425ef'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:49.364173 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-2f3ba817-89da-4713-8812-8d0442a425ef admin admin] The token cache is being invalidate because project 0f3bff3c482c405f9c82e96482450be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:49.364481 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-2f3ba817-89da-4713-8812-8d0442a425ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:49.366155 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-2f3ba817-89da-4713-8812-8d0442a425ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:49.367761 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 934/1858] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:49 2022] DELETE /identity/v3/projects/0f3bff3c482c405f9c82e96482450be5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:49.368604 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ba817-89da-4713-8812-8d0442a425ef admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:49.369971 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-2f3ba817-89da-4713-8812-8d0442a425ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:49.390271 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-bb225af9-3082-4302-a529-16fa0ea739b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0cd507d989546118d2d13cd6c6abb43'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:49.391116 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-bb225af9-3082-4302-a529-16fa0ea739b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0cd507d989546118d2d13cd6c6abb43'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:49.404498 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-bb225af9-3082-4302-a529-16fa0ea739b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0cd507d989546118d2d13cd6c6abb43'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:49.411152 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-bb225af9-3082-4302-a529-16fa0ea739b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0cd507d989546118d2d13cd6c6abb43'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:49.412463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-bb225af9-3082-4302-a529-16fa0ea739b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0cd507d989546118d2d13cd6c6abb43'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:49.435239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ba817-89da-4713-8812-8d0442a425ef admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:49.440001 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54e7ae-bd2f-48c9-aad0-49ca53b8ceb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:49.440742 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54e7ae-bd2f-48c9-aad0-49ca53b8ceb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:49.441062 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54e7ae-bd2f-48c9-aad0-49ca53b8ceb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:49.441343 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54e7ae-bd2f-48c9-aad0-49ca53b8ceb2 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:49.442058 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54e7ae-bd2f-48c9-aad0-49ca53b8ceb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:49.444007 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54e7ae-bd2f-48c9-aad0-49ca53b8ceb2 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:49.489816 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 925/1859] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:49 2022] DELETE /identity/v3/users/e0cd507d989546118d2d13cd6c6abb43 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:49.491137 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee0e4a-0226-4d50-94eb-5ce89285ba2a None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:49.491423 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee0e4a-0226-4d50-94eb-5ce89285ba2a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:49.491703 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee0e4a-0226-4d50-94eb-5ce89285ba2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:49.518744 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-9bee0e4a-0226-4d50-94eb-5ce89285ba2a None None] MFA Rules not processed for user `f12c518350e249f4945253f49e09c14f`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:49.519987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9bee0e4a-0226-4d50-94eb-5ce89285ba2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:49.572052 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 935/1860] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:49 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:49.572926 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54e7ae-bd2f-48c9-aad0-49ca53b8ceb2 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:49.575738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-0e54e7ae-bd2f-48c9-aad0-49ca53b8ceb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:49.590498 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54e7ae-bd2f-48c9-aad0-49ca53b8ceb2 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:49.597718 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 926/1861] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:49.600944 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c5874-e6de-4b41-9ab5-0d8d8c856955 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:49.601470 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c5874-e6de-4b41-9ab5-0d8d8c856955 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:49.601852 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c5874-e6de-4b41-9ab5-0d8d8c856955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:49.620489 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-905c5874-e6de-4b41-9ab5-0d8d8c856955 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:49.621736 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-905c5874-e6de-4b41-9ab5-0d8d8c856955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:49.657550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433647a-22a3-4cff-a4f3-87bc7b8832f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:49.659163 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433647a-22a3-4cff-a4f3-87bc7b8832f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:49.659163 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433647a-22a3-4cff-a4f3-87bc7b8832f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:49.659163 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433647a-22a3-4cff-a4f3-87bc7b8832f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:49.659543 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433647a-22a3-4cff-a4f3-87bc7b8832f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:49.659851 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433647a-22a3-4cff-a4f3-87bc7b8832f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:49.661576 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433647a-22a3-4cff-a4f3-87bc7b8832f8 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:49.676722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 936/1862] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:49.676722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433647a-22a3-4cff-a4f3-87bc7b8832f8 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:49.678847 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-4433647a-22a3-4cff-a4f3-87bc7b8832f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:49.693857 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433647a-22a3-4cff-a4f3-87bc7b8832f8 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:49.705543 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 927/1863] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:49.706421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c5874-e6de-4b41-9ab5-0d8d8c856955 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:49.708924 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-905c5874-e6de-4b41-9ab5-0d8d8c856955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:49.710007 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f1a03-558b-4926-aca5-e3b2eeacee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:49.710713 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f1a03-558b-4926-aca5-e3b2eeacee70 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:49.711109 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f1a03-558b-4926-aca5-e3b2eeacee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:49.711360 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f1a03-558b-4926-aca5-e3b2eeacee70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:49.712910 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f1a03-558b-4926-aca5-e3b2eeacee70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:49.715047 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f1a03-558b-4926-aca5-e3b2eeacee70 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:49.726454 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c5874-e6de-4b41-9ab5-0d8d8c856955 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:49.732530 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d6763-3902-47a1-a1f6-ecf5495f36ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:49.733875 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d6763-3902-47a1-a1f6-ecf5495f36ef admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:49.734550 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d6763-3902-47a1-a1f6-ecf5495f36ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:49.734932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d6763-3902-47a1-a1f6-ecf5495f36ef admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:49.736265 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d6763-3902-47a1-a1f6-ecf5495f36ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:49.738759 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d6763-3902-47a1-a1f6-ecf5495f36ef admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:49.739177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 937/1864] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:49.740968 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f1a03-558b-4926-aca5-e3b2eeacee70 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:49.753663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f1a03-558b-4926-aca5-e3b2eeacee70 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:49.761797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee9576-e10b-47ae-a731-e17e8ef920b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:49.763514 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee9576-e10b-47ae-a731-e17e8ef920b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:49.764164 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee9576-e10b-47ae-a731-e17e8ef920b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:49.764605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee9576-e10b-47ae-a731-e17e8ef920b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:49.765360 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee9576-e10b-47ae-a731-e17e8ef920b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:49.767343 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee9576-e10b-47ae-a731-e17e8ef920b4 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:49.874108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 928/1865] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:49 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:49.874108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77991d14-0a2e-4d0d-a7f1-79c3f41bb6eb None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:49.874108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77991d14-0a2e-4d0d-a7f1-79c3f41bb6eb None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:49.874108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77991d14-0a2e-4d0d-a7f1-79c3f41bb6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:49.893229 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 938/1866] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:49 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:49.894592 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee9576-e10b-47ae-a731-e17e8ef920b4 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:49.905012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-77991d14-0a2e-4d0d-a7f1-79c3f41bb6eb None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:49.906414 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-77991d14-0a2e-4d0d-a7f1-79c3f41bb6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:49.992917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee9576-e10b-47ae-a731-e17e8ef920b4 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:50.010052 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec2dca-8a21-4fd4-838a-5fdb1c601678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:50.010052 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec2dca-8a21-4fd4-838a-5fdb1c601678 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:50.010052 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec2dca-8a21-4fd4-838a-5fdb1c601678 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:50.010318 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec2dca-8a21-4fd4-838a-5fdb1c601678 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:50.011536 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec2dca-8a21-4fd4-838a-5fdb1c601678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:50.012310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 929/1867] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:50.013457 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77991d14-0a2e-4d0d-a7f1-79c3f41bb6eb None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:50.015070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec2dca-8a21-4fd4-838a-5fdb1c601678 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:50.028246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 939/1868] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:50.029213 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec2dca-8a21-4fd4-838a-5fdb1c601678 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:50.044157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77991d14-0a2e-4d0d-a7f1-79c3f41bb6eb None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:50.047247 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec2dca-8a21-4fd4-838a-5fdb1c601678 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:50.053528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34f85f-77f5-49e9-a5aa-0477c198a09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:50.053765 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aeab71-eea4-4090-889a-af5ba6c49877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:50.055685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeab71-eea4-4090-889a-af5ba6c49877 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:50.055974 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeab71-eea4-4090-889a-af5ba6c49877 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:50.056325 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeab71-eea4-4090-889a-af5ba6c49877 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:50.057000 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34f85f-77f5-49e9-a5aa-0477c198a09d admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:50.057109 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aeab71-eea4-4090-889a-af5ba6c49877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:50.059918 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aeab71-eea4-4090-889a-af5ba6c49877 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:50.066035 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34f85f-77f5-49e9-a5aa-0477c198a09d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:50.066035 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34f85f-77f5-49e9-a5aa-0477c198a09d admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:50.066035 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34f85f-77f5-49e9-a5aa-0477c198a09d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:50.066870 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34f85f-77f5-49e9-a5aa-0477c198a09d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:50.197888 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 930/1869] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:50 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:50.199078 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34f85f-77f5-49e9-a5aa-0477c198a09d admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:50.200830 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 940/1870] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:50 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:50.201629 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aeab71-eea4-4090-889a-af5ba6c49877 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:50.201919 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-6b34f85f-77f5-49e9-a5aa-0477c198a09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:50.213439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aeab71-eea4-4090-889a-af5ba6c49877 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:50.218611 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6229e0d-2925-485f-9bbe-fb1a2ae57001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:50.219007 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34f85f-77f5-49e9-a5aa-0477c198a09d admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:50.219287 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6229e0d-2925-485f-9bbe-fb1a2ae57001 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:50.219569 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6229e0d-2925-485f-9bbe-fb1a2ae57001 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:50.219841 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6229e0d-2925-485f-9bbe-fb1a2ae57001 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:50.220633 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6229e0d-2925-485f-9bbe-fb1a2ae57001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:50.221128 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6229e0d-2925-485f-9bbe-fb1a2ae57001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:50.223037 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6229e0d-2925-485f-9bbe-fb1a2ae57001 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:50.226049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68434d8b-e6df-4b72-acbc-d5e613395d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:50.227080 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68434d8b-e6df-4b72-acbc-d5e613395d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:50.227357 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68434d8b-e6df-4b72-acbc-d5e613395d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:50.227624 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68434d8b-e6df-4b72-acbc-d5e613395d1b admin admin] PATH_INFO: `/v3/projects/a52d58374fe24b2c8a522a37e7c9cb53` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:50.228868 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68434d8b-e6df-4b72-acbc-d5e613395d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a52d58374fe24b2c8a522a37e7c9cb53)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:50.230764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68434d8b-e6df-4b72-acbc-d5e613395d1b admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:50.237949 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 941/1871] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:50.238853 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6229e0d-2925-485f-9bbe-fb1a2ae57001 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:50.249112 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6229e0d-2925-485f-9bbe-fb1a2ae57001 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:50.253937 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93761ff-5baf-493b-9497-dfbf3832390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:50.254824 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93761ff-5baf-493b-9497-dfbf3832390d admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:50.255101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93761ff-5baf-493b-9497-dfbf3832390d admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:50.255627 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93761ff-5baf-493b-9497-dfbf3832390d admin admin] PATH_INFO: `/v3/projects/e56e1fc498f441bdac7b465540d19184/users/ce0a8212e00543d8b0a2eb6023568767/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:50.270276 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93761ff-5baf-493b-9497-dfbf3832390d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56e1fc498f441bdac7b465540d19184, user_id=ce0a8212e00543d8b0a2eb6023568767, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:50.273493 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93761ff-5baf-493b-9497-dfbf3832390d admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:50.352088 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 942/1872] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:50 2022] PUT /identity/v3/projects/e56e1fc498f441bdac7b465540d19184/users/ce0a8212e00543d8b0a2eb6023568767/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:50.353578 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93761ff-5baf-493b-9497-dfbf3832390d admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:50.365492 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-68434d8b-e6df-4b72-acbc-d5e613395d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a52d58374fe24b2c8a522a37e7c9cb53', 'request_id': 'req-68434d8b-e6df-4b72-acbc-d5e613395d1b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:50.424606 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93761ff-5baf-493b-9497-dfbf3832390d admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:50.432352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-68434d8b-e6df-4b72-acbc-d5e613395d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a52d58374fe24b2c8a522a37e7c9cb53', 'request_id': 'req-68434d8b-e6df-4b72-acbc-d5e613395d1b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:50.440251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-68434d8b-e6df-4b72-acbc-d5e613395d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a52d58374fe24b2c8a522a37e7c9cb53', 'request_id': 'req-68434d8b-e6df-4b72-acbc-d5e613395d1b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:50.452984 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-68434d8b-e6df-4b72-acbc-d5e613395d1b admin admin] The token cache is being invalidate because project a52d58374fe24b2c8a522a37e7c9cb53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:50.453278 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-68434d8b-e6df-4b72-acbc-d5e613395d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:50.453966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-68434d8b-e6df-4b72-acbc-d5e613395d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:50.459996 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 931/1873] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:50 2022] DELETE /identity/v3/projects/a52d58374fe24b2c8a522a37e7c9cb53 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:50.459996 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68434d8b-e6df-4b72-acbc-d5e613395d1b admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:50.461453 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-68434d8b-e6df-4b72-acbc-d5e613395d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:50.499155 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939cf1f-3552-4871-b6e5-01734f19a34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:50.500026 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939cf1f-3552-4871-b6e5-01734f19a34f admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:50.501110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939cf1f-3552-4871-b6e5-01734f19a34f admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:50.501396 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939cf1f-3552-4871-b6e5-01734f19a34f admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:50.502143 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939cf1f-3552-4871-b6e5-01734f19a34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:50.504174 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939cf1f-3552-4871-b6e5-01734f19a34f admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:50.524968 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 943/1874] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:50.525779 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939cf1f-3552-4871-b6e5-01734f19a34f admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:50.527854 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-9939cf1f-3552-4871-b6e5-01734f19a34f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:50.542756 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939cf1f-3552-4871-b6e5-01734f19a34f admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:50.550335 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47492755-f18a-4d8a-8a35-00627d92466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:50.550978 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47492755-f18a-4d8a-8a35-00627d92466e admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:50.551259 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47492755-f18a-4d8a-8a35-00627d92466e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:50.551595 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47492755-f18a-4d8a-8a35-00627d92466e admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:50.551898 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68434d8b-e6df-4b72-acbc-d5e613395d1b admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:50.552571 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47492755-f18a-4d8a-8a35-00627d92466e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:50.554623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47492755-f18a-4d8a-8a35-00627d92466e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:50.558819 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6dc3a-1868-4509-a43c-96b410cc87f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:50.559914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6dc3a-1868-4509-a43c-96b410cc87f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:50.560193 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6dc3a-1868-4509-a43c-96b410cc87f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:50.560466 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6dc3a-1868-4509-a43c-96b410cc87f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:50.561231 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6dc3a-1868-4509-a43c-96b410cc87f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:50.562839 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6dc3a-1868-4509-a43c-96b410cc87f8 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:50.577030 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 932/1875] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:50.581572 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a231-855c-48ed-ace3-b0ee00e4704c None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:50.581859 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a231-855c-48ed-ace3-b0ee00e4704c None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:50.584843 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a231-855c-48ed-ace3-b0ee00e4704c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:50.615393 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-e638a231-855c-48ed-ace3-b0ee00e4704c None None] MFA Rules not processed for user `ce0a8212e00543d8b0a2eb6023568767`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:50.616689 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e638a231-855c-48ed-ace3-b0ee00e4704c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:50.661090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 944/1876] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:50 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:50.661090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75961292-fb6a-4e4a-ab58-1141320c08f8 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:50.661090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75961292-fb6a-4e4a-ab58-1141320c08f8 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:50.661090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75961292-fb6a-4e4a-ab58-1141320c08f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:50.691490 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-75961292-fb6a-4e4a-ab58-1141320c08f8 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:50.693215 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-75961292-fb6a-4e4a-ab58-1141320c08f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:50.736822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 933/1877] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:50.736822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638a231-855c-48ed-ace3-b0ee00e4704c None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:50.736822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e638a231-855c-48ed-ace3-b0ee00e4704c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:50.758362 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638a231-855c-48ed-ace3-b0ee00e4704c None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:50.776563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 945/1878] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:50.777502 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75961292-fb6a-4e4a-ab58-1141320c08f8 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:50.789408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75961292-fb6a-4e4a-ab58-1141320c08f8 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:50.796409 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc143d-25fd-4895-8063-b6b932920a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:50.797050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc143d-25fd-4895-8063-b6b932920a4c admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:50.797331 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc143d-25fd-4895-8063-b6b932920a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:50.798023 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc143d-25fd-4895-8063-b6b932920a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:50.800654 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc143d-25fd-4895-8063-b6b932920a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:50.802706 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc143d-25fd-4895-8063-b6b932920a4c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:50.827475 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 946/1879] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:50.827940 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc143d-25fd-4895-8063-b6b932920a4c admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:50.849685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc143d-25fd-4895-8063-b6b932920a4c admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:50.852365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a789c-9eb8-42b1-85d4-446b66f59f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:50.853570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a789c-9eb8-42b1-85d4-446b66f59f71 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:50.854100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a789c-9eb8-42b1-85d4-446b66f59f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:50.854575 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a789c-9eb8-42b1-85d4-446b66f59f71 admin admin] PATH_INFO: `/v3/projects/cccc76fe60184d24ac21e7da76eca218/users/c909d396c95f43ca840ffba562790081/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:50.862690 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25fe81-1127-47a3-960c-98de00375225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:50.863253 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25fe81-1127-47a3-960c-98de00375225 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:50.863546 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25fe81-1127-47a3-960c-98de00375225 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:50.863873 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25fe81-1127-47a3-960c-98de00375225 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:50.865137 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25fe81-1127-47a3-960c-98de00375225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:50.870713 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25fe81-1127-47a3-960c-98de00375225 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:50.884041 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a789c-9eb8-42b1-85d4-446b66f59f71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cccc76fe60184d24ac21e7da76eca218, user_id=c909d396c95f43ca840ffba562790081, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:50.889595 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a789c-9eb8-42b1-85d4-446b66f59f71 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:50.996270 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 947/1880] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:50 2022] POST /identity/v3/users => generated 284 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:50.996270 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25fe81-1127-47a3-960c-98de00375225 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:51.007598 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-9d25fe81-1127-47a3-960c-98de00375225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:51.015675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 934/1881] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:50 2022] PUT /identity/v3/projects/cccc76fe60184d24ac21e7da76eca218/users/c909d396c95f43ca840ffba562790081/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:51.017881 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc2ec9-c518-401c-a876-2ea243d28878 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:51.018317 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc2ec9-c518-401c-a876-2ea243d28878 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:51.018859 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc2ec9-c518-401c-a876-2ea243d28878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:51.025645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25fe81-1127-47a3-960c-98de00375225 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:51.042793 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-c8bc2ec9-c518-401c-a876-2ea243d28878 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:51.044607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c8bc2ec9-c518-401c-a876-2ea243d28878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:51.175841 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 935/1882] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:51.176765 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc2ec9-c518-401c-a876-2ea243d28878 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:51.185825 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7665d88-a2b6-4482-b0d8-5bb4910245d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:51.186554 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7665d88-a2b6-4482-b0d8-5bb4910245d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:51.187879 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7665d88-a2b6-4482-b0d8-5bb4910245d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:51.188169 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7665d88-a2b6-4482-b0d8-5bb4910245d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:51.189060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7665d88-a2b6-4482-b0d8-5bb4910245d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:51.191355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7665d88-a2b6-4482-b0d8-5bb4910245d8 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:51.210345 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc2ec9-c518-401c-a876-2ea243d28878 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:51.225969 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec381a56-10e3-45cb-8828-8cf2c42fd737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:51.226958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec381a56-10e3-45cb-8828-8cf2c42fd737 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:51.227239 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec381a56-10e3-45cb-8828-8cf2c42fd737 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:51.227508 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec381a56-10e3-45cb-8828-8cf2c42fd737 admin admin] PATH_INFO: `/v3/projects/0509cc3f54074110a426bc6a6392113c/users/39b4a93ff0564a638b0428bcfaafb39e/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:51.254892 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec381a56-10e3-45cb-8828-8cf2c42fd737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0509cc3f54074110a426bc6a6392113c, user_id=39b4a93ff0564a638b0428bcfaafb39e, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:51.259780 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec381a56-10e3-45cb-8828-8cf2c42fd737 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:51.339141 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 948/1883] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:50 2022] POST /identity/v3/projects => generated 385 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:51.340277 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7665d88-a2b6-4482-b0d8-5bb4910245d8 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:51.375727 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 936/1884] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:51 2022] PUT /identity/v3/projects/0509cc3f54074110a426bc6a6392113c/users/39b4a93ff0564a638b0428bcfaafb39e/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:51.391575 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec381a56-10e3-45cb-8828-8cf2c42fd737 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:51.475819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7665d88-a2b6-4482-b0d8-5bb4910245d8 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:51.541347 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec381a56-10e3-45cb-8828-8cf2c42fd737 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:51.556209 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4b06b-ee63-442d-9325-abb0fbac0798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:51.557465 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4b06b-ee63-442d-9325-abb0fbac0798 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:51.557749 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4b06b-ee63-442d-9325-abb0fbac0798 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:51.558022 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4b06b-ee63-442d-9325-abb0fbac0798 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:51.564207 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4b06b-ee63-442d-9325-abb0fbac0798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:51.566646 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4b06b-ee63-442d-9325-abb0fbac0798 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:51.583158 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49d92d-7fa3-40fd-be04-2b2f4b34027c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:51.584760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49d92d-7fa3-40fd-be04-2b2f4b34027c admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:51.585169 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49d92d-7fa3-40fd-be04-2b2f4b34027c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:51.585355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49d92d-7fa3-40fd-be04-2b2f4b34027c admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:51.586054 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49d92d-7fa3-40fd-be04-2b2f4b34027c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:51.588254 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49d92d-7fa3-40fd-be04-2b2f4b34027c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:51.598269 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 937/1885] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:51.598269 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4b06b-ee63-442d-9325-abb0fbac0798 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:51.605812 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 949/1886] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:51.606973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49d92d-7fa3-40fd-be04-2b2f4b34027c admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:51.618747 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4b06b-ee63-442d-9325-abb0fbac0798 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:51.621837 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49d92d-7fa3-40fd-be04-2b2f4b34027c admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:51.627410 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e2ede-743f-4584-b896-4de5f964b158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:51.628104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2ede-743f-4584-b896-4de5f964b158 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:51.628389 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2ede-743f-4584-b896-4de5f964b158 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:51.628701 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2ede-743f-4584-b896-4de5f964b158 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:51.629446 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e2ede-743f-4584-b896-4de5f964b158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:56:51.629744 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e2ede-743f-4584-b896-4de5f964b158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:51.629847 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2797c-59bd-4832-b511-9e9700080127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:51.630666 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2797c-59bd-4832-b511-9e9700080127 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:51.631036 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2797c-59bd-4832-b511-9e9700080127 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:51.631370 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2797c-59bd-4832-b511-9e9700080127 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:51.631724 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e2ede-743f-4584-b896-4de5f964b158 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:51.632341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2797c-59bd-4832-b511-9e9700080127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:51.634615 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2797c-59bd-4832-b511-9e9700080127 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:51.645044 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 938/1887] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:56:51.648672 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde70ef1-6b29-44a6-8410-d725b60512f6 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:51.653089 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde70ef1-6b29-44a6-8410-d725b60512f6 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:51.653089 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde70ef1-6b29-44a6-8410-d725b60512f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:51.681776 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-cde70ef1-6b29-44a6-8410-d725b60512f6 None None] MFA Rules not processed for user `39b4a93ff0564a638b0428bcfaafb39e`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:51.683779 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-cde70ef1-6b29-44a6-8410-d725b60512f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:51.751017 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 950/1888] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:51 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:51.752675 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2797c-59bd-4832-b511-9e9700080127 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:51.764243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 939/1889] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:51.765169 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde70ef1-6b29-44a6-8410-d725b60512f6 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:51.768641 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2797c-59bd-4832-b511-9e9700080127 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:51.775326 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdece4-3478-40ff-b206-0af747f58c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:51.776345 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdece4-3478-40ff-b206-0af747f58c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:51.776768 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdece4-3478-40ff-b206-0af747f58c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:51.777235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdece4-3478-40ff-b206-0af747f58c6c admin admin] PATH_INFO: `/v3/projects/cccc76fe60184d24ac21e7da76eca218/users/c909d396c95f43ca840ffba562790081/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:51.778911 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde70ef1-6b29-44a6-8410-d725b60512f6 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:51.779651 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdece4-3478-40ff-b206-0af747f58c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cccc76fe60184d24ac21e7da76eca218, user_id=c909d396c95f43ca840ffba562790081, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:51.782829 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdece4-3478-40ff-b206-0af747f58c6c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:51.784347 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5099bdf-d996-47af-9056-ab1eee6aef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:51.784483 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5099bdf-d996-47af-9056-ab1eee6aef79 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:51.784736 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5099bdf-d996-47af-9056-ab1eee6aef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:51.785022 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5099bdf-d996-47af-9056-ab1eee6aef79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:51.785815 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5099bdf-d996-47af-9056-ab1eee6aef79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:51.787566 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5099bdf-d996-47af-9056-ab1eee6aef79 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:51.794859 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 951/1890] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:51 2022] PUT /identity/v3/projects/cccc76fe60184d24ac21e7da76eca218/users/c909d396c95f43ca840ffba562790081/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:51.795838 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdece4-3478-40ff-b206-0af747f58c6c admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:51.797974 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 940/1891] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:51.798770 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5099bdf-d996-47af-9056-ab1eee6aef79 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:51.814478 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5099bdf-d996-47af-9056-ab1eee6aef79 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:51.884429 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdece4-3478-40ff-b206-0af747f58c6c admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:51.890033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85983b5-53ef-45b9-a88d-124f2e9e7929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:51.890940 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85983b5-53ef-45b9-a88d-124f2e9e7929 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:51.891222 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85983b5-53ef-45b9-a88d-124f2e9e7929 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:51.891502 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85983b5-53ef-45b9-a88d-124f2e9e7929 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:51.892222 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85983b5-53ef-45b9-a88d-124f2e9e7929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:51.894307 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85983b5-53ef-45b9-a88d-124f2e9e7929 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:51.902984 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1c7e2-c739-4de1-a41b-0ca6c5a99514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:51.903801 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1c7e2-c739-4de1-a41b-0ca6c5a99514 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:51.904090 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1c7e2-c739-4de1-a41b-0ca6c5a99514 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:51.904994 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1c7e2-c739-4de1-a41b-0ca6c5a99514 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:51.905756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1c7e2-c739-4de1-a41b-0ca6c5a99514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:51.908890 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1c7e2-c739-4de1-a41b-0ca6c5a99514 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:51.920701 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 941/1892] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:51.921556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1c7e2-c739-4de1-a41b-0ca6c5a99514 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:51.932308 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1c7e2-c739-4de1-a41b-0ca6c5a99514 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:51.939303 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ccb03-2bdb-4bb2-990b-8e894f4b0622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:51.939989 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ccb03-2bdb-4bb2-990b-8e894f4b0622 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:51.940269 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ccb03-2bdb-4bb2-990b-8e894f4b0622 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:51.940544 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ccb03-2bdb-4bb2-990b-8e894f4b0622 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:51.941282 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ccb03-2bdb-4bb2-990b-8e894f4b0622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:51.943984 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ccb03-2bdb-4bb2-990b-8e894f4b0622 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:51.998967 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 952/1893] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:51 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:51.999972 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85983b5-53ef-45b9-a88d-124f2e9e7929 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:52.035818 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 942/1894] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:51 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:52.038153 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d828ad2-65a3-44cb-a829-9e812c690c50 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:52.038727 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d828ad2-65a3-44cb-a829-9e812c690c50 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:52.039254 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d828ad2-65a3-44cb-a829-9e812c690c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:52.074489 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-6d828ad2-65a3-44cb-a829-9e812c690c50 None None] MFA Rules not processed for user `c909d396c95f43ca840ffba562790081`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:52.076219 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-6d828ad2-65a3-44cb-a829-9e812c690c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:52.082730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85983b5-53ef-45b9-a88d-124f2e9e7929 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:52.148430 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29fd49-9865-4287-b840-42ff14369f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:52.149605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29fd49-9865-4287-b840-42ff14369f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:52.149884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29fd49-9865-4287-b840-42ff14369f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:52.150669 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29fd49-9865-4287-b840-42ff14369f43 admin admin] PATH_INFO: `/v3/projects/b068a57c61a5491586e2edc68d26110f/users/cb52779b604f4e4292dcd29114181875/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:52.168159 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 943/1895] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:52.169700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d828ad2-65a3-44cb-a829-9e812c690c50 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:52.178453 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29fd49-9865-4287-b840-42ff14369f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b068a57c61a5491586e2edc68d26110f, user_id=cb52779b604f4e4292dcd29114181875, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:52.178896 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29fd49-9865-4287-b840-42ff14369f43 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:52.188632 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d828ad2-65a3-44cb-a829-9e812c690c50 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:52.196457 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07b58e-fa90-4681-beb3-357e91bed533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:52.197666 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07b58e-fa90-4681-beb3-357e91bed533 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:52.198151 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07b58e-fa90-4681-beb3-357e91bed533 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:52.198639 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07b58e-fa90-4681-beb3-357e91bed533 admin admin] PATH_INFO: `/v3/projects/79baa07f7a7746d9ba780393dd8ab8ff/users/54f5c6eeda024a9cb6c815350aab1772/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:52.217161 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07b58e-fa90-4681-beb3-357e91bed533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79baa07f7a7746d9ba780393dd8ab8ff, user_id=54f5c6eeda024a9cb6c815350aab1772, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:52.220010 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07b58e-fa90-4681-beb3-357e91bed533 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:52.244782 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 953/1896] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:51 2022] PUT /identity/v3/projects/b068a57c61a5491586e2edc68d26110f/users/cb52779b604f4e4292dcd29114181875/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:52.245857 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29fd49-9865-4287-b840-42ff14369f43 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:52.310482 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29fd49-9865-4287-b840-42ff14369f43 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:52.315491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a194137-c1cf-4d24-9421-64fd5b20514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:52.316535 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a194137-c1cf-4d24-9421-64fd5b20514a admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:52.316898 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a194137-c1cf-4d24-9421-64fd5b20514a admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:52.317322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a194137-c1cf-4d24-9421-64fd5b20514a admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:52.317962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a194137-c1cf-4d24-9421-64fd5b20514a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:52.322429 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 944/1897] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:52 2022] PUT /identity/v3/projects/79baa07f7a7746d9ba780393dd8ab8ff/users/54f5c6eeda024a9cb6c815350aab1772/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:52.324882 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a194137-c1cf-4d24-9421-64fd5b20514a admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:52.325021 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07b58e-fa90-4681-beb3-357e91bed533 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:52.382505 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 954/1898] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:52 2022] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:52.382505 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a194137-c1cf-4d24-9421-64fd5b20514a admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:52.384176 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-5a194137-c1cf-4d24-9421-64fd5b20514a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:52.388462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07b58e-fa90-4681-beb3-357e91bed533 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:52.393698 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5a35b-e7f2-47d5-8d95-6d93d3aed979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:52.394378 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5a35b-e7f2-47d5-8d95-6d93d3aed979 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:52.394662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5a35b-e7f2-47d5-8d95-6d93d3aed979 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:52.395038 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5a35b-e7f2-47d5-8d95-6d93d3aed979 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:52.395672 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5a35b-e7f2-47d5-8d95-6d93d3aed979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:52.398288 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5a35b-e7f2-47d5-8d95-6d93d3aed979 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:52.440959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a194137-c1cf-4d24-9421-64fd5b20514a admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:52.492398 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 945/1899] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:52 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:52.495049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a5f52-d53f-4247-9e81-77c266a710e0 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:52.495390 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a5f52-d53f-4247-9e81-77c266a710e0 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:52.495647 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e788dc9-8152-404e-a304-888f4b045862 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:52.496066 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a5f52-d53f-4247-9e81-77c266a710e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:52.496467 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e788dc9-8152-404e-a304-888f4b045862 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:52.496789 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e788dc9-8152-404e-a304-888f4b045862 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:52.497405 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e788dc9-8152-404e-a304-888f4b045862 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:52.498994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-0e788dc9-8152-404e-a304-888f4b045862 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:52.533723 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-791a5f52-d53f-4247-9e81-77c266a710e0 None None] MFA Rules not processed for user `cb52779b604f4e4292dcd29114181875`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:52.535698 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-791a5f52-d53f-4247-9e81-77c266a710e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:52.577271 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e788dc9-8152-404e-a304-888f4b045862 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:52.578741 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e788dc9-8152-404e-a304-888f4b045862 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:52.592787 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 955/1900] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:52.595977 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e788dc9-8152-404e-a304-888f4b045862 service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:52.610581 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e788dc9-8152-404e-a304-888f4b045862 service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:52.619343 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72297a6b-d74b-4d2a-a997-293c5172a9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:52.619962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72297a6b-d74b-4d2a-a997-293c5172a9de admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:52.620245 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72297a6b-d74b-4d2a-a997-293c5172a9de admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:52.620525 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72297a6b-d74b-4d2a-a997-293c5172a9de admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:52.621357 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72297a6b-d74b-4d2a-a997-293c5172a9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:52.623085 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72297a6b-d74b-4d2a-a997-293c5172a9de admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:52.640867 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 956/1901] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:52.640867 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72297a6b-d74b-4d2a-a997-293c5172a9de admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:52.648131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 946/1902] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:52.649688 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a5f52-d53f-4247-9e81-77c266a710e0 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:52.655884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72297a6b-d74b-4d2a-a997-293c5172a9de admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:52.663680 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a5f52-d53f-4247-9e81-77c266a710e0 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:52.669500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb51174-8d20-4f9e-85b5-e3848cf6d80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:52.669774 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761e382-068b-4be9-97b8-c0b58fb03d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:52.669992 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb51174-8d20-4f9e-85b5-e3848cf6d80b admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:52.670234 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb51174-8d20-4f9e-85b5-e3848cf6d80b admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:52.670510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb51174-8d20-4f9e-85b5-e3848cf6d80b admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:52.670736 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761e382-068b-4be9-97b8-c0b58fb03d89 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:52.671214 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761e382-068b-4be9-97b8-c0b58fb03d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:52.671314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb51174-8d20-4f9e-85b5-e3848cf6d80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:52.671738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761e382-068b-4be9-97b8-c0b58fb03d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:52.672906 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb51174-8d20-4f9e-85b5-e3848cf6d80b admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:52.673085 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761e382-068b-4be9-97b8-c0b58fb03d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:52.680348 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761e382-068b-4be9-97b8-c0b58fb03d89 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:52.690307 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 947/1903] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:52.691249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb51174-8d20-4f9e-85b5-e3848cf6d80b admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:52.697146 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 957/1904] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:52.700992 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761e382-068b-4be9-97b8-c0b58fb03d89 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:52.704798 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb51174-8d20-4f9e-85b5-e3848cf6d80b admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:52.712803 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761e382-068b-4be9-97b8-c0b58fb03d89 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:52.713380 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e3f97-788a-4b1a-8e04-b0de63752830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:52.714294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e3f97-788a-4b1a-8e04-b0de63752830 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:52.714579 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e3f97-788a-4b1a-8e04-b0de63752830 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:52.714914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e3f97-788a-4b1a-8e04-b0de63752830 admin admin] PATH_INFO: `/v3/projects/79baa07f7a7746d9ba780393dd8ab8ff/users/54f5c6eeda024a9cb6c815350aab1772/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:52.718180 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e3f97-788a-4b1a-8e04-b0de63752830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79baa07f7a7746d9ba780393dd8ab8ff, user_id=54f5c6eeda024a9cb6c815350aab1772, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:52.718611 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb19c85-80e0-4678-955e-2bf6cdc3ba42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:52.719472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19c85-80e0-4678-955e-2bf6cdc3ba42 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:52.720496 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19c85-80e0-4678-955e-2bf6cdc3ba42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:52.721020 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19c85-80e0-4678-955e-2bf6cdc3ba42 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:52.721914 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb19c85-80e0-4678-955e-2bf6cdc3ba42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:52.724684 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb19c85-80e0-4678-955e-2bf6cdc3ba42 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:52.729155 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e3f97-788a-4b1a-8e04-b0de63752830 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:52.751892 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 948/1905] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:52 2022] PUT /identity/v3/projects/79baa07f7a7746d9ba780393dd8ab8ff/users/54f5c6eeda024a9cb6c815350aab1772/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:52.752899 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e3f97-788a-4b1a-8e04-b0de63752830 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:52.834186 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e3f97-788a-4b1a-8e04-b0de63752830 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:52.839866 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56916bad-c39b-40fc-aff5-bcef5373babc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:52.840528 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 958/1906] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:52 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:52.841121 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56916bad-c39b-40fc-aff5-bcef5373babc admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:52.841386 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56916bad-c39b-40fc-aff5-bcef5373babc admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:52.841666 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56916bad-c39b-40fc-aff5-bcef5373babc admin admin] PATH_INFO: `/v3/projects/76b516a053644dd29de5d63192f2b750/users/79f50e01d3ef440d9ad83fbab22434cf/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:52.844846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb19c85-80e0-4678-955e-2bf6cdc3ba42 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:52.860873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56916bad-c39b-40fc-aff5-bcef5373babc admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b516a053644dd29de5d63192f2b750, user_id=79f50e01d3ef440d9ad83fbab22434cf, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:52.863587 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56916bad-c39b-40fc-aff5-bcef5373babc admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:52.910074 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb19c85-80e0-4678-955e-2bf6cdc3ba42 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:52.916185 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce3844-ff8c-4458-a67c-cdd432f33f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:52.916876 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce3844-ff8c-4458-a67c-cdd432f33f82 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:52.917184 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce3844-ff8c-4458-a67c-cdd432f33f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:52.917460 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce3844-ff8c-4458-a67c-cdd432f33f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:52.918203 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce3844-ff8c-4458-a67c-cdd432f33f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:52.919812 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce3844-ff8c-4458-a67c-cdd432f33f82 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:52.929884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 959/1907] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:52.931082 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec366a-19fb-45ec-9743-4eeb6e92e3b1 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:52.931366 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec366a-19fb-45ec-9743-4eeb6e92e3b1 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:52.931633 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec366a-19fb-45ec-9743-4eeb6e92e3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:52.960174 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-deec366a-19fb-45ec-9743-4eeb6e92e3b1 None None] MFA Rules not processed for user `54f5c6eeda024a9cb6c815350aab1772`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:52.961410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-deec366a-19fb-45ec-9743-4eeb6e92e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:52.976643 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 949/1908] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:52 2022] PUT /identity/v3/projects/76b516a053644dd29de5d63192f2b750/users/79f50e01d3ef440d9ad83fbab22434cf/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:52.980499 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56916bad-c39b-40fc-aff5-bcef5373babc admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:53.051996 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 960/1909] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:53.053651 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec366a-19fb-45ec-9743-4eeb6e92e3b1 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:53.053778 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56916bad-c39b-40fc-aff5-bcef5373babc admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:53.060498 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c4e41-4654-432c-84cc-174092e55eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:53.061662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c4e41-4654-432c-84cc-174092e55eec admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:53.062211 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c4e41-4654-432c-84cc-174092e55eec admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:53.062754 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c4e41-4654-432c-84cc-174092e55eec admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:53.064032 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c4e41-4654-432c-84cc-174092e55eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:53.065906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec366a-19fb-45ec-9743-4eeb6e92e3b1 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:53.067451 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c4e41-4654-432c-84cc-174092e55eec admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:53.071579 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21042813-f66d-434b-8297-8b4b06a229fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:53.072476 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042813-f66d-434b-8297-8b4b06a229fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:53.072799 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042813-f66d-434b-8297-8b4b06a229fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:53.073096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042813-f66d-434b-8297-8b4b06a229fb admin admin] PATH_INFO: `/v3/projects/fe4de53f65a8443eb9874b634c320093/users/0c3dedb6fff843c8a9e8b220776ce7e6/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:53.099494 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21042813-f66d-434b-8297-8b4b06a229fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4de53f65a8443eb9874b634c320093, user_id=0c3dedb6fff843c8a9e8b220776ce7e6, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:53.102671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21042813-f66d-434b-8297-8b4b06a229fb admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:53.180522 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 950/1910] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:52 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:53.181386 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c4e41-4654-432c-84cc-174092e55eec admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:53.191099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c4e41-4654-432c-84cc-174092e55eec admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:53.196608 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ff391-8797-41eb-be29-55ef46f9507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:53.197263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ff391-8797-41eb-be29-55ef46f9507c admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:53.197545 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ff391-8797-41eb-be29-55ef46f9507c admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:53.197825 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ff391-8797-41eb-be29-55ef46f9507c admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:53.198561 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ff391-8797-41eb-be29-55ef46f9507c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:53.200238 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ff391-8797-41eb-be29-55ef46f9507c admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:53.216163 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 951/1911] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:53.216163 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ff391-8797-41eb-be29-55ef46f9507c admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:53.216163 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a04ff391-8797-41eb-be29-55ef46f9507c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:53.230671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 961/1912] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:53 2022] PUT /identity/v3/projects/fe4de53f65a8443eb9874b634c320093/users/0c3dedb6fff843c8a9e8b220776ce7e6/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:53.231727 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21042813-f66d-434b-8297-8b4b06a229fb admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:53.289843 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ff391-8797-41eb-be29-55ef46f9507c admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:53.336199 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21042813-f66d-434b-8297-8b4b06a229fb admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:53.339160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91abc2-7a8c-47c1-af7d-7591893b69f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:53.339900 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91abc2-7a8c-47c1-af7d-7591893b69f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:53.340184 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91abc2-7a8c-47c1-af7d-7591893b69f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:53.340460 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91abc2-7a8c-47c1-af7d-7591893b69f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:53.341355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91abc2-7a8c-47c1-af7d-7591893b69f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:53.342969 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91abc2-7a8c-47c1-af7d-7591893b69f9 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:53.363942 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 962/1913] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:53.364085 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91abc2-7a8c-47c1-af7d-7591893b69f9 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:53.378010 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6dcbc-9d8f-43bc-9417-8f64659cc5f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:53.379654 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91abc2-7a8c-47c1-af7d-7591893b69f9 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:53.379781 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6dcbc-9d8f-43bc-9417-8f64659cc5f4 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:53.379781 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6dcbc-9d8f-43bc-9417-8f64659cc5f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:53.379781 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6dcbc-9d8f-43bc-9417-8f64659cc5f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:53.386140 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71eb8b-cc1b-45f0-acfc-cd273944a9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:53.386599 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71eb8b-cc1b-45f0-acfc-cd273944a9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:53.387013 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71eb8b-cc1b-45f0-acfc-cd273944a9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:53.387296 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71eb8b-cc1b-45f0-acfc-cd273944a9c7 admin admin] PATH_INFO: `/v3/projects/76b516a053644dd29de5d63192f2b750/users/79f50e01d3ef440d9ad83fbab22434cf/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:53.389521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71eb8b-cc1b-45f0-acfc-cd273944a9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b516a053644dd29de5d63192f2b750, user_id=79f50e01d3ef440d9ad83fbab22434cf, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:53.394091 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71eb8b-cc1b-45f0-acfc-cd273944a9c7 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:53.409726 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 963/1914] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:53 2022] PUT /identity/v3/projects/76b516a053644dd29de5d63192f2b750/users/79f50e01d3ef440d9ad83fbab22434cf/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:53.413202 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2a0a7-5d43-4036-a022-3f399e48d79e None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:53.418527 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2a0a7-5d43-4036-a022-3f399e48d79e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:53.418527 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2a0a7-5d43-4036-a022-3f399e48d79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:53.457622 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-1aa2a0a7-5d43-4036-a022-3f399e48d79e None None] MFA Rules not processed for user `0c3dedb6fff843c8a9e8b220776ce7e6`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:53.460323 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-1aa2a0a7-5d43-4036-a022-3f399e48d79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:53.463610 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6dcbc-9d8f-43bc-9417-8f64659cc5f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:53.465078 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6dcbc-9d8f-43bc-9417-8f64659cc5f4 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:53.480025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 952/1915] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:53.481767 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6dcbc-9d8f-43bc-9417-8f64659cc5f4 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:53.496188 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6dcbc-9d8f-43bc-9417-8f64659cc5f4 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:53.577758 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46456992-d4f2-401d-95b3-c17fb1366c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:53.578699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46456992-d4f2-401d-95b3-c17fb1366c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:53.578982 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46456992-d4f2-401d-95b3-c17fb1366c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:53.579257 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46456992-d4f2-401d-95b3-c17fb1366c70 admin admin] PATH_INFO: `/v3/projects/692a48c97a0d44f788cf740b9892def3/users/8664bc4d7d254fc193721f43aa72d808/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:53.600514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46456992-d4f2-401d-95b3-c17fb1366c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=692a48c97a0d44f788cf740b9892def3, user_id=8664bc4d7d254fc193721f43aa72d808, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:53.605268 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46456992-d4f2-401d-95b3-c17fb1366c70 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:53.622419 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 964/1916] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:53.623895 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e430a38-c0b3-4017-9d07-c61de78b3530 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:53.624181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e430a38-c0b3-4017-9d07-c61de78b3530 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:53.624449 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e430a38-c0b3-4017-9d07-c61de78b3530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:53.656314 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-1e430a38-c0b3-4017-9d07-c61de78b3530 None None] MFA Rules not processed for user `79f50e01d3ef440d9ad83fbab22434cf`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:53.657638 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-1e430a38-c0b3-4017-9d07-c61de78b3530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:53.702230 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 953/1917] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:53 2022] PUT /identity/v3/projects/692a48c97a0d44f788cf740b9892def3/users/8664bc4d7d254fc193721f43aa72d808/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:53.703039 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46456992-d4f2-401d-95b3-c17fb1366c70 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:53.741539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 965/1918] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:53 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:53.742393 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e430a38-c0b3-4017-9d07-c61de78b3530 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:53.755212 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e430a38-c0b3-4017-9d07-c61de78b3530 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:53.829654 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46456992-d4f2-401d-95b3-c17fb1366c70 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:53.848738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fda1f-0b92-46a4-b471-5a155620e874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:53.850159 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fda1f-0b92-46a4-b471-5a155620e874 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:53.850705 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fda1f-0b92-46a4-b471-5a155620e874 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:53.851241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fda1f-0b92-46a4-b471-5a155620e874 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:53.851952 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4f807-f946-4c16-8859-403fd785819e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:53.852081 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fda1f-0b92-46a4-b471-5a155620e874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:53.852699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4f807-f946-4c16-8859-403fd785819e admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:53.852990 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4f807-f946-4c16-8859-403fd785819e admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:53.853270 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4f807-f946-4c16-8859-403fd785819e admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:53.854087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4f807-f946-4c16-8859-403fd785819e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:53.854366 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fda1f-0b92-46a4-b471-5a155620e874 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:53.856402 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4f807-f946-4c16-8859-403fd785819e admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:53.872775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 966/1919] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:56:53.874030 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fda1f-0b92-46a4-b471-5a155620e874 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:53.955733 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fda1f-0b92-46a4-b471-5a155620e874 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:53.956228 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121209a-7467-4db4-92d6-e9e1e5e00d49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:53.956909 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121209a-7467-4db4-92d6-e9e1e5e00d49 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:53.957190 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121209a-7467-4db4-92d6-e9e1e5e00d49 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:53.957468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121209a-7467-4db4-92d6-e9e1e5e00d49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:54.021963 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121209a-7467-4db4-92d6-e9e1e5e00d49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:54.023397 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121209a-7467-4db4-92d6-e9e1e5e00d49 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:54.032836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 967/1920] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:53 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:54.033600 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121209a-7467-4db4-92d6-e9e1e5e00d49 service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:54.049977 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121209a-7467-4db4-92d6-e9e1e5e00d49 service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:54.049977 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea73047-0c6b-4fbd-ad52-8eb8c01dcbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:54.050630 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea73047-0c6b-4fbd-ad52-8eb8c01dcbbf admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:54.050908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea73047-0c6b-4fbd-ad52-8eb8c01dcbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:54.051181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea73047-0c6b-4fbd-ad52-8eb8c01dcbbf admin admin] PATH_INFO: `/v3/projects/692a48c97a0d44f788cf740b9892def3/users/8664bc4d7d254fc193721f43aa72d808/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:54.053550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea73047-0c6b-4fbd-ad52-8eb8c01dcbbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=692a48c97a0d44f788cf740b9892def3, user_id=8664bc4d7d254fc193721f43aa72d808, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:54.056211 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea73047-0c6b-4fbd-ad52-8eb8c01dcbbf admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:54.066679 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 968/1921] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:54 2022] PUT /identity/v3/projects/692a48c97a0d44f788cf740b9892def3/users/8664bc4d7d254fc193721f43aa72d808/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:54.077870 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9b443-9ccc-4f88-b5d6-8c5463f47ae2 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:54.078160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9b443-9ccc-4f88-b5d6-8c5463f47ae2 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:54.078443 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9b443-9ccc-4f88-b5d6-8c5463f47ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:54.092494 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 954/1922] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:56:53 2022] POST /identity/v3/projects => generated 381 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:56:54.096518 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4f807-f946-4c16-8859-403fd785819e admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:54.108154 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-dfe9b443-9ccc-4f88-b5d6-8c5463f47ae2 None None] MFA Rules not processed for user `8664bc4d7d254fc193721f43aa72d808`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:54.109310 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-dfe9b443-9ccc-4f88-b5d6-8c5463f47ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:54.160341 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4f807-f946-4c16-8859-403fd785819e admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:54.165776 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cc995-d208-4589-aef6-26b9a749b4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:54.166463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cc995-d208-4589-aef6-26b9a749b4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:54.166727 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cc995-d208-4589-aef6-26b9a749b4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:54.167001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cc995-d208-4589-aef6-26b9a749b4a1 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:54.167701 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cc995-d208-4589-aef6-26b9a749b4a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:54.169704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cc995-d208-4589-aef6-26b9a749b4a1 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:54.180452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 969/1923] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:56:54.270378 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 955/1924] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:56:54 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:56:54.275311 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9b443-9ccc-4f88-b5d6-8c5463f47ae2 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:54.286123 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9b443-9ccc-4f88-b5d6-8c5463f47ae2 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:54.291160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b152287-324b-44be-b281-53a3711a0f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:54.291832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b152287-324b-44be-b281-53a3711a0f5c admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:54.292117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b152287-324b-44be-b281-53a3711a0f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:54.292388 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b152287-324b-44be-b281-53a3711a0f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:54.293180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b152287-324b-44be-b281-53a3711a0f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:54.294846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b152287-324b-44be-b281-53a3711a0f5c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:54.304727 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 970/1925] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:56:54.309149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cc995-d208-4589-aef6-26b9a749b4a1 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:54.319911 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cc995-d208-4589-aef6-26b9a749b4a1 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:54.328871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b334c55-713d-4831-bc7a-b87b1edc953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:54.328871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b334c55-713d-4831-bc7a-b87b1edc953b admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:54.328871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b334c55-713d-4831-bc7a-b87b1edc953b admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:54.328871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b334c55-713d-4831-bc7a-b87b1edc953b admin admin] PATH_INFO: `/v3/projects/f60289aa71c54b1cbafa40d18f97dbdb/users/2894d9f3fe8c40a9aebc66389dd409e3/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:54.332387 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b152287-324b-44be-b281-53a3711a0f5c admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:54.353476 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b334c55-713d-4831-bc7a-b87b1edc953b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60289aa71c54b1cbafa40d18f97dbdb, user_id=2894d9f3fe8c40a9aebc66389dd409e3, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:54.356216 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b334c55-713d-4831-bc7a-b87b1edc953b admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:54.393718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b152287-324b-44be-b281-53a3711a0f5c admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:54.398260 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e8bfc-95d0-4463-a5de-667ca7776e79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:54.398912 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e8bfc-95d0-4463-a5de-667ca7776e79 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:54.399199 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e8bfc-95d0-4463-a5de-667ca7776e79 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:54.399478 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e8bfc-95d0-4463-a5de-667ca7776e79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:54.409200 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e8bfc-95d0-4463-a5de-667ca7776e79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:54.410646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e8bfc-95d0-4463-a5de-667ca7776e79 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:54.420988 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 971/1926] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:56:54.477380 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 956/1927] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:54 2022] PUT /identity/v3/projects/f60289aa71c54b1cbafa40d18f97dbdb/users/2894d9f3fe8c40a9aebc66389dd409e3/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:54.481882 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e8bfc-95d0-4463-a5de-667ca7776e79 service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:54.493232 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e8bfc-95d0-4463-a5de-667ca7776e79 service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:54.566439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e6af6-645e-4480-a4aa-121fa831afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:54.572461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e6af6-645e-4480-a4aa-121fa831afd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:54.572461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e6af6-645e-4480-a4aa-121fa831afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:54.572461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e6af6-645e-4480-a4aa-121fa831afd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:54.572461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e6af6-645e-4480-a4aa-121fa831afd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:54.572461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e6af6-645e-4480-a4aa-121fa831afd9 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:54.582514 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 972/1928] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:56:54.587737 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b334c55-713d-4831-bc7a-b87b1edc953b admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:54.601494 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b334c55-713d-4831-bc7a-b87b1edc953b admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:54.609524 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf95860-216b-4515-8fc5-827c75559e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:54.609981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf95860-216b-4515-8fc5-827c75559e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:54.610461 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf95860-216b-4515-8fc5-827c75559e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:54.610901 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf95860-216b-4515-8fc5-827c75559e5a admin admin] PATH_INFO: `/v3/projects/f60289aa71c54b1cbafa40d18f97dbdb/users/2894d9f3fe8c40a9aebc66389dd409e3/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:54.612990 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf95860-216b-4515-8fc5-827c75559e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60289aa71c54b1cbafa40d18f97dbdb, user_id=2894d9f3fe8c40a9aebc66389dd409e3, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:54.616545 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf95860-216b-4515-8fc5-827c75559e5a admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:54.627583 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 957/1929] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:56:54 2022] PUT /identity/v3/projects/f60289aa71c54b1cbafa40d18f97dbdb/users/2894d9f3fe8c40a9aebc66389dd409e3/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:54.639024 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa585532-e3c2-4ea4-996d-d87315880fd3 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:54.639487 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa585532-e3c2-4ea4-996d-d87315880fd3 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:54.639561 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa585532-e3c2-4ea4-996d-d87315880fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:54.648862 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf95860-216b-4515-8fc5-827c75559e5a admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:54.677972 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-fa585532-e3c2-4ea4-996d-d87315880fd3 None None] MFA Rules not processed for user `2894d9f3fe8c40a9aebc66389dd409e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:54.679533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-fa585532-e3c2-4ea4-996d-d87315880fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:54.736244 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf95860-216b-4515-8fc5-827c75559e5a admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:54.761463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c13cb-85e7-4c04-b8c9-973cbbede9e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:54.762963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c13cb-85e7-4c04-b8c9-973cbbede9e2 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:54.763733 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c13cb-85e7-4c04-b8c9-973cbbede9e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:54.764464 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c13cb-85e7-4c04-b8c9-973cbbede9e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:54.840526 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 973/1930] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:54.874650 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c13cb-85e7-4c04-b8c9-973cbbede9e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:54.879203 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c13cb-85e7-4c04-b8c9-973cbbede9e2 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:54.901995 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 958/1931] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:56:55.828902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa585532-e3c2-4ea4-996d-d87315880fd3 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:55.837969 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa585532-e3c2-4ea4-996d-d87315880fd3 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:55.841737 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ceb6c-19c9-4f82-8802-cd8797ed098a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:55.842399 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ceb6c-19c9-4f82-8802-cd8797ed098a service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:55.842674 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ceb6c-19c9-4f82-8802-cd8797ed098a service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:55.842946 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ceb6c-19c9-4f82-8802-cd8797ed098a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:55.852784 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ceb6c-19c9-4f82-8802-cd8797ed098a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:55.854214 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ceb6c-19c9-4f82-8802-cd8797ed098a service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:55.863709 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 974/1932] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:56.511784 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c13cb-85e7-4c04-b8c9-973cbbede9e2 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:56.529924 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c13cb-85e7-4c04-b8c9-973cbbede9e2 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:56.534180 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7898a7-0e8f-4bf7-8710-14cd04a59cb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:56.534803 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7898a7-0e8f-4bf7-8710-14cd04a59cb0 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:56.535082 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7898a7-0e8f-4bf7-8710-14cd04a59cb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:56.535353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7898a7-0e8f-4bf7-8710-14cd04a59cb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:56.603478 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7898a7-0e8f-4bf7-8710-14cd04a59cb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:56.604965 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7898a7-0e8f-4bf7-8710-14cd04a59cb0 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:56.615901 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 959/1933] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:56.707059 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ceb6c-19c9-4f82-8802-cd8797ed098a service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:56.716415 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ceb6c-19c9-4f82-8802-cd8797ed098a service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:56.720241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efd5e0-c746-4b16-bc1d-2703290e9a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:56.720914 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efd5e0-c746-4b16-bc1d-2703290e9a3e service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:56.721199 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efd5e0-c746-4b16-bc1d-2703290e9a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:56.721473 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efd5e0-c746-4b16-bc1d-2703290e9a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:56.723298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-31efd5e0-c746-4b16-bc1d-2703290e9a3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:56.788928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efd5e0-c746-4b16-bc1d-2703290e9a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:56.790382 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efd5e0-c746-4b16-bc1d-2703290e9a3e service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:56.800409 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 975/1934] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:56:58.177581 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7898a7-0e8f-4bf7-8710-14cd04a59cb0 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:58.248189 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7898a7-0e8f-4bf7-8710-14cd04a59cb0 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:58.253205 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de536ca-6570-4602-89c6-cb64348dd352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:58.254077 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de536ca-6570-4602-89c6-cb64348dd352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:58.254352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de536ca-6570-4602-89c6-cb64348dd352 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:58.254622 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de536ca-6570-4602-89c6-cb64348dd352 admin admin] PATH_INFO: `/v3/users/0c3dedb6fff843c8a9e8b220776ce7e6` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:58.256333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de536ca-6570-4602-89c6-cb64348dd352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3dedb6fff843c8a9e8b220776ce7e6)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:58.260774 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de536ca-6570-4602-89c6-cb64348dd352 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:58.480182 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3de536ca-6570-4602-89c6-cb64348dd352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3dedb6fff843c8a9e8b220776ce7e6'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:58.480182 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3de536ca-6570-4602-89c6-cb64348dd352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3dedb6fff843c8a9e8b220776ce7e6'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:58.501175 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3de536ca-6570-4602-89c6-cb64348dd352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3dedb6fff843c8a9e8b220776ce7e6'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:58.511300 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3de536ca-6570-4602-89c6-cb64348dd352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3dedb6fff843c8a9e8b220776ce7e6'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:58.512305 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3de536ca-6570-4602-89c6-cb64348dd352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3dedb6fff843c8a9e8b220776ce7e6'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:58.597206 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 960/1935] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:58 2022] DELETE /identity/v3/users/0c3dedb6fff843c8a9e8b220776ce7e6 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:58.602418 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced39d5c-468f-4bf9-9f06-4e51001e9374 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:58.602921 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced39d5c-468f-4bf9-9f06-4e51001e9374 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:58.603121 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced39d5c-468f-4bf9-9f06-4e51001e9374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:58.623015 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-ced39d5c-468f-4bf9-9f06-4e51001e9374 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:56:58.624220 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ced39d5c-468f-4bf9-9f06-4e51001e9374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:58.695837 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 976/1936] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:56:58.706158 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de536ca-6570-4602-89c6-cb64348dd352 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:58.707628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-3de536ca-6570-4602-89c6-cb64348dd352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:58.793061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de536ca-6570-4602-89c6-cb64348dd352 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:58.796963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5cac9-c285-445b-91f5-7224331ecf9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:58.797829 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5cac9-c285-445b-91f5-7224331ecf9b service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:58.804932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5cac9-c285-445b-91f5-7224331ecf9b service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:58.804932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5cac9-c285-445b-91f5-7224331ecf9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:58.810391 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5cac9-c285-445b-91f5-7224331ecf9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:58.811934 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5cac9-c285-445b-91f5-7224331ecf9b service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:58.828026 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 961/1937] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:56:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:56:59.253873 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced39d5c-468f-4bf9-9f06-4e51001e9374 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:59.255356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ced39d5c-468f-4bf9-9f06-4e51001e9374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:56:59.275053 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced39d5c-468f-4bf9-9f06-4e51001e9374 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:59.283590 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74882e-8448-461a-9397-e92df2ea5af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:59.285051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74882e-8448-461a-9397-e92df2ea5af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:59.285519 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74882e-8448-461a-9397-e92df2ea5af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:59.285789 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74882e-8448-461a-9397-e92df2ea5af1 admin admin] PATH_INFO: `/v3/projects/fe4de53f65a8443eb9874b634c320093` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:59.287738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74882e-8448-461a-9397-e92df2ea5af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe4de53f65a8443eb9874b634c320093)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:59.289804 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74882e-8448-461a-9397-e92df2ea5af1 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:59.393318 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3f74882e-8448-461a-9397-e92df2ea5af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe4de53f65a8443eb9874b634c320093', 'request_id': 'req-3f74882e-8448-461a-9397-e92df2ea5af1'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:59.461101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3f74882e-8448-461a-9397-e92df2ea5af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe4de53f65a8443eb9874b634c320093', 'request_id': 'req-3f74882e-8448-461a-9397-e92df2ea5af1'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:59.468225 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3f74882e-8448-461a-9397-e92df2ea5af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe4de53f65a8443eb9874b634c320093', 'request_id': 'req-3f74882e-8448-461a-9397-e92df2ea5af1'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:59.479290 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3f74882e-8448-461a-9397-e92df2ea5af1 admin admin] The token cache is being invalidate because project fe4de53f65a8443eb9874b634c320093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:56:59.479577 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3f74882e-8448-461a-9397-e92df2ea5af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:59.480267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3f74882e-8448-461a-9397-e92df2ea5af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:59.482109 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 977/1938] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:56:59 2022] DELETE /identity/v3/projects/fe4de53f65a8443eb9874b634c320093 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:56:59.486240 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5cac9-c285-445b-91f5-7224331ecf9b service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:56:59.496474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5cac9-c285-445b-91f5-7224331ecf9b service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:56:59.561916 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55125a99-abfd-447f-8a7a-349a659c4105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:56:59.562830 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55125a99-abfd-447f-8a7a-349a659c4105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:56:59.563156 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55125a99-abfd-447f-8a7a-349a659c4105 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:56:59.563543 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55125a99-abfd-447f-8a7a-349a659c4105 admin admin] PATH_INFO: `/v3/users/2894d9f3fe8c40a9aebc66389dd409e3` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:56:59.565448 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55125a99-abfd-447f-8a7a-349a659c4105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2894d9f3fe8c40a9aebc66389dd409e3)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:56:59.568048 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55125a99-abfd-447f-8a7a-349a659c4105 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:56:59.810819 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-55125a99-abfd-447f-8a7a-349a659c4105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2894d9f3fe8c40a9aebc66389dd409e3'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:59.811565 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-55125a99-abfd-447f-8a7a-349a659c4105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2894d9f3fe8c40a9aebc66389dd409e3'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:59.824303 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-55125a99-abfd-447f-8a7a-349a659c4105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2894d9f3fe8c40a9aebc66389dd409e3'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:59.831379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-55125a99-abfd-447f-8a7a-349a659c4105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2894d9f3fe8c40a9aebc66389dd409e3'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:59.832102 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-55125a99-abfd-447f-8a7a-349a659c4105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2894d9f3fe8c40a9aebc66389dd409e3'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:56:59.997260 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 962/1939] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:56:59 2022] DELETE /identity/v3/users/2894d9f3fe8c40a9aebc66389dd409e3 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:57:00.060390 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74882e-8448-461a-9397-e92df2ea5af1 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:00.062661 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-3f74882e-8448-461a-9397-e92df2ea5af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:00.087619 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74882e-8448-461a-9397-e92df2ea5af1 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:00.168498 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817e917-0491-4715-aeaf-d9df794d1f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:00.169457 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817e917-0491-4715-aeaf-d9df794d1f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:00.169730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817e917-0491-4715-aeaf-d9df794d1f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:00.170061 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817e917-0491-4715-aeaf-d9df794d1f0c admin admin] PATH_INFO: `/v3/users/39b4a93ff0564a638b0428bcfaafb39e` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:00.171451 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817e917-0491-4715-aeaf-d9df794d1f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b4a93ff0564a638b0428bcfaafb39e)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:00.173407 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817e917-0491-4715-aeaf-d9df794d1f0c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:00.409768 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c817e917-0491-4715-aeaf-d9df794d1f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b4a93ff0564a638b0428bcfaafb39e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:00.410423 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c817e917-0491-4715-aeaf-d9df794d1f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b4a93ff0564a638b0428bcfaafb39e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:00.422664 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c817e917-0491-4715-aeaf-d9df794d1f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b4a93ff0564a638b0428bcfaafb39e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:00.434807 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c817e917-0491-4715-aeaf-d9df794d1f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b4a93ff0564a638b0428bcfaafb39e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:00.435544 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c817e917-0491-4715-aeaf-d9df794d1f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b4a93ff0564a638b0428bcfaafb39e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:00.496071 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55125a99-abfd-447f-8a7a-349a659c4105 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:00.498304 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-55125a99-abfd-447f-8a7a-349a659c4105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:00.516462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55125a99-abfd-447f-8a7a-349a659c4105 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:00.521462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df7cbb-9920-4c73-8ace-908d0ca31a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:00.522593 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df7cbb-9920-4c73-8ace-908d0ca31a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:00.522975 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df7cbb-9920-4c73-8ace-908d0ca31a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:00.523268 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df7cbb-9920-4c73-8ace-908d0ca31a5a admin admin] PATH_INFO: `/v3/projects/f60289aa71c54b1cbafa40d18f97dbdb` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:00.524812 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df7cbb-9920-4c73-8ace-908d0ca31a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60289aa71c54b1cbafa40d18f97dbdb)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:00.526881 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df7cbb-9920-4c73-8ace-908d0ca31a5a admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:00.536150 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 978/1940] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:57:00 2022] DELETE /identity/v3/users/39b4a93ff0564a638b0428bcfaafb39e => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:57:00.546465 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad3f0d-bd0a-4975-aa86-759632105948 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:00.546465 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad3f0d-bd0a-4975-aa86-759632105948 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:00.546465 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad3f0d-bd0a-4975-aa86-759632105948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:00.566976 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-4dad3f0d-bd0a-4975-aa86-759632105948 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:00.568445 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-4dad3f0d-bd0a-4975-aa86-759632105948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:00.639635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 979/1941] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:57:00.650805 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad3f0d-bd0a-4975-aa86-759632105948 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:00.652381 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-4dad3f0d-bd0a-4975-aa86-759632105948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:00.672950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-80df7cbb-9920-4c73-8ace-908d0ca31a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60289aa71c54b1cbafa40d18f97dbdb', 'request_id': 'req-80df7cbb-9920-4c73-8ace-908d0ca31a5a'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:00.712697 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad3f0d-bd0a-4975-aa86-759632105948 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:00.757473 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-80df7cbb-9920-4c73-8ace-908d0ca31a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60289aa71c54b1cbafa40d18f97dbdb', 'request_id': 'req-80df7cbb-9920-4c73-8ace-908d0ca31a5a'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:00.764252 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39965f6-ba4a-49c8-89e2-13ac5ee995b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:00.766363 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39965f6-ba4a-49c8-89e2-13ac5ee995b2 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:00.766363 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39965f6-ba4a-49c8-89e2-13ac5ee995b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:00.766535 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-80df7cbb-9920-4c73-8ace-908d0ca31a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60289aa71c54b1cbafa40d18f97dbdb', 'request_id': 'req-80df7cbb-9920-4c73-8ace-908d0ca31a5a'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:00.766617 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39965f6-ba4a-49c8-89e2-13ac5ee995b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:00.776901 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-80df7cbb-9920-4c73-8ace-908d0ca31a5a admin admin] The token cache is being invalidate because project f60289aa71c54b1cbafa40d18f97dbdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:57:00.777132 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-80df7cbb-9920-4c73-8ace-908d0ca31a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:00.777774 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-80df7cbb-9920-4c73-8ace-908d0ca31a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:00.779315 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 963/1942] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:57:00 2022] DELETE /identity/v3/projects/f60289aa71c54b1cbafa40d18f97dbdb => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:57:00.784817 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172c7a3-17cb-4221-a75b-c8a43933cb3a None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:00.785280 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172c7a3-17cb-4221-a75b-c8a43933cb3a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:00.785730 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172c7a3-17cb-4221-a75b-c8a43933cb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:00.817028 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-1172c7a3-17cb-4221-a75b-c8a43933cb3a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:00.818273 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1172c7a3-17cb-4221-a75b-c8a43933cb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:00.838148 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39965f6-ba4a-49c8-89e2-13ac5ee995b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:00.839687 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39965f6-ba4a-49c8-89e2-13ac5ee995b2 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:00.851136 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 980/1943] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:57:00.882476 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 964/1944] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:57:00.890945 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02235b-45e0-4148-ba1a-3f4ff8e1d361 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:00.891302 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02235b-45e0-4148-ba1a-3f4ff8e1d361 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:00.891648 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02235b-45e0-4148-ba1a-3f4ff8e1d361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:00.914178 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-7d02235b-45e0-4148-ba1a-3f4ff8e1d361 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:00.915394 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-7d02235b-45e0-4148-ba1a-3f4ff8e1d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:00.923908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 981/1945] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:00.928610 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172c7a3-17cb-4221-a75b-c8a43933cb3a None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:00.939221 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172c7a3-17cb-4221-a75b-c8a43933cb3a None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:00.944362 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de71e46-b175-423c-9dd2-d7ca26905088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:00.946838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de71e46-b175-423c-9dd2-d7ca26905088 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:00.946838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de71e46-b175-423c-9dd2-d7ca26905088 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:00.946838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de71e46-b175-423c-9dd2-d7ca26905088 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:00.946838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de71e46-b175-423c-9dd2-d7ca26905088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:57:00.946838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de71e46-b175-423c-9dd2-d7ca26905088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:00.948449 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de71e46-b175-423c-9dd2-d7ca26905088 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:00.961067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 965/1946] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:57:00.965659 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02235b-45e0-4148-ba1a-3f4ff8e1d361 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:00.976260 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02235b-45e0-4148-ba1a-3f4ff8e1d361 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:00.983774 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d99cb-43b2-41af-af6d-5bc86c41df9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:00.984447 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d99cb-43b2-41af-af6d-5bc86c41df9e admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:00.984794 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d99cb-43b2-41af-af6d-5bc86c41df9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:00.985066 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d99cb-43b2-41af-af6d-5bc86c41df9e admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:00.985790 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d99cb-43b2-41af-af6d-5bc86c41df9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:00.987780 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d99cb-43b2-41af-af6d-5bc86c41df9e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:01.033097 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de71e46-b175-423c-9dd2-d7ca26905088 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:01.035931 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1de71e46-b175-423c-9dd2-d7ca26905088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:01.056861 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de71e46-b175-423c-9dd2-d7ca26905088 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:01.063983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359509d-171c-4d90-adab-5e29bb23ed45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:01.065276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359509d-171c-4d90-adab-5e29bb23ed45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:01.065692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359509d-171c-4d90-adab-5e29bb23ed45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:01.073374 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359509d-171c-4d90-adab-5e29bb23ed45 admin admin] PATH_INFO: `/v3/users/cb52779b604f4e4292dcd29114181875` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:01.073374 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359509d-171c-4d90-adab-5e29bb23ed45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb52779b604f4e4292dcd29114181875)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:01.073374 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359509d-171c-4d90-adab-5e29bb23ed45 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:01.138655 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 982/1947] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:57:00 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:57:01.143455 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d99cb-43b2-41af-af6d-5bc86c41df9e admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:01.239873 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d99cb-43b2-41af-af6d-5bc86c41df9e admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:01.246804 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb17f6-db62-4be9-8d79-7e1f7f55ee1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:01.247926 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb17f6-db62-4be9-8d79-7e1f7f55ee1b admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:01.248312 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb17f6-db62-4be9-8d79-7e1f7f55ee1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:01.248884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb17f6-db62-4be9-8d79-7e1f7f55ee1b admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:01.250236 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb17f6-db62-4be9-8d79-7e1f7f55ee1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:01.253221 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb17f6-db62-4be9-8d79-7e1f7f55ee1b admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:01.346688 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-c359509d-171c-4d90-adab-5e29bb23ed45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb52779b604f4e4292dcd29114181875'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:01.348635 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-c359509d-171c-4d90-adab-5e29bb23ed45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb52779b604f4e4292dcd29114181875'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:01.363321 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-c359509d-171c-4d90-adab-5e29bb23ed45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb52779b604f4e4292dcd29114181875'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:01.375722 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-c359509d-171c-4d90-adab-5e29bb23ed45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb52779b604f4e4292dcd29114181875'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:01.376910 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-c359509d-171c-4d90-adab-5e29bb23ed45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb52779b604f4e4292dcd29114181875'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:01.388664 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 983/1948] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:57:01 2022] POST /identity/v3/users => generated 287 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:57:01.389529 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb17f6-db62-4be9-8d79-7e1f7f55ee1b admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:01.396868 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-0dfb17f6-db62-4be9-8d79-7e1f7f55ee1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:01.419449 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb17f6-db62-4be9-8d79-7e1f7f55ee1b admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:01.426675 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095158e5-b4ad-482e-8f8d-d7015ecab3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:01.427900 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095158e5-b4ad-482e-8f8d-d7015ecab3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:01.428327 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095158e5-b4ad-482e-8f8d-d7015ecab3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:01.428813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095158e5-b4ad-482e-8f8d-d7015ecab3b9 admin admin] PATH_INFO: `/v3/projects/0509cc3f54074110a426bc6a6392113c` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:01.431020 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095158e5-b4ad-482e-8f8d-d7015ecab3b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0509cc3f54074110a426bc6a6392113c)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:01.434499 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095158e5-b4ad-482e-8f8d-d7015ecab3b9 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:01.472698 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 966/1949] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:57:01 2022] DELETE /identity/v3/users/cb52779b604f4e4292dcd29114181875 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:57:01.474495 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359509d-171c-4d90-adab-5e29bb23ed45 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:01.476207 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c359509d-171c-4d90-adab-5e29bb23ed45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:01.557536 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359509d-171c-4d90-adab-5e29bb23ed45 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:01.562718 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd112b8-bc36-4f5f-a061-2b19df42c7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:01.563445 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd112b8-bc36-4f5f-a061-2b19df42c7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:01.563776 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd112b8-bc36-4f5f-a061-2b19df42c7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:01.564054 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd112b8-bc36-4f5f-a061-2b19df42c7f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:01.564859 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd112b8-bc36-4f5f-a061-2b19df42c7f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:01.566475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd112b8-bc36-4f5f-a061-2b19df42c7f8 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:01.578214 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 967/1950] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:01.579991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90106ebd-4255-4efb-80bc-5e028e9ff04d None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:01.580273 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90106ebd-4255-4efb-80bc-5e028e9ff04d None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:01.580795 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90106ebd-4255-4efb-80bc-5e028e9ff04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:01.601419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-90106ebd-4255-4efb-80bc-5e028e9ff04d None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:01.602187 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-095158e5-b4ad-482e-8f8d-d7015ecab3b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0509cc3f54074110a426bc6a6392113c', 'request_id': 'req-095158e5-b4ad-482e-8f8d-d7015ecab3b9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:01.602663 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-90106ebd-4255-4efb-80bc-5e028e9ff04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:01.678429 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 968/1951] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:01.679334 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90106ebd-4255-4efb-80bc-5e028e9ff04d None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:01.688717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90106ebd-4255-4efb-80bc-5e028e9ff04d None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:01.693595 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2bc3c-37d8-4f18-bba0-3b083760ad00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:01.694296 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2bc3c-37d8-4f18-bba0-3b083760ad00 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:01.694579 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2bc3c-37d8-4f18-bba0-3b083760ad00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:01.694858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2bc3c-37d8-4f18-bba0-3b083760ad00 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:01.695584 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2bc3c-37d8-4f18-bba0-3b083760ad00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:01.697222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2bc3c-37d8-4f18-bba0-3b083760ad00 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:01.706782 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-095158e5-b4ad-482e-8f8d-d7015ecab3b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0509cc3f54074110a426bc6a6392113c', 'request_id': 'req-095158e5-b4ad-482e-8f8d-d7015ecab3b9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:01.707636 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 969/1952] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:01.709224 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2bc3c-37d8-4f18-bba0-3b083760ad00 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:01.713410 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-0cd2bc3c-37d8-4f18-bba0-3b083760ad00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:01.717945 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-095158e5-b4ad-482e-8f8d-d7015ecab3b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0509cc3f54074110a426bc6a6392113c', 'request_id': 'req-095158e5-b4ad-482e-8f8d-d7015ecab3b9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:01.734976 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-095158e5-b4ad-482e-8f8d-d7015ecab3b9 admin admin] The token cache is being invalidate because project 0509cc3f54074110a426bc6a6392113c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:57:01.735377 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-095158e5-b4ad-482e-8f8d-d7015ecab3b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:01.736390 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-095158e5-b4ad-482e-8f8d-d7015ecab3b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:01.739288 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 984/1953] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:57:01 2022] DELETE /identity/v3/projects/0509cc3f54074110a426bc6a6392113c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:01.740795 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095158e5-b4ad-482e-8f8d-d7015ecab3b9 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:01.742962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-095158e5-b4ad-482e-8f8d-d7015ecab3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:01.781043 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095158e5-b4ad-482e-8f8d-d7015ecab3b9 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:01.793746 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2bc3c-37d8-4f18-bba0-3b083760ad00 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:01.798011 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3b074-4b62-44cf-9aae-650f3d24dd2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:01.798779 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3b074-4b62-44cf-9aae-650f3d24dd2b service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:01.799100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3b074-4b62-44cf-9aae-650f3d24dd2b service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:01.799445 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3b074-4b62-44cf-9aae-650f3d24dd2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:01.801533 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-0df3b074-4b62-44cf-9aae-650f3d24dd2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:01.802889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24657681-ca55-4ebd-b057-d27bacd8a3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:01.805740 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24657681-ca55-4ebd-b057-d27bacd8a3f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:01.806554 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24657681-ca55-4ebd-b057-d27bacd8a3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:01.807785 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24657681-ca55-4ebd-b057-d27bacd8a3f4 admin admin] PATH_INFO: `/v3/projects/342efa0d9e874a989e236bc5b52e1b73/users/839ae32a1c224d64a2a63bb36cfde642/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:01.816066 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3b074-4b62-44cf-9aae-650f3d24dd2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:01.819621 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3b074-4b62-44cf-9aae-650f3d24dd2b service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:01.829808 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24657681-ca55-4ebd-b057-d27bacd8a3f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=342efa0d9e874a989e236bc5b52e1b73, user_id=839ae32a1c224d64a2a63bb36cfde642, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:01.832662 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24657681-ca55-4ebd-b057-d27bacd8a3f4 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:01.838591 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 970/1954] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:57:01.840334 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3b074-4b62-44cf-9aae-650f3d24dd2b service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:01.842804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-0df3b074-4b62-44cf-9aae-650f3d24dd2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:01.868211 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3b074-4b62-44cf-9aae-650f3d24dd2b service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:01.872921 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9bc5e-cc31-4047-a88c-3474e1fd7e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:01.873791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9bc5e-cc31-4047-a88c-3474e1fd7e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:01.874070 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9bc5e-cc31-4047-a88c-3474e1fd7e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:01.874341 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9bc5e-cc31-4047-a88c-3474e1fd7e22 admin admin] PATH_INFO: `/v3/users/79f50e01d3ef440d9ad83fbab22434cf` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:01.875531 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9bc5e-cc31-4047-a88c-3474e1fd7e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79f50e01d3ef440d9ad83fbab22434cf)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:01.877489 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9bc5e-cc31-4047-a88c-3474e1fd7e22 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:02.024054 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 985/1955] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:57:01 2022] PUT /identity/v3/projects/342efa0d9e874a989e236bc5b52e1b73/users/839ae32a1c224d64a2a63bb36cfde642/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:02.035058 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072332f8-60d7-465f-96bf-950c4f2b8a3a None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:02.035316 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072332f8-60d7-465f-96bf-950c4f2b8a3a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:02.035541 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072332f8-60d7-465f-96bf-950c4f2b8a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:02.069881 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-072332f8-60d7-465f-96bf-950c4f2b8a3a None None] MFA Rules not processed for user `839ae32a1c224d64a2a63bb36cfde642`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:02.070981 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-072332f8-60d7-465f-96bf-950c4f2b8a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:02.147285 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 986/1956] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:57:02.150645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072332f8-60d7-465f-96bf-950c4f2b8a3a None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:02.152818 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-072332f8-60d7-465f-96bf-950c4f2b8a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:02.229905 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072332f8-60d7-465f-96bf-950c4f2b8a3a None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:02.235057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add467f-c1e2-472d-b1dd-871f8529ff40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:02.235736 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add467f-c1e2-472d-b1dd-871f8529ff40 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:02.240115 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add467f-c1e2-472d-b1dd-871f8529ff40 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:02.240115 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add467f-c1e2-472d-b1dd-871f8529ff40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:02.240115 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8add467f-c1e2-472d-b1dd-871f8529ff40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:02.249989 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7dd9bc5e-cc31-4047-a88c-3474e1fd7e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f50e01d3ef440d9ad83fbab22434cf'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:02.252060 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7dd9bc5e-cc31-4047-a88c-3474e1fd7e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f50e01d3ef440d9ad83fbab22434cf'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:02.267691 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7dd9bc5e-cc31-4047-a88c-3474e1fd7e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f50e01d3ef440d9ad83fbab22434cf'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:02.289667 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7dd9bc5e-cc31-4047-a88c-3474e1fd7e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f50e01d3ef440d9ad83fbab22434cf'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:02.290337 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7dd9bc5e-cc31-4047-a88c-3474e1fd7e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f50e01d3ef440d9ad83fbab22434cf'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:02.326059 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add467f-c1e2-472d-b1dd-871f8529ff40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:02.327538 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add467f-c1e2-472d-b1dd-871f8529ff40 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:02.339268 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 987/1957] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:57:02.373530 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 971/1958] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:57:01 2022] DELETE /identity/v3/users/79f50e01d3ef440d9ad83fbab22434cf => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:02.571250 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add467f-c1e2-472d-b1dd-871f8529ff40 service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:02.583966 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add467f-c1e2-472d-b1dd-871f8529ff40 service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:02.637532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9bc5e-cc31-4047-a88c-3474e1fd7e22 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:02.639823 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-7dd9bc5e-cc31-4047-a88c-3474e1fd7e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:02.678250 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40819d6-905f-443c-b7f6-3474661bd681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:02.689470 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40819d6-905f-443c-b7f6-3474661bd681 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:02.689789 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40819d6-905f-443c-b7f6-3474661bd681 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:02.690139 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40819d6-905f-443c-b7f6-3474661bd681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:02.699194 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d40819d6-905f-443c-b7f6-3474661bd681 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:02.725088 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9bc5e-cc31-4047-a88c-3474e1fd7e22 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:02.732300 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c71e6-b685-44d7-b5cc-895402dfb5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:02.734206 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c71e6-b685-44d7-b5cc-895402dfb5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:02.735012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c71e6-b685-44d7-b5cc-895402dfb5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:02.735791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c71e6-b685-44d7-b5cc-895402dfb5c6 admin admin] PATH_INFO: `/v3/projects/b068a57c61a5491586e2edc68d26110f` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:02.738707 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c71e6-b685-44d7-b5cc-895402dfb5c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b068a57c61a5491586e2edc68d26110f)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:02.743817 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c71e6-b685-44d7-b5cc-895402dfb5c6 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:02.779488 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40819d6-905f-443c-b7f6-3474661bd681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:02.781070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40819d6-905f-443c-b7f6-3474661bd681 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:02.805240 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 988/1959] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:57:02.827194 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40819d6-905f-443c-b7f6-3474661bd681 service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:02.828808 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d40819d6-905f-443c-b7f6-3474661bd681 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:02.849645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40819d6-905f-443c-b7f6-3474661bd681 service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:02.862961 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e81bc-3992-4d1a-ba72-518e8f4cae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:02.864103 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e81bc-3992-4d1a-ba72-518e8f4cae1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:02.864826 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e81bc-3992-4d1a-ba72-518e8f4cae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:02.865163 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e81bc-3992-4d1a-ba72-518e8f4cae1d admin admin] PATH_INFO: `/v3/users/839ae32a1c224d64a2a63bb36cfde642` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:02.867708 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e81bc-3992-4d1a-ba72-518e8f4cae1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=839ae32a1c224d64a2a63bb36cfde642)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:02.870455 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e81bc-3992-4d1a-ba72-518e8f4cae1d admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:02.932086 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-762c71e6-b685-44d7-b5cc-895402dfb5c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b068a57c61a5491586e2edc68d26110f', 'request_id': 'req-762c71e6-b685-44d7-b5cc-895402dfb5c6'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.065983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-762c71e6-b685-44d7-b5cc-895402dfb5c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b068a57c61a5491586e2edc68d26110f', 'request_id': 'req-762c71e6-b685-44d7-b5cc-895402dfb5c6'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.082332 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-762c71e6-b685-44d7-b5cc-895402dfb5c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b068a57c61a5491586e2edc68d26110f', 'request_id': 'req-762c71e6-b685-44d7-b5cc-895402dfb5c6'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.106572 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-762c71e6-b685-44d7-b5cc-895402dfb5c6 admin admin] The token cache is being invalidate because project b068a57c61a5491586e2edc68d26110f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:57:03.109628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-762c71e6-b685-44d7-b5cc-895402dfb5c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.111671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-762c71e6-b685-44d7-b5cc-895402dfb5c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.117699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 972/1960] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:57:02 2022] DELETE /identity/v3/projects/b068a57c61a5491586e2edc68d26110f => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:57:03.119704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c71e6-b685-44d7-b5cc-895402dfb5c6 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:03.122606 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-762c71e6-b685-44d7-b5cc-895402dfb5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:03.216927 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-cc1e81bc-3992-4d1a-ba72-518e8f4cae1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '839ae32a1c224d64a2a63bb36cfde642'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.217599 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-cc1e81bc-3992-4d1a-ba72-518e8f4cae1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '839ae32a1c224d64a2a63bb36cfde642'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.226190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c71e6-b685-44d7-b5cc-895402dfb5c6 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:03.231395 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847eb6e-39c4-4ad9-bf54-8ebd9202934b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:03.232278 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847eb6e-39c4-4ad9-bf54-8ebd9202934b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:03.232552 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847eb6e-39c4-4ad9-bf54-8ebd9202934b admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:03.232861 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-cc1e81bc-3992-4d1a-ba72-518e8f4cae1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '839ae32a1c224d64a2a63bb36cfde642'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.233022 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847eb6e-39c4-4ad9-bf54-8ebd9202934b admin admin] PATH_INFO: `/v3/projects/76b516a053644dd29de5d63192f2b750` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:03.234069 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847eb6e-39c4-4ad9-bf54-8ebd9202934b admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b516a053644dd29de5d63192f2b750)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:03.236012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847eb6e-39c4-4ad9-bf54-8ebd9202934b admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:03.243195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-cc1e81bc-3992-4d1a-ba72-518e8f4cae1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '839ae32a1c224d64a2a63bb36cfde642'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.244071 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-cc1e81bc-3992-4d1a-ba72-518e8f4cae1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '839ae32a1c224d64a2a63bb36cfde642'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.342139 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 989/1961] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:57:02 2022] DELETE /identity/v3/users/839ae32a1c224d64a2a63bb36cfde642 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:57:03.343160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e81bc-3992-4d1a-ba72-518e8f4cae1d admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:03.344667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-cc1e81bc-3992-4d1a-ba72-518e8f4cae1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:03.406711 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6847eb6e-39c4-4ad9-bf54-8ebd9202934b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b516a053644dd29de5d63192f2b750', 'request_id': 'req-6847eb6e-39c4-4ad9-bf54-8ebd9202934b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.417008 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e81bc-3992-4d1a-ba72-518e8f4cae1d admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:03.495238 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff019a6-497e-4363-a2f6-287fceca0f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:03.496257 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff019a6-497e-4363-a2f6-287fceca0f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:03.496717 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff019a6-497e-4363-a2f6-287fceca0f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:03.497155 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff019a6-497e-4363-a2f6-287fceca0f73 admin admin] PATH_INFO: `/v3/users/8664bc4d7d254fc193721f43aa72d808` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:03.498911 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff019a6-497e-4363-a2f6-287fceca0f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8664bc4d7d254fc193721f43aa72d808)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:03.499860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6847eb6e-39c4-4ad9-bf54-8ebd9202934b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b516a053644dd29de5d63192f2b750', 'request_id': 'req-6847eb6e-39c4-4ad9-bf54-8ebd9202934b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.502284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff019a6-497e-4363-a2f6-287fceca0f73 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:03.510702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6847eb6e-39c4-4ad9-bf54-8ebd9202934b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b516a053644dd29de5d63192f2b750', 'request_id': 'req-6847eb6e-39c4-4ad9-bf54-8ebd9202934b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.527314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6847eb6e-39c4-4ad9-bf54-8ebd9202934b admin admin] The token cache is being invalidate because project 76b516a053644dd29de5d63192f2b750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:57:03.527673 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6847eb6e-39c4-4ad9-bf54-8ebd9202934b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.528651 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6847eb6e-39c4-4ad9-bf54-8ebd9202934b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.531147 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 973/1962] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:57:03 2022] DELETE /identity/v3/projects/76b516a053644dd29de5d63192f2b750 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:03.533272 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26f7aa-a3db-492c-b9c0-8dc4e04a2668 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:03.533741 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26f7aa-a3db-492c-b9c0-8dc4e04a2668 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:03.534311 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26f7aa-a3db-492c-b9c0-8dc4e04a2668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:03.556257 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-7d26f7aa-a3db-492c-b9c0-8dc4e04a2668 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:03.557573 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-7d26f7aa-a3db-492c-b9c0-8dc4e04a2668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:03.565845 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 974/1963] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:03.567142 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a2ecb-974b-4084-abd9-3ff93586f26e None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:03.567462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a2ecb-974b-4084-abd9-3ff93586f26e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:03.567737 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a2ecb-974b-4084-abd9-3ff93586f26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:03.597994 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-413a2ecb-974b-4084-abd9-3ff93586f26e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:03.600734 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-413a2ecb-974b-4084-abd9-3ff93586f26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:03.616623 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 975/1964] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:03.619943 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a2ecb-974b-4084-abd9-3ff93586f26e None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:03.622435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-413a2ecb-974b-4084-abd9-3ff93586f26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:03.745436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a2ecb-974b-4084-abd9-3ff93586f26e None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:03.754355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bbc88-a18b-4f37-bc20-7ba804018a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:03.756610 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bbc88-a18b-4f37-bc20-7ba804018a97 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:03.757258 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bbc88-a18b-4f37-bc20-7ba804018a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:03.757837 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bbc88-a18b-4f37-bc20-7ba804018a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:03.762535 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fff019a6-497e-4363-a2f6-287fceca0f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8664bc4d7d254fc193721f43aa72d808'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.763346 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fff019a6-497e-4363-a2f6-287fceca0f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8664bc4d7d254fc193721f43aa72d808'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.774840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bbc88-a18b-4f37-bc20-7ba804018a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:03.777362 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bbc88-a18b-4f37-bc20-7ba804018a97 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:03.782520 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fff019a6-497e-4363-a2f6-287fceca0f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8664bc4d7d254fc193721f43aa72d808'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.794968 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 976/1965] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:57:03.796798 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18d208-67c4-4e4e-8255-1554f24ccc24 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:03.797307 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18d208-67c4-4e4e-8255-1554f24ccc24 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:03.797892 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18d208-67c4-4e4e-8255-1554f24ccc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:03.808657 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fff019a6-497e-4363-a2f6-287fceca0f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8664bc4d7d254fc193721f43aa72d808'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.809510 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fff019a6-497e-4363-a2f6-287fceca0f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8664bc4d7d254fc193721f43aa72d808'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:03.823337 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-bd18d208-67c4-4e4e-8255-1554f24ccc24 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:03.824958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-bd18d208-67c4-4e4e-8255-1554f24ccc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:03.839623 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 977/1966] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:03.843983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18d208-67c4-4e4e-8255-1554f24ccc24 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:03.854634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18d208-67c4-4e4e-8255-1554f24ccc24 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:03.859442 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c5e8f-7e1b-4215-b2c8-487c8572c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:03.860490 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c5e8f-7e1b-4215-b2c8-487c8572c842 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:03.860863 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c5e8f-7e1b-4215-b2c8-487c8572c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:03.861241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c5e8f-7e1b-4215-b2c8-487c8572c842 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:03.862168 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c5e8f-7e1b-4215-b2c8-487c8572c842 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:57:03.862544 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c5e8f-7e1b-4215-b2c8-487c8572c842 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:03.864522 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c5e8f-7e1b-4215-b2c8-487c8572c842 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:03.878947 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 978/1967] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:57:03.885432 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c5e8f-7e1b-4215-b2c8-487c8572c842 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:03.909206 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c5e8f-7e1b-4215-b2c8-487c8572c842 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:03.913274 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 990/1968] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:57:03 2022] DELETE /identity/v3/users/8664bc4d7d254fc193721f43aa72d808 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:04.024847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f837dae-4ddd-446c-97d3-45ad6a0f3bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:04.025656 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f837dae-4ddd-446c-97d3-45ad6a0f3bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:04.025947 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f837dae-4ddd-446c-97d3-45ad6a0f3bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:04.026225 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f837dae-4ddd-446c-97d3-45ad6a0f3bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:04.026949 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f837dae-4ddd-446c-97d3-45ad6a0f3bf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:04.029161 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f837dae-4ddd-446c-97d3-45ad6a0f3bf5 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:04.249276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 979/1969] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:57:03 2022] POST /identity/v3/projects => generated 377 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:57:04.255805 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff019a6-497e-4363-a2f6-287fceca0f73 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:04.266614 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff019a6-497e-4363-a2f6-287fceca0f73 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:04.338052 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92544da9-b4c4-4e73-ab8d-32fc9a8ab150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:04.344088 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92544da9-b4c4-4e73-ab8d-32fc9a8ab150 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:04.344536 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92544da9-b4c4-4e73-ab8d-32fc9a8ab150 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:04.345416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92544da9-b4c4-4e73-ab8d-32fc9a8ab150 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:04.346668 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92544da9-b4c4-4e73-ab8d-32fc9a8ab150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:04.348183 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92544da9-b4c4-4e73-ab8d-32fc9a8ab150 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:04.427948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 991/1970] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:57:04 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:57:04.432783 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f837dae-4ddd-446c-97d3-45ad6a0f3bf5 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:04.448413 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f837dae-4ddd-446c-97d3-45ad6a0f3bf5 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:04.453398 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec7908-86d3-4e32-b34c-165e67c33982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:04.454133 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec7908-86d3-4e32-b34c-165e67c33982 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:04.454413 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec7908-86d3-4e32-b34c-165e67c33982 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:04.454689 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec7908-86d3-4e32-b34c-165e67c33982 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:04.455435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec7908-86d3-4e32-b34c-165e67c33982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:04.457241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec7908-86d3-4e32-b34c-165e67c33982 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:04.468760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 980/1971] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:57:04.473006 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92544da9-b4c4-4e73-ab8d-32fc9a8ab150 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:04.484530 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92544da9-b4c4-4e73-ab8d-32fc9a8ab150 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:04.490837 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d655742-d324-44c5-af6a-ee4a993b66f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:04.491643 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655742-d324-44c5-af6a-ee4a993b66f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:04.491998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655742-d324-44c5-af6a-ee4a993b66f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:04.492349 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655742-d324-44c5-af6a-ee4a993b66f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:04.493214 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d655742-d324-44c5-af6a-ee4a993b66f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:04.495022 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d655742-d324-44c5-af6a-ee4a993b66f0 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:04.506472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 992/1972] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:04.512251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec7908-86d3-4e32-b34c-165e67c33982 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:04.525917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec7908-86d3-4e32-b34c-165e67c33982 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:04.526477 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d655742-d324-44c5-af6a-ee4a993b66f0 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:04.529617 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8d655742-d324-44c5-af6a-ee4a993b66f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:04.531426 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7dfec-47be-4567-9ec6-2e422103274c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:04.532564 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7dfec-47be-4567-9ec6-2e422103274c admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:04.533191 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7dfec-47be-4567-9ec6-2e422103274c admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:04.533653 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7dfec-47be-4567-9ec6-2e422103274c admin admin] PATH_INFO: `/v3/projects/ffb8bed5a024424c9c20104e1b292ce6/users/0f87181192ef4942b290e140c5417a0d/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:04.559703 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7dfec-47be-4567-9ec6-2e422103274c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffb8bed5a024424c9c20104e1b292ce6, user_id=0f87181192ef4942b290e140c5417a0d, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:04.561362 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7dfec-47be-4567-9ec6-2e422103274c admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:04.575073 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d655742-d324-44c5-af6a-ee4a993b66f0 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:04.576106 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5d7d9-40e2-41e8-8ea0-d7c4d8c18e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:04.577023 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5d7d9-40e2-41e8-8ea0-d7c4d8c18e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:04.577308 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5d7d9-40e2-41e8-8ea0-d7c4d8c18e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:04.577583 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5d7d9-40e2-41e8-8ea0-d7c4d8c18e63 admin admin] PATH_INFO: `/v3/projects/342efa0d9e874a989e236bc5b52e1b73` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:04.578934 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5d7d9-40e2-41e8-8ea0-d7c4d8c18e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=342efa0d9e874a989e236bc5b52e1b73)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:04.580940 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5d7d9-40e2-41e8-8ea0-d7c4d8c18e63 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:04.694583 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 981/1973] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:57:04 2022] PUT /identity/v3/projects/ffb8bed5a024424c9c20104e1b292ce6/users/0f87181192ef4942b290e140c5417a0d/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:04.696527 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7dfec-47be-4567-9ec6-2e422103274c admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:04.704400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-8ee7dfec-47be-4567-9ec6-2e422103274c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:04.720703 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b8d5d7d9-40e2-41e8-8ea0-d7c4d8c18e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342efa0d9e874a989e236bc5b52e1b73', 'request_id': 'req-b8d5d7d9-40e2-41e8-8ea0-d7c4d8c18e63'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:04.790020 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7dfec-47be-4567-9ec6-2e422103274c admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:04.799160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b8d5d7d9-40e2-41e8-8ea0-d7c4d8c18e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342efa0d9e874a989e236bc5b52e1b73', 'request_id': 'req-b8d5d7d9-40e2-41e8-8ea0-d7c4d8c18e63'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:04.813757 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b8d5d7d9-40e2-41e8-8ea0-d7c4d8c18e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342efa0d9e874a989e236bc5b52e1b73', 'request_id': 'req-b8d5d7d9-40e2-41e8-8ea0-d7c4d8c18e63'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:04.830016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b8d5d7d9-40e2-41e8-8ea0-d7c4d8c18e63 admin admin] The token cache is being invalidate because project 342efa0d9e874a989e236bc5b52e1b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:57:04.830447 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b8d5d7d9-40e2-41e8-8ea0-d7c4d8c18e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:04.831462 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b8d5d7d9-40e2-41e8-8ea0-d7c4d8c18e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:04.835468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 993/1974] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:57:04 2022] DELETE /identity/v3/projects/342efa0d9e874a989e236bc5b52e1b73 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:04.838230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e465b-f664-4362-94b4-ba007c66aeed None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:04.838692 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e465b-f664-4362-94b4-ba007c66aeed None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:04.849665 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e465b-f664-4362-94b4-ba007c66aeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:04.876356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-766e465b-f664-4362-94b4-ba007c66aeed None None] MFA Rules not processed for user `0f87181192ef4942b290e140c5417a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:04.878286 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-766e465b-f664-4362-94b4-ba007c66aeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:04.885134 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b769b3b-ab53-432f-95a8-ef1ba63f3ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:04.886528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b769b3b-ab53-432f-95a8-ef1ba63f3ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:04.886982 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b769b3b-ab53-432f-95a8-ef1ba63f3ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:04.887703 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b769b3b-ab53-432f-95a8-ef1ba63f3ccf admin admin] PATH_INFO: `/v3/projects/692a48c97a0d44f788cf740b9892def3` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:04.889115 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b769b3b-ab53-432f-95a8-ef1ba63f3ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=692a48c97a0d44f788cf740b9892def3)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:04.892700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b769b3b-ab53-432f-95a8-ef1ba63f3ccf admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:04.970663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 994/1975] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:04.971969 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282c5a-4b7b-489c-a506-6f1afb90d7dd None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:04.972260 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282c5a-4b7b-489c-a506-6f1afb90d7dd None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:04.972534 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282c5a-4b7b-489c-a506-6f1afb90d7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:05.001406 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-53282c5a-4b7b-489c-a506-6f1afb90d7dd None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:05.002630 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-53282c5a-4b7b-489c-a506-6f1afb90d7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:05.012062 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 995/1976] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:05.012996 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53282c5a-4b7b-489c-a506-6f1afb90d7dd None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:05.014823 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-53282c5a-4b7b-489c-a506-6f1afb90d7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:05.030458 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53282c5a-4b7b-489c-a506-6f1afb90d7dd None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:05.058714 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9b769b3b-ab53-432f-95a8-ef1ba63f3ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '692a48c97a0d44f788cf740b9892def3', 'request_id': 'req-9b769b3b-ab53-432f-95a8-ef1ba63f3ccf'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:05.101538 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1776e58-f55d-4d66-9c8d-c71a9af460b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:05.102230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1776e58-f55d-4d66-9c8d-c71a9af460b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:05.102508 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1776e58-f55d-4d66-9c8d-c71a9af460b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:05.102779 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1776e58-f55d-4d66-9c8d-c71a9af460b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:05.103492 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1776e58-f55d-4d66-9c8d-c71a9af460b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:05.105457 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1776e58-f55d-4d66-9c8d-c71a9af460b4 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:05.135611 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9b769b3b-ab53-432f-95a8-ef1ba63f3ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '692a48c97a0d44f788cf740b9892def3', 'request_id': 'req-9b769b3b-ab53-432f-95a8-ef1ba63f3ccf'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:05.142803 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9b769b3b-ab53-432f-95a8-ef1ba63f3ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '692a48c97a0d44f788cf740b9892def3', 'request_id': 'req-9b769b3b-ab53-432f-95a8-ef1ba63f3ccf'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:05.158520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9b769b3b-ab53-432f-95a8-ef1ba63f3ccf admin admin] The token cache is being invalidate because project 692a48c97a0d44f788cf740b9892def3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:57:05.158880 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9b769b3b-ab53-432f-95a8-ef1ba63f3ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:05.159727 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9b769b3b-ab53-432f-95a8-ef1ba63f3ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:05.161932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 982/1977] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:57:04 2022] DELETE /identity/v3/projects/692a48c97a0d44f788cf740b9892def3 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:05.170275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50df41-6901-4839-839a-a66eb6d5fd76 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:05.170578 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50df41-6901-4839-839a-a66eb6d5fd76 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:05.170884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50df41-6901-4839-839a-a66eb6d5fd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:05.192713 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-9f50df41-6901-4839-839a-a66eb6d5fd76 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:05.194986 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9f50df41-6901-4839-839a-a66eb6d5fd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:05.206142 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 983/1978] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:05.206937 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24879f-7d7c-4699-9630-ac4b320044bf None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:05.207332 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24879f-7d7c-4699-9630-ac4b320044bf None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:05.207654 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24879f-7d7c-4699-9630-ac4b320044bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:05.228825 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-7e24879f-7d7c-4699-9630-ac4b320044bf None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:05.230217 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-7e24879f-7d7c-4699-9630-ac4b320044bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:05.240179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 984/1979] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:05.241031 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24879f-7d7c-4699-9630-ac4b320044bf None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:05.252051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24879f-7d7c-4699-9630-ac4b320044bf None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:05.257236 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d76bbe-a656-4159-a240-00a7561ef4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:05.257905 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76bbe-a656-4159-a240-00a7561ef4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:05.258187 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76bbe-a656-4159-a240-00a7561ef4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:05.258465 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76bbe-a656-4159-a240-00a7561ef4a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:05.259225 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d76bbe-a656-4159-a240-00a7561ef4a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:57:05.259541 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d76bbe-a656-4159-a240-00a7561ef4a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:05.261344 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d76bbe-a656-4159-a240-00a7561ef4a7 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:05.275284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 996/1980] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:57:05 2022] POST /identity/v3/projects => generated 377 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:57:05.275284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb9ac-f7e2-46d5-acd4-346b5e73e47c None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:05.275284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb9ac-f7e2-46d5-acd4-346b5e73e47c None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:05.275284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb9ac-f7e2-46d5-acd4-346b5e73e47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:05.278990 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 985/1981] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:57:05.279846 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d76bbe-a656-4159-a240-00a7561ef4a7 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:05.282435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d9d76bbe-a656-4159-a240-00a7561ef4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:05.288620 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-9e6cb9ac-f7e2-46d5-acd4-346b5e73e47c None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:05.289889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-9e6cb9ac-f7e2-46d5-acd4-346b5e73e47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:05.298049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d76bbe-a656-4159-a240-00a7561ef4a7 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:05.366449 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 997/1982] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:05.368408 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399ffe4-38a0-489d-bd61-3dff79d9c997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:05.369131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399ffe4-38a0-489d-bd61-3dff79d9c997 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:05.369412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399ffe4-38a0-489d-bd61-3dff79d9c997 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:05.369688 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399ffe4-38a0-489d-bd61-3dff79d9c997 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:05.370694 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399ffe4-38a0-489d-bd61-3dff79d9c997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:05.370865 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cb9ac-f7e2-46d5-acd4-346b5e73e47c None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:05.372683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399ffe4-38a0-489d-bd61-3dff79d9c997 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:05.382434 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cb9ac-f7e2-46d5-acd4-346b5e73e47c None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:05.388437 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38784b24-cb98-4365-802e-a6559d8ae725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:05.389329 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38784b24-cb98-4365-802e-a6559d8ae725 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:05.389613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38784b24-cb98-4365-802e-a6559d8ae725 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:05.389947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38784b24-cb98-4365-802e-a6559d8ae725 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:05.390647 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38784b24-cb98-4365-802e-a6559d8ae725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:05.392630 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38784b24-cb98-4365-802e-a6559d8ae725 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:05.494409 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 986/1983] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:57:05 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:57:05.495386 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399ffe4-38a0-489d-bd61-3dff79d9c997 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:05.508335 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399ffe4-38a0-489d-bd61-3dff79d9c997 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:05.515616 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207762-3f8a-430b-b544-5624de86bcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:05.516275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207762-3f8a-430b-b544-5624de86bcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:05.516556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207762-3f8a-430b-b544-5624de86bcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:05.516858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207762-3f8a-430b-b544-5624de86bcb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:05.517584 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a207762-3f8a-430b-b544-5624de86bcb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:57:05.517887 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a207762-3f8a-430b-b544-5624de86bcb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:05.519473 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a207762-3f8a-430b-b544-5624de86bcb4 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:05.529938 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 998/1984] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:57:05 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:57:05.531594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38784b24-cb98-4365-802e-a6559d8ae725 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:05.533381 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 987/1985] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:57:05.535062 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207762-3f8a-430b-b544-5624de86bcb4 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:05.545938 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207762-3f8a-430b-b544-5624de86bcb4 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:05.606909 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38784b24-cb98-4365-802e-a6559d8ae725 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:05.613735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500ba93-dd96-4a2a-9140-6a65bce4efef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:05.615554 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500ba93-dd96-4a2a-9140-6a65bce4efef admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:05.616402 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500ba93-dd96-4a2a-9140-6a65bce4efef admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:05.616557 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500ba93-dd96-4a2a-9140-6a65bce4efef admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:05.617821 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500ba93-dd96-4a2a-9140-6a65bce4efef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:05.620881 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500ba93-dd96-4a2a-9140-6a65bce4efef admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:05.621466 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b12740-23c6-4897-be66-d7ac6a70add3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:05.622144 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b12740-23c6-4897-be66-d7ac6a70add3 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:05.622424 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b12740-23c6-4897-be66-d7ac6a70add3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:05.622700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b12740-23c6-4897-be66-d7ac6a70add3 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:05.623396 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b12740-23c6-4897-be66-d7ac6a70add3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:05.625382 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b12740-23c6-4897-be66-d7ac6a70add3 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:05.632523 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 999/1986] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:05.633512 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500ba93-dd96-4a2a-9140-6a65bce4efef admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:05.644602 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500ba93-dd96-4a2a-9140-6a65bce4efef admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:05.650111 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8651c6-c7d4-425e-a17e-3953e466eab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:05.650765 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8651c6-c7d4-425e-a17e-3953e466eab2 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:05.651045 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8651c6-c7d4-425e-a17e-3953e466eab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:05.651319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8651c6-c7d4-425e-a17e-3953e466eab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:05.652017 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8651c6-c7d4-425e-a17e-3953e466eab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:05.653966 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8651c6-c7d4-425e-a17e-3953e466eab2 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:05.752165 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 988/1987] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:57:05 2022] POST /identity/v3/users => generated 281 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:57:05.752825 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b12740-23c6-4897-be66-d7ac6a70add3 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:05.764097 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b12740-23c6-4897-be66-d7ac6a70add3 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:05.769116 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a9af0-f99e-4333-b862-27664dd7c89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:05.769777 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a9af0-f99e-4333-b862-27664dd7c89f admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:05.770049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a9af0-f99e-4333-b862-27664dd7c89f admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:05.770316 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a9af0-f99e-4333-b862-27664dd7c89f admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:05.772002 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a9af0-f99e-4333-b862-27664dd7c89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:05.773918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a9af0-f99e-4333-b862-27664dd7c89f admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:05.785557 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1000/1988] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:57:05 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:57:05.786567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8651c6-c7d4-425e-a17e-3953e466eab2 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:05.786950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 989/1989] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:05.790027 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a9af0-f99e-4333-b862-27664dd7c89f admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:05.805841 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a9af0-f99e-4333-b862-27664dd7c89f admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:05.863968 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8651c6-c7d4-425e-a17e-3953e466eab2 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:05.870656 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fceebf9-46df-4e90-83b0-cc3315865b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:05.871531 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceebf9-46df-4e90-83b0-cc3315865b8d admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:05.871821 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceebf9-46df-4e90-83b0-cc3315865b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:05.872475 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceebf9-46df-4e90-83b0-cc3315865b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:05.873269 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fceebf9-46df-4e90-83b0-cc3315865b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:05.875411 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fceebf9-46df-4e90-83b0-cc3315865b8d admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:05.887342 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6fac2-012d-4d30-bf84-0f12c295542f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:05.888345 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6fac2-012d-4d30-bf84-0f12c295542f admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:05.888813 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6fac2-012d-4d30-bf84-0f12c295542f admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:05.889227 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6fac2-012d-4d30-bf84-0f12c295542f admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:05.890196 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6fac2-012d-4d30-bf84-0f12c295542f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:05.890304 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1001/1990] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:05.892151 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fceebf9-46df-4e90-83b0-cc3315865b8d admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:05.892838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6fac2-012d-4d30-bf84-0f12c295542f admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:05.911555 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fceebf9-46df-4e90-83b0-cc3315865b8d admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:05.916907 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620420cd-5a10-49af-bb4f-293c866f295b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:05.917857 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620420cd-5a10-49af-bb4f-293c866f295b admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:05.918188 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620420cd-5a10-49af-bb4f-293c866f295b admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:05.918468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620420cd-5a10-49af-bb4f-293c866f295b admin admin] PATH_INFO: `/v3/projects/604580b0aaee43419e1b959d9291ce32/users/d628b2a288784d35bd004c0f3112aab7/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:05.942309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620420cd-5a10-49af-bb4f-293c866f295b admin admin] RBAC: Authorizing `identity:create_grant(project_id=604580b0aaee43419e1b959d9291ce32, user_id=d628b2a288784d35bd004c0f3112aab7, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:05.945621 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620420cd-5a10-49af-bb4f-293c866f295b admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:06.027583 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 990/1991] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:57:05 2022] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:57:06.028390 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6fac2-012d-4d30-bf84-0f12c295542f admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:06.038563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6fac2-012d-4d30-bf84-0f12c295542f admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:06.039541 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1002/1992] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:57:05 2022] PUT /identity/v3/projects/604580b0aaee43419e1b959d9291ce32/users/d628b2a288784d35bd004c0f3112aab7/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:06.040762 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620420cd-5a10-49af-bb4f-293c866f295b admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:06.108132 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab710e2-b84f-4644-8e41-39383ce0e47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:06.108843 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab710e2-b84f-4644-8e41-39383ce0e47b admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:06.109125 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab710e2-b84f-4644-8e41-39383ce0e47b admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:06.109400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab710e2-b84f-4644-8e41-39383ce0e47b admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:06.110136 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab710e2-b84f-4644-8e41-39383ce0e47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:06.111735 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab710e2-b84f-4644-8e41-39383ce0e47b admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:06.112274 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620420cd-5a10-49af-bb4f-293c866f295b admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:06.118011 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1df7b-ea64-4428-8aa8-d823e7afe1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:06.118442 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1df7b-ea64-4428-8aa8-d823e7afe1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:06.118725 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1df7b-ea64-4428-8aa8-d823e7afe1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:06.119000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1df7b-ea64-4428-8aa8-d823e7afe1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:06.119731 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1df7b-ea64-4428-8aa8-d823e7afe1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:06.121478 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1df7b-ea64-4428-8aa8-d823e7afe1a0 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:06.123099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 991/1993] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:06.124165 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93711850-2c61-4e86-a6b5-d4ff79deb693 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:06.124447 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93711850-2c61-4e86-a6b5-d4ff79deb693 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:06.124744 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93711850-2c61-4e86-a6b5-d4ff79deb693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:06.132619 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1003/1994] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:06.133223 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1df7b-ea64-4428-8aa8-d823e7afe1a0 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:06.143145 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1df7b-ea64-4428-8aa8-d823e7afe1a0 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:06.150368 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d230ea-56c6-4e99-949f-2e96c25e3723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:06.151481 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d230ea-56c6-4e99-949f-2e96c25e3723 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:06.151758 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d230ea-56c6-4e99-949f-2e96c25e3723 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:06.152033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d230ea-56c6-4e99-949f-2e96c25e3723 admin admin] PATH_INFO: `/v3/projects/b6d40125efd84a798e1fd41a8bcd5133/users/ac4dcab39856459688553be804249ff4/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:06.156336 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-93711850-2c61-4e86-a6b5-d4ff79deb693 None None] MFA Rules not processed for user `d628b2a288784d35bd004c0f3112aab7`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:06.157658 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-93711850-2c61-4e86-a6b5-d4ff79deb693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:06.167626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d230ea-56c6-4e99-949f-2e96c25e3723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d40125efd84a798e1fd41a8bcd5133, user_id=ac4dcab39856459688553be804249ff4, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:06.170340 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d230ea-56c6-4e99-949f-2e96c25e3723 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:06.247585 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 992/1995] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:06.249243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93711850-2c61-4e86-a6b5-d4ff79deb693 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:06.271944 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93711850-2c61-4e86-a6b5-d4ff79deb693 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:06.287809 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1004/1996] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:57:06 2022] PUT /identity/v3/projects/b6d40125efd84a798e1fd41a8bcd5133/users/ac4dcab39856459688553be804249ff4/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:06.290378 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d230ea-56c6-4e99-949f-2e96c25e3723 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:06.368304 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f91d2e-027b-4f7f-95fb-e6052335cd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:06.369429 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f91d2e-027b-4f7f-95fb-e6052335cd8e admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:06.369716 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f91d2e-027b-4f7f-95fb-e6052335cd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:06.370048 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f91d2e-027b-4f7f-95fb-e6052335cd8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:06.370782 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f91d2e-027b-4f7f-95fb-e6052335cd8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:06.372585 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f91d2e-027b-4f7f-95fb-e6052335cd8e admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:06.376521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d230ea-56c6-4e99-949f-2e96c25e3723 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:06.384188 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 993/1997] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:06.385806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7ffca-711f-427e-ae08-da49828264f2 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:06.386143 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7ffca-711f-427e-ae08-da49828264f2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:06.386421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7ffca-711f-427e-ae08-da49828264f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:06.388188 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f5386-458f-43e1-b910-d0ed6317d57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:06.389130 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f5386-458f-43e1-b910-d0ed6317d57e admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:06.389590 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f5386-458f-43e1-b910-d0ed6317d57e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:06.390036 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f5386-458f-43e1-b910-d0ed6317d57e admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:06.390917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f5386-458f-43e1-b910-d0ed6317d57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:06.393110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f5386-458f-43e1-b910-d0ed6317d57e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:06.435057 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-9ce7ffca-711f-427e-ae08-da49828264f2 None None] MFA Rules not processed for user `ac4dcab39856459688553be804249ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:06.435057 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9ce7ffca-711f-427e-ae08-da49828264f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:06.484911 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1005/1998] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:57:06 2022] POST /identity/v3/projects => generated 377 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:57:06.486227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f5386-458f-43e1-b910-d0ed6317d57e admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:06.557671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 994/1999] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:06.557671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7ffca-711f-427e-ae08-da49828264f2 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:06.589186 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f5386-458f-43e1-b910-d0ed6317d57e admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:06.592880 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7ffca-711f-427e-ae08-da49828264f2 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:06.594359 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff73cd6-d6e8-4c5b-9512-f890fdc0b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:06.595270 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff73cd6-d6e8-4c5b-9512-f890fdc0b372 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:06.595564 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff73cd6-d6e8-4c5b-9512-f890fdc0b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:06.595815 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff73cd6-d6e8-4c5b-9512-f890fdc0b372 admin admin] PATH_INFO: `/v3/projects/19541936c13a4fd58689e30f0767ae2e/users/246a1e16afa24ab2a53f66b207c7aecd/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:06.601801 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ceba44-d5a9-497b-b0de-ccd14e31b088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:06.602496 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceba44-d5a9-497b-b0de-ccd14e31b088 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:06.602777 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceba44-d5a9-497b-b0de-ccd14e31b088 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:06.603051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceba44-d5a9-497b-b0de-ccd14e31b088 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:06.603759 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ceba44-d5a9-497b-b0de-ccd14e31b088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:06.605949 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ceba44-d5a9-497b-b0de-ccd14e31b088 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:06.620316 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff73cd6-d6e8-4c5b-9512-f890fdc0b372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19541936c13a4fd58689e30f0767ae2e, user_id=246a1e16afa24ab2a53f66b207c7aecd, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:06.623096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff73cd6-d6e8-4c5b-9512-f890fdc0b372 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:06.719345 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 995/2000] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:57:06 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:57:06.720191 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ceba44-d5a9-497b-b0de-ccd14e31b088 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:06.721838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e7ceba44-d5a9-497b-b0de-ccd14e31b088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:06.737179 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1006/2001] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:57:06 2022] PUT /identity/v3/projects/19541936c13a4fd58689e30f0767ae2e/users/246a1e16afa24ab2a53f66b207c7aecd/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:06.746843 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff73cd6-d6e8-4c5b-9512-f890fdc0b372 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:06.793030 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ceba44-d5a9-497b-b0de-ccd14e31b088 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:06.830395 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff73cd6-d6e8-4c5b-9512-f890fdc0b372 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:06.836048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e8907-20fc-41e6-8369-8dd14e02b091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:06.837061 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e8907-20fc-41e6-8369-8dd14e02b091 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:06.837573 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e8907-20fc-41e6-8369-8dd14e02b091 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:06.837844 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e8907-20fc-41e6-8369-8dd14e02b091 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:06.838550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e8907-20fc-41e6-8369-8dd14e02b091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:06.840256 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e8907-20fc-41e6-8369-8dd14e02b091 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:06.851608 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1007/2002] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:06.854070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cebda-994d-43f9-9f89-9dabde9b974b None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:06.854542 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cebda-994d-43f9-9f89-9dabde9b974b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:06.855098 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cebda-994d-43f9-9f89-9dabde9b974b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:06.858554 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a1e0b-828d-4cb3-ae32-56bd82183392 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:06.859219 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a1e0b-828d-4cb3-ae32-56bd82183392 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:06.859500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a1e0b-828d-4cb3-ae32-56bd82183392 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:06.859777 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a1e0b-828d-4cb3-ae32-56bd82183392 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:06.891123 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-5c7cebda-994d-43f9-9f89-9dabde9b974b None None] MFA Rules not processed for user `246a1e16afa24ab2a53f66b207c7aecd`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:06.893551 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-5c7cebda-994d-43f9-9f89-9dabde9b974b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:06.938570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a1e0b-828d-4cb3-ae32-56bd82183392 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:06.940304 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a1e0b-828d-4cb3-ae32-56bd82183392 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:06.954693 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 996/2003] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:57:06.956318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a1e0b-828d-4cb3-ae32-56bd82183392 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:06.974946 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a1e0b-828d-4cb3-ae32-56bd82183392 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:06.988921 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2065e-25a2-4f65-b051-fe2b87d31f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:06.992774 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2065e-25a2-4f65-b051-fe2b87d31f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:06.993234 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2065e-25a2-4f65-b051-fe2b87d31f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:06.993529 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2065e-25a2-4f65-b051-fe2b87d31f2f admin admin] PATH_INFO: `/v3/projects/0869edd46fe445df9da0bf45297c84b2/users/78c82909b60a4055b839e412088effca/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:06.994486 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1008/2004] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:06.995252 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cebda-994d-43f9-9f89-9dabde9b974b None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:07.008601 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cebda-994d-43f9-9f89-9dabde9b974b None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:07.014001 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1988da6-6ff7-4d08-972a-7a771a570ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:07.014971 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1988da6-6ff7-4d08-972a-7a771a570ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:07.015355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1988da6-6ff7-4d08-972a-7a771a570ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:07.015715 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1988da6-6ff7-4d08-972a-7a771a570ce2 admin admin] PATH_INFO: `/v3/users/ac4dcab39856459688553be804249ff4` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:07.015915 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2065e-25a2-4f65-b051-fe2b87d31f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0869edd46fe445df9da0bf45297c84b2, user_id=78c82909b60a4055b839e412088effca, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:07.017159 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1988da6-6ff7-4d08-972a-7a771a570ce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4dcab39856459688553be804249ff4)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:07.019184 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1988da6-6ff7-4d08-972a-7a771a570ce2 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:07.020931 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2065e-25a2-4f65-b051-fe2b87d31f2f admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:07.094902 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 997/2005] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:57:06 2022] PUT /identity/v3/projects/0869edd46fe445df9da0bf45297c84b2/users/78c82909b60a4055b839e412088effca/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:07.095723 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2065e-25a2-4f65-b051-fe2b87d31f2f admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:07.180567 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2065e-25a2-4f65-b051-fe2b87d31f2f admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:07.185571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa34d6-1604-45fc-8419-45e99743ca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:07.186268 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa34d6-1604-45fc-8419-45e99743ca10 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:07.186888 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa34d6-1604-45fc-8419-45e99743ca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:07.186888 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa34d6-1604-45fc-8419-45e99743ca10 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:07.187997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa34d6-1604-45fc-8419-45e99743ca10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:07.189354 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa34d6-1604-45fc-8419-45e99743ca10 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:07.229546 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d1988da6-6ff7-4d08-972a-7a771a570ce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4dcab39856459688553be804249ff4'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:07.230198 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d1988da6-6ff7-4d08-972a-7a771a570ce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4dcab39856459688553be804249ff4'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:07.248521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d1988da6-6ff7-4d08-972a-7a771a570ce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4dcab39856459688553be804249ff4'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:07.258423 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d1988da6-6ff7-4d08-972a-7a771a570ce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4dcab39856459688553be804249ff4'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:07.259676 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d1988da6-6ff7-4d08-972a-7a771a570ce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4dcab39856459688553be804249ff4'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:07.292764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 998/2006] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:57:07 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:57:07.293893 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa34d6-1604-45fc-8419-45e99743ca10 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:07.297170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-2faa34d6-1604-45fc-8419-45e99743ca10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:07.362936 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1009/2007] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:57:06 2022] DELETE /identity/v3/users/ac4dcab39856459688553be804249ff4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:07.363903 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1988da6-6ff7-4d08-972a-7a771a570ce2 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:07.366378 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d1988da6-6ff7-4d08-972a-7a771a570ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:07.377153 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa34d6-1604-45fc-8419-45e99743ca10 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:07.449480 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1988da6-6ff7-4d08-972a-7a771a570ce2 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:07.458762 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706223ab-8523-4bff-a365-30a1f33feace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:07.459624 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706223ab-8523-4bff-a365-30a1f33feace admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:07.460080 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706223ab-8523-4bff-a365-30a1f33feace admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:07.460541 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706223ab-8523-4bff-a365-30a1f33feace admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:07.461568 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706223ab-8523-4bff-a365-30a1f33feace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:07.464787 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706223ab-8523-4bff-a365-30a1f33feace admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:07.465412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13286ff9-6571-4d80-9df0-03cb48ad701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:07.467757 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13286ff9-6571-4d80-9df0-03cb48ad701b admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:07.468206 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13286ff9-6571-4d80-9df0-03cb48ad701b admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:07.468692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13286ff9-6571-4d80-9df0-03cb48ad701b admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:07.469871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13286ff9-6571-4d80-9df0-03cb48ad701b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:07.472465 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13286ff9-6571-4d80-9df0-03cb48ad701b admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:07.488416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 999/2008] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:07.491291 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf136f-c275-40cb-b8d0-4f24dc930fcc None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:07.491726 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf136f-c275-40cb-b8d0-4f24dc930fcc None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:07.492147 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf136f-c275-40cb-b8d0-4f24dc930fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:07.512106 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-49bf136f-c275-40cb-b8d0-4f24dc930fcc None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:07.513395 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-49bf136f-c275-40cb-b8d0-4f24dc930fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:07.521372 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1000/2009] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:07.522192 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf136f-c275-40cb-b8d0-4f24dc930fcc None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:07.533338 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf136f-c275-40cb-b8d0-4f24dc930fcc None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:07.538567 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efecb4-9204-45f5-891a-c3cb31763db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:07.539477 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efecb4-9204-45f5-891a-c3cb31763db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:07.539751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efecb4-9204-45f5-891a-c3cb31763db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:07.540024 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efecb4-9204-45f5-891a-c3cb31763db7 admin admin] PATH_INFO: `/v3/projects/0869edd46fe445df9da0bf45297c84b2/users/78c82909b60a4055b839e412088effca/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:07.542705 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efecb4-9204-45f5-891a-c3cb31763db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0869edd46fe445df9da0bf45297c84b2, user_id=78c82909b60a4055b839e412088effca, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:07.543818 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1010/2010] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:57:07 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:57:07.544817 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706223ab-8523-4bff-a365-30a1f33feace admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:07.545418 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efecb4-9204-45f5-891a-c3cb31763db7 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:07.547327 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-706223ab-8523-4bff-a365-30a1f33feace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:07.560439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1001/2011] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:57:07 2022] PUT /identity/v3/projects/0869edd46fe445df9da0bf45297c84b2/users/78c82909b60a4055b839e412088effca/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:07.561316 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efecb4-9204-45f5-891a-c3cb31763db7 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:07.637299 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706223ab-8523-4bff-a365-30a1f33feace admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:07.644244 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efecb4-9204-45f5-891a-c3cb31763db7 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:07.650275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308679c-6c15-4447-b6bd-92e2cca5bc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:07.651152 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308679c-6c15-4447-b6bd-92e2cca5bc99 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:07.651426 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308679c-6c15-4447-b6bd-92e2cca5bc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:07.651699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308679c-6c15-4447-b6bd-92e2cca5bc99 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:07.652725 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308679c-6c15-4447-b6bd-92e2cca5bc99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:07.654061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308679c-6c15-4447-b6bd-92e2cca5bc99 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:07.666400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1002/2012] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:07.671602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b05318-74ae-43a0-8944-627a8c192ff2 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:07.671602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b05318-74ae-43a0-8944-627a8c192ff2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:07.671602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b05318-74ae-43a0-8944-627a8c192ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:07.719415 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-c2b05318-74ae-43a0-8944-627a8c192ff2 None None] MFA Rules not processed for user `78c82909b60a4055b839e412088effca`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:07.721675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c2b05318-74ae-43a0-8944-627a8c192ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:07.729456 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3f4f3-b84e-4de9-9f6b-be4868567b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:07.730865 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3f4f3-b84e-4de9-9f6b-be4868567b66 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:07.731329 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3f4f3-b84e-4de9-9f6b-be4868567b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:07.731766 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3f4f3-b84e-4de9-9f6b-be4868567b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:07.743205 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3f4f3-b84e-4de9-9f6b-be4868567b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:07.744694 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3f4f3-b84e-4de9-9f6b-be4868567b66 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:07.756440 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1011/2013] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:57:07.757400 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3f4f3-b84e-4de9-9f6b-be4868567b66 service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:07.775252 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3f4f3-b84e-4de9-9f6b-be4868567b66 service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:07.783323 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a9a1e-ed15-497b-ad8c-a58470a8a828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:07.788871 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a9a1e-ed15-497b-ad8c-a58470a8a828 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:07.788871 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a9a1e-ed15-497b-ad8c-a58470a8a828 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:07.792743 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a9a1e-ed15-497b-ad8c-a58470a8a828 admin admin] PATH_INFO: `/v3/projects/4218388b76f347109f7e05fb03269617/users/49e680d10e5049fc84158960a5f94449/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:07.838155 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1003/2014] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:07.839005 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a9a1e-ed15-497b-ad8c-a58470a8a828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4218388b76f347109f7e05fb03269617, user_id=49e680d10e5049fc84158960a5f94449, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:07.840518 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a9a1e-ed15-497b-ad8c-a58470a8a828 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:07.852392 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b05318-74ae-43a0-8944-627a8c192ff2 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:07.854094 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c2b05318-74ae-43a0-8944-627a8c192ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:07.937314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b05318-74ae-43a0-8944-627a8c192ff2 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:07.941366 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb451b14-35bd-40a3-87ab-f418a2330743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:07.942104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451b14-35bd-40a3-87ab-f418a2330743 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:07.942468 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451b14-35bd-40a3-87ab-f418a2330743 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:07.943575 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451b14-35bd-40a3-87ab-f418a2330743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:07.953476 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb451b14-35bd-40a3-87ab-f418a2330743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:07.954913 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb451b14-35bd-40a3-87ab-f418a2330743 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:07.965841 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1004/2015] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:57:07.998838 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1012/2016] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:57:07 2022] PUT /identity/v3/projects/4218388b76f347109f7e05fb03269617/users/49e680d10e5049fc84158960a5f94449/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:08.003075 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb451b14-35bd-40a3-87ab-f418a2330743 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:08.013965 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb451b14-35bd-40a3-87ab-f418a2330743 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:08.090013 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86070d-b8c8-41e1-aa4a-199dc5538324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:08.090728 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86070d-b8c8-41e1-aa4a-199dc5538324 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:08.091012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86070d-b8c8-41e1-aa4a-199dc5538324 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:08.091292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86070d-b8c8-41e1-aa4a-199dc5538324 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:08.092041 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86070d-b8c8-41e1-aa4a-199dc5538324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:08.093710 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86070d-b8c8-41e1-aa4a-199dc5538324 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:08.104764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1005/2017] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:08.109801 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a9a1e-ed15-497b-ad8c-a58470a8a828 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:08.128809 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a9a1e-ed15-497b-ad8c-a58470a8a828 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:08.138914 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58ec91-0855-4b31-9840-dc9a623731a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:08.143261 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58ec91-0855-4b31-9840-dc9a623731a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:08.143261 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58ec91-0855-4b31-9840-dc9a623731a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:08.143261 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58ec91-0855-4b31-9840-dc9a623731a4 admin admin] PATH_INFO: `/v3/projects/4218388b76f347109f7e05fb03269617/users/49e680d10e5049fc84158960a5f94449/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:08.144112 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86070d-b8c8-41e1-aa4a-199dc5538324 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:08.144645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58ec91-0855-4b31-9840-dc9a623731a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4218388b76f347109f7e05fb03269617, user_id=49e680d10e5049fc84158960a5f94449, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:08.146479 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-4b86070d-b8c8-41e1-aa4a-199dc5538324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:08.149932 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58ec91-0855-4b31-9840-dc9a623731a4 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:08.165493 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1013/2018] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:57:08 2022] PUT /identity/v3/projects/4218388b76f347109f7e05fb03269617/users/49e680d10e5049fc84158960a5f94449/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:08.177717 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156e5d5-5768-4ce5-bbe1-f5ca31744a89 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:08.178185 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156e5d5-5768-4ce5-bbe1-f5ca31744a89 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:08.178475 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156e5d5-5768-4ce5-bbe1-f5ca31744a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:08.210981 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-0156e5d5-5768-4ce5-bbe1-f5ca31744a89 None None] MFA Rules not processed for user `49e680d10e5049fc84158960a5f94449`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:08.212243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-0156e5d5-5768-4ce5-bbe1-f5ca31744a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:08.235258 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86070d-b8c8-41e1-aa4a-199dc5538324 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:08.309976 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1014/2019] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:57:08.312132 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e414ac-f8b4-4ab9-aab3-e7e8bc66c65e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:08.313103 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e414ac-f8b4-4ab9-aab3-e7e8bc66c65e service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:08.313570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e414ac-f8b4-4ab9-aab3-e7e8bc66c65e service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:08.313982 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e414ac-f8b4-4ab9-aab3-e7e8bc66c65e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:08.316229 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-98e414ac-f8b4-4ab9-aab3-e7e8bc66c65e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:08.320917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156e5d5-5768-4ce5-bbe1-f5ca31744a89 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:08.330665 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156e5d5-5768-4ce5-bbe1-f5ca31744a89 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:08.335161 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843ad5e-2198-435a-9df3-1e1c4fd0d62b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:08.335825 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843ad5e-2198-435a-9df3-1e1c4fd0d62b service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:08.336077 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843ad5e-2198-435a-9df3-1e1c4fd0d62b service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:08.336349 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843ad5e-2198-435a-9df3-1e1c4fd0d62b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:08.338560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-3843ad5e-2198-435a-9df3-1e1c4fd0d62b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:08.405211 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843ad5e-2198-435a-9df3-1e1c4fd0d62b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:08.406158 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e414ac-f8b4-4ab9-aab3-e7e8bc66c65e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:08.407101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843ad5e-2198-435a-9df3-1e1c4fd0d62b service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:08.407286 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e414ac-f8b4-4ab9-aab3-e7e8bc66c65e service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:08.419832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1015/2020] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:57:08.420331 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1006/2021] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:57:08.421140 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843ad5e-2198-435a-9df3-1e1c4fd0d62b service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:08.422862 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-3843ad5e-2198-435a-9df3-1e1c4fd0d62b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:08.522616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843ad5e-2198-435a-9df3-1e1c4fd0d62b service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:08.527486 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed0280-352f-4dd6-99a0-81d82d12a319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:08.528462 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed0280-352f-4dd6-99a0-81d82d12a319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:08.528781 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed0280-352f-4dd6-99a0-81d82d12a319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:08.529060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed0280-352f-4dd6-99a0-81d82d12a319 admin admin] PATH_INFO: `/v3/projects/b6d40125efd84a798e1fd41a8bcd5133` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:08.530612 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed0280-352f-4dd6-99a0-81d82d12a319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6d40125efd84a798e1fd41a8bcd5133)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:08.532624 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed0280-352f-4dd6-99a0-81d82d12a319 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:08.774751 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ffed0280-352f-4dd6-99a0-81d82d12a319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6d40125efd84a798e1fd41a8bcd5133', 'request_id': 'req-ffed0280-352f-4dd6-99a0-81d82d12a319'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:08.977341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ffed0280-352f-4dd6-99a0-81d82d12a319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6d40125efd84a798e1fd41a8bcd5133', 'request_id': 'req-ffed0280-352f-4dd6-99a0-81d82d12a319'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:09.251880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ffed0280-352f-4dd6-99a0-81d82d12a319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6d40125efd84a798e1fd41a8bcd5133', 'request_id': 'req-ffed0280-352f-4dd6-99a0-81d82d12a319'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:09.251880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ffed0280-352f-4dd6-99a0-81d82d12a319 admin admin] The token cache is being invalidate because project b6d40125efd84a798e1fd41a8bcd5133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:57:09.251880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ffed0280-352f-4dd6-99a0-81d82d12a319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:09.251880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ffed0280-352f-4dd6-99a0-81d82d12a319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:09.251880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1016/2022] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:57:08 2022] DELETE /identity/v3/projects/b6d40125efd84a798e1fd41a8bcd5133 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:09.252470 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1405a3-b784-41c1-9a82-62b4ba59dc1a None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:09.252470 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1405a3-b784-41c1-9a82-62b4ba59dc1a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:09.252470 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1405a3-b784-41c1-9a82-62b4ba59dc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:09.274763 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-9f1405a3-b784-41c1-9a82-62b4ba59dc1a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:09.276879 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9f1405a3-b784-41c1-9a82-62b4ba59dc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:09.354712 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1007/2023] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:09.366651 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341dbac-3edc-4c36-992a-7b8b51523fed None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:09.367067 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341dbac-3edc-4c36-992a-7b8b51523fed None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:09.367462 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341dbac-3edc-4c36-992a-7b8b51523fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:09.390014 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-8341dbac-3edc-4c36-992a-7b8b51523fed None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:09.391274 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8341dbac-3edc-4c36-992a-7b8b51523fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:09.400206 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1017/2024] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:57:09.404898 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1405a3-b784-41c1-9a82-62b4ba59dc1a None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:09.418350 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1405a3-b784-41c1-9a82-62b4ba59dc1a None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:09.425691 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84376b38-9aae-4cc3-8fb2-606403563914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:09.426682 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84376b38-9aae-4cc3-8fb2-606403563914 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:09.427152 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84376b38-9aae-4cc3-8fb2-606403563914 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:09.427629 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84376b38-9aae-4cc3-8fb2-606403563914 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:09.428935 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84376b38-9aae-4cc3-8fb2-606403563914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:57:09.429458 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84376b38-9aae-4cc3-8fb2-606403563914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:09.432317 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84376b38-9aae-4cc3-8fb2-606403563914 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:09.446703 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1008/2025] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:57:09.451262 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341dbac-3edc-4c36-992a-7b8b51523fed None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:09.461769 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341dbac-3edc-4c36-992a-7b8b51523fed None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:09.476061 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d87d6-888d-4393-b5e0-0973f23cfc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:09.476755 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d87d6-888d-4393-b5e0-0973f23cfc36 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:09.477039 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d87d6-888d-4393-b5e0-0973f23cfc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:09.477315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d87d6-888d-4393-b5e0-0973f23cfc36 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:09.478027 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d87d6-888d-4393-b5e0-0973f23cfc36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:09.479963 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d87d6-888d-4393-b5e0-0973f23cfc36 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:09.744381 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1018/2026] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:57:09 2022] POST /identity/v3/projects => generated 375 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:57:09.750676 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84376b38-9aae-4cc3-8fb2-606403563914 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:09.768290 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84376b38-9aae-4cc3-8fb2-606403563914 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:09.842000 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572b910-94b7-433c-b14d-02b666a9e7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:09.842784 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572b910-94b7-433c-b14d-02b666a9e7ba admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:09.843087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572b910-94b7-433c-b14d-02b666a9e7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:09.843433 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572b910-94b7-433c-b14d-02b666a9e7ba admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:09.844177 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572b910-94b7-433c-b14d-02b666a9e7ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:09.846367 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572b910-94b7-433c-b14d-02b666a9e7ba admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:09.989269 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1009/2027] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:57:09 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:57:09.991204 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d87d6-888d-4393-b5e0-0973f23cfc36 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:10.002167 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d87d6-888d-4393-b5e0-0973f23cfc36 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:10.027168 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9561af-38e0-486a-8a7b-66810ed90b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:10.027874 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9561af-38e0-486a-8a7b-66810ed90b59 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:10.028157 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9561af-38e0-486a-8a7b-66810ed90b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:10.028424 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9561af-38e0-486a-8a7b-66810ed90b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:10.029760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9561af-38e0-486a-8a7b-66810ed90b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:10.030928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9561af-38e0-486a-8a7b-66810ed90b59 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:10.051030 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1019/2028] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:10.056206 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572b910-94b7-433c-b14d-02b666a9e7ba admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:10.071439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572b910-94b7-433c-b14d-02b666a9e7ba admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:10.084083 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0e700-087c-45d3-9def-298c2b56aaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:10.085662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0e700-087c-45d3-9def-298c2b56aaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:10.086399 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0e700-087c-45d3-9def-298c2b56aaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:10.087325 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0e700-087c-45d3-9def-298c2b56aaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:10.090135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0e700-087c-45d3-9def-298c2b56aaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:10.098003 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0e700-087c-45d3-9def-298c2b56aaa3 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:10.123370 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1010/2029] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:10.127541 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9561af-38e0-486a-8a7b-66810ed90b59 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:10.146845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9561af-38e0-486a-8a7b-66810ed90b59 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:10.154229 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe8470-1b0f-4ca1-b312-111b567767b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:10.155831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe8470-1b0f-4ca1-b312-111b567767b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:10.155997 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe8470-1b0f-4ca1-b312-111b567767b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:10.156397 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe8470-1b0f-4ca1-b312-111b567767b8 admin admin] PATH_INFO: `/v3/projects/33303cdc7d464025b9cf72d046f8ad69/users/efbc2b41331a4c739f1cc95cc6bc1a2b/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:10.186737 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe8470-1b0f-4ca1-b312-111b567767b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33303cdc7d464025b9cf72d046f8ad69, user_id=efbc2b41331a4c739f1cc95cc6bc1a2b, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:10.194626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe8470-1b0f-4ca1-b312-111b567767b8 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:10.343277 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1020/2030] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:57:10 2022] PUT /identity/v3/projects/33303cdc7d464025b9cf72d046f8ad69/users/efbc2b41331a4c739f1cc95cc6bc1a2b/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:10.371439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76547c72-f036-4704-b728-f6632ab8182c None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:10.371439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76547c72-f036-4704-b728-f6632ab8182c None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:10.371439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76547c72-f036-4704-b728-f6632ab8182c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:10.429140 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-76547c72-f036-4704-b728-f6632ab8182c None None] MFA Rules not processed for user `efbc2b41331a4c739f1cc95cc6bc1a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:10.431082 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-76547c72-f036-4704-b728-f6632ab8182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:10.547383 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1011/2031] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:10.563574 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe8470-1b0f-4ca1-b312-111b567767b8 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:10.565464 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-2cfe8470-1b0f-4ca1-b312-111b567767b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:10.647018 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe8470-1b0f-4ca1-b312-111b567767b8 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:10.651732 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbafdc0-9862-4e95-81ef-3eed0601431a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:10.654048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbafdc0-9862-4e95-81ef-3eed0601431a service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:10.654048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbafdc0-9862-4e95-81ef-3eed0601431a service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:10.654048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbafdc0-9862-4e95-81ef-3eed0601431a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:10.667711 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbafdc0-9862-4e95-81ef-3eed0601431a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:10.670460 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbafdc0-9862-4e95-81ef-3eed0601431a service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:10.686376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1021/2032] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:57:11.486421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76547c72-f036-4704-b728-f6632ab8182c None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:11.488713 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-76547c72-f036-4704-b728-f6632ab8182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:11.508108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76547c72-f036-4704-b728-f6632ab8182c None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:11.511784 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c72d8-766d-448d-85a8-d0a71e4cfdfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:11.512442 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c72d8-766d-448d-85a8-d0a71e4cfdfd service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:11.512755 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c72d8-766d-448d-85a8-d0a71e4cfdfd service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:11.513029 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c72d8-766d-448d-85a8-d0a71e4cfdfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:11.514881 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f26c72d8-766d-448d-85a8-d0a71e4cfdfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:11.674280 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c72d8-766d-448d-85a8-d0a71e4cfdfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:11.678649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c72d8-766d-448d-85a8-d0a71e4cfdfd service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:11.700835 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1012/2033] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:57:18.436073 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f565152-f349-4cb2-89e3-e72d83ff143b None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:18.436889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f565152-f349-4cb2-89e3-e72d83ff143b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:18.436889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f565152-f349-4cb2-89e3-e72d83ff143b None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:18.439191 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1022/2034] 10.222.0.52 () {54 vars in 921 bytes} [Thu Apr 14 21:57:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 21:57:18.451601 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b520f4-bb11-4c1f-abfb-c8868262d645 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:18.452463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b520f4-bb11-4c1f-abfb-c8868262d645 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:18.452652 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b520f4-bb11-4c1f-abfb-c8868262d645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:18.473157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-33b520f4-bb11-4c1f-abfb-c8868262d645 None None] MFA Rules not processed for user `e7f3ea629181433eb8c6d5dbc354c141`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:18.474938 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-33b520f4-bb11-4c1f-abfb-c8868262d645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:18.595721 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1013/2035] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Apr 14 21:57:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:57:18.616704 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f565152-f349-4cb2-89e3-e72d83ff143b None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:18.618590 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-1f565152-f349-4cb2-89e3-e72d83ff143b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:18.641880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f565152-f349-4cb2-89e3-e72d83ff143b None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:18.655225 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83320964-58c8-4789-b15a-4fef4d02c48a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:18.656508 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83320964-58c8-4789-b15a-4fef4d02c48a service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:18.657037 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83320964-58c8-4789-b15a-4fef4d02c48a service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:18.657931 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83320964-58c8-4789-b15a-4fef4d02c48a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:18.675098 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83320964-58c8-4789-b15a-4fef4d02c48a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:18.677356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83320964-58c8-4789-b15a-4fef4d02c48a service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:18.691076 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1023/2036] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:57:34.371001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b520f4-bb11-4c1f-abfb-c8868262d645 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:34.373199 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-33b520f4-bb11-4c1f-abfb-c8868262d645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:34.492117 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b520f4-bb11-4c1f-abfb-c8868262d645 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:34.498493 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ecfa8-7cbf-4019-ae98-6c6653c54203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:34.500027 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ecfa8-7cbf-4019-ae98-6c6653c54203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:34.500324 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ecfa8-7cbf-4019-ae98-6c6653c54203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:34.500648 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ecfa8-7cbf-4019-ae98-6c6653c54203 admin admin] PATH_INFO: `/v3/users/0f87181192ef4942b290e140c5417a0d` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:34.502069 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ecfa8-7cbf-4019-ae98-6c6653c54203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f87181192ef4942b290e140c5417a0d)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:34.504777 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ecfa8-7cbf-4019-ae98-6c6653c54203 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:34.734753 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83320964-58c8-4789-b15a-4fef4d02c48a service nova] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:34.740836 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-108ecfa8-7cbf-4019-ae98-6c6653c54203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f87181192ef4942b290e140c5417a0d'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:34.741596 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-108ecfa8-7cbf-4019-ae98-6c6653c54203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f87181192ef4942b290e140c5417a0d'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:34.750926 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83320964-58c8-4789-b15a-4fef4d02c48a service nova] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:34.754987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-108ecfa8-7cbf-4019-ae98-6c6653c54203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f87181192ef4942b290e140c5417a0d'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:34.755706 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8405545-6d1c-448b-9aeb-714e26af04e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:34.756461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8405545-6d1c-448b-9aeb-714e26af04e1 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:34.756989 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8405545-6d1c-448b-9aeb-714e26af04e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:34.757160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8405545-6d1c-448b-9aeb-714e26af04e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:34.758981 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d8405545-6d1c-448b-9aeb-714e26af04e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:34.762987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-108ecfa8-7cbf-4019-ae98-6c6653c54203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f87181192ef4942b290e140c5417a0d'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:34.764101 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-108ecfa8-7cbf-4019-ae98-6c6653c54203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f87181192ef4942b290e140c5417a0d'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:34.834747 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8405545-6d1c-448b-9aeb-714e26af04e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:34.836209 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8405545-6d1c-448b-9aeb-714e26af04e1 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:34.852268 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1024/2037] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:57:34.881691 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1014/2038] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:57:34 2022] DELETE /identity/v3/users/0f87181192ef4942b290e140c5417a0d => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:57:34.887488 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e207e-991c-4e1b-ae18-e7c598306a99 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:34.887959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e207e-991c-4e1b-ae18-e7c598306a99 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:34.888464 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e207e-991c-4e1b-ae18-e7c598306a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:34.911474 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-8c9e207e-991c-4e1b-ae18-e7c598306a99 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:34.913204 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8c9e207e-991c-4e1b-ae18-e7c598306a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:35.001328 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1025/2039] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:57:35.016389 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ecfa8-7cbf-4019-ae98-6c6653c54203 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:35.017898 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-108ecfa8-7cbf-4019-ae98-6c6653c54203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:35.089442 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ecfa8-7cbf-4019-ae98-6c6653c54203 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:35.094259 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d09f3c-a0d1-4929-9b6b-a968456ead73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:35.094951 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d09f3c-a0d1-4929-9b6b-a968456ead73 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:35.095257 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d09f3c-a0d1-4929-9b6b-a968456ead73 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:35.095508 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d09f3c-a0d1-4929-9b6b-a968456ead73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:35.114810 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d09f3c-a0d1-4929-9b6b-a968456ead73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:35.116662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d09f3c-a0d1-4929-9b6b-a968456ead73 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:35.134960 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1015/2040] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:57:35.152291 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e207e-991c-4e1b-ae18-e7c598306a99 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:35.153792 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8c9e207e-991c-4e1b-ae18-e7c598306a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:35.168006 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e207e-991c-4e1b-ae18-e7c598306a99 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:35.173035 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20990f-61d9-402a-93fd-65eb83e6be7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:35.173926 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20990f-61d9-402a-93fd-65eb83e6be7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:35.174195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20990f-61d9-402a-93fd-65eb83e6be7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:35.174460 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20990f-61d9-402a-93fd-65eb83e6be7f admin admin] PATH_INFO: `/v3/users/6beffd101ec04e9488378f1713b5c16c` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:35.175721 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20990f-61d9-402a-93fd-65eb83e6be7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6beffd101ec04e9488378f1713b5c16c)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:35.178692 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20990f-61d9-402a-93fd-65eb83e6be7f admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:35.360686 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fd20990f-61d9-402a-93fd-65eb83e6be7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6beffd101ec04e9488378f1713b5c16c'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:35.361956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fd20990f-61d9-402a-93fd-65eb83e6be7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6beffd101ec04e9488378f1713b5c16c'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:35.382729 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fd20990f-61d9-402a-93fd-65eb83e6be7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6beffd101ec04e9488378f1713b5c16c'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:35.396194 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fd20990f-61d9-402a-93fd-65eb83e6be7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6beffd101ec04e9488378f1713b5c16c'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:35.397132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fd20990f-61d9-402a-93fd-65eb83e6be7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6beffd101ec04e9488378f1713b5c16c'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:35.509078 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1026/2041] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:57:35 2022] DELETE /identity/v3/users/6beffd101ec04e9488378f1713b5c16c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:57:35.514033 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8ca1b-4819-4986-9b87-7c6a1f716fd8 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:35.514810 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8ca1b-4819-4986-9b87-7c6a1f716fd8 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:35.514810 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8ca1b-4819-4986-9b87-7c6a1f716fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:35.540382 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-30b8ca1b-4819-4986-9b87-7c6a1f716fd8 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:35.542074 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-30b8ca1b-4819-4986-9b87-7c6a1f716fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:35.597080 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20990f-61d9-402a-93fd-65eb83e6be7f admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:35.599911 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-fd20990f-61d9-402a-93fd-65eb83e6be7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:35.640259 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1016/2042] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:57:35.655128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8ca1b-4819-4986-9b87-7c6a1f716fd8 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:35.658462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-30b8ca1b-4819-4986-9b87-7c6a1f716fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:35.757446 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8ca1b-4819-4986-9b87-7c6a1f716fd8 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:35.763722 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec2798-7603-43d3-8d40-d0516f5ca2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:35.764826 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec2798-7603-43d3-8d40-d0516f5ca2fe service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:35.765322 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec2798-7603-43d3-8d40-d0516f5ca2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:35.765773 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec2798-7603-43d3-8d40-d0516f5ca2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:35.768943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20990f-61d9-402a-93fd-65eb83e6be7f admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:35.778356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:35.779944 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:35.780452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:35.781415 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c admin admin] PATH_INFO: `/v3/projects/ffb8bed5a024424c9c20104e1b292ce6` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:35.781587 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec2798-7603-43d3-8d40-d0516f5ca2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:35.783308 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec2798-7603-43d3-8d40-d0516f5ca2fe service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:35.784252 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffb8bed5a024424c9c20104e1b292ce6)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:35.788511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:35.796480 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1017/2043] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:57:36.005463 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffb8bed5a024424c9c20104e1b292ce6', 'request_id': 'req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:36.106420 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffb8bed5a024424c9c20104e1b292ce6', 'request_id': 'req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:36.123025 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffb8bed5a024424c9c20104e1b292ce6', 'request_id': 'req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:36.166063 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c admin admin] The token cache is being invalidate because project ffb8bed5a024424c9c20104e1b292ce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:57:36.166707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:36.167625 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:36.170395 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1027/2044] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:57:35 2022] DELETE /identity/v3/projects/ffb8bed5a024424c9c20104e1b292ce6 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:36.176161 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec2798-7603-43d3-8d40-d0516f5ca2fe service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:36.191353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec2798-7603-43d3-8d40-d0516f5ca2fe service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:36.287881 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b75531-d6b9-45a6-a596-5191f6b6df9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:36.289609 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b75531-d6b9-45a6-a596-5191f6b6df9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:36.290099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b75531-d6b9-45a6-a596-5191f6b6df9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:36.290585 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b75531-d6b9-45a6-a596-5191f6b6df9b admin admin] PATH_INFO: `/v3/users/d628b2a288784d35bd004c0f3112aab7` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:36.292820 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b75531-d6b9-45a6-a596-5191f6b6df9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d628b2a288784d35bd004c0f3112aab7)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:36.296135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b75531-d6b9-45a6-a596-5191f6b6df9b admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:36.458948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:36.460548 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:36.476860 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99988096-b8e3-4c92-9fe0-32ef8e9cf24c admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:36.481983 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:36.482853 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:36.483125 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:36.483391 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3 admin admin] PATH_INFO: `/v3/projects/f21b141486fa4e5581b5416a25be3c3b` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:36.484666 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f21b141486fa4e5581b5416a25be3c3b)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:36.486667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:36.528891 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-13b75531-d6b9-45a6-a596-5191f6b6df9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd628b2a288784d35bd004c0f3112aab7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:36.529922 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-13b75531-d6b9-45a6-a596-5191f6b6df9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd628b2a288784d35bd004c0f3112aab7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:36.542884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-13b75531-d6b9-45a6-a596-5191f6b6df9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd628b2a288784d35bd004c0f3112aab7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:36.554802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-13b75531-d6b9-45a6-a596-5191f6b6df9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd628b2a288784d35bd004c0f3112aab7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:36.555769 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-13b75531-d6b9-45a6-a596-5191f6b6df9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd628b2a288784d35bd004c0f3112aab7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:36.605587 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f21b141486fa4e5581b5416a25be3c3b', 'request_id': 'req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:36.627717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1018/2045] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:57:36 2022] DELETE /identity/v3/users/d628b2a288784d35bd004c0f3112aab7 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:57:36.701432 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f21b141486fa4e5581b5416a25be3c3b', 'request_id': 'req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:36.710826 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f21b141486fa4e5581b5416a25be3c3b', 'request_id': 'req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:36.730897 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3 admin admin] The token cache is being invalidate because project f21b141486fa4e5581b5416a25be3c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:57:36.731199 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:36.731987 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:36.738096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1028/2046] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:57:36 2022] DELETE /identity/v3/projects/f21b141486fa4e5581b5416a25be3c3b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:57:36.740618 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b75531-d6b9-45a6-a596-5191f6b6df9b admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:36.742157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-13b75531-d6b9-45a6-a596-5191f6b6df9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:36.812485 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b75531-d6b9-45a6-a596-5191f6b6df9b admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:36.818144 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9346b9-232d-442b-a7f2-f8a7279852f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:36.819054 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9346b9-232d-442b-a7f2-f8a7279852f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:36.821371 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9346b9-232d-442b-a7f2-f8a7279852f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:36.821371 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9346b9-232d-442b-a7f2-f8a7279852f9 admin admin] PATH_INFO: `/v3/users/ce0a8212e00543d8b0a2eb6023568767` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:36.821371 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9346b9-232d-442b-a7f2-f8a7279852f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce0a8212e00543d8b0a2eb6023568767)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:36.822877 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9346b9-232d-442b-a7f2-f8a7279852f9 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:37.065365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-db9346b9-232d-442b-a7f2-f8a7279852f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce0a8212e00543d8b0a2eb6023568767'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:37.066180 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-db9346b9-232d-442b-a7f2-f8a7279852f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce0a8212e00543d8b0a2eb6023568767'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:37.080129 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-db9346b9-232d-442b-a7f2-f8a7279852f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce0a8212e00543d8b0a2eb6023568767'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:37.091174 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-db9346b9-232d-442b-a7f2-f8a7279852f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce0a8212e00543d8b0a2eb6023568767'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:37.092858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-db9346b9-232d-442b-a7f2-f8a7279852f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce0a8212e00543d8b0a2eb6023568767'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:37.162853 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:37.164845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:37.221940 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1019/2047] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:57:36 2022] DELETE /identity/v3/users/ce0a8212e00543d8b0a2eb6023568767 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:37.265540 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeeb26f-39e3-4bfb-9be0-c2923bdedcd3 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:37.361989 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac505785-e72d-4e31-80a5-62750a1c4187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:37.362844 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505785-e72d-4e31-80a5-62750a1c4187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:37.363124 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505785-e72d-4e31-80a5-62750a1c4187 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:37.363395 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505785-e72d-4e31-80a5-62750a1c4187 admin admin] PATH_INFO: `/v3/projects/604580b0aaee43419e1b959d9291ce32` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:37.365868 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac505785-e72d-4e31-80a5-62750a1c4187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=604580b0aaee43419e1b959d9291ce32)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:37.367956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac505785-e72d-4e31-80a5-62750a1c4187 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:37.534685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ac505785-e72d-4e31-80a5-62750a1c4187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '604580b0aaee43419e1b959d9291ce32', 'request_id': 'req-ac505785-e72d-4e31-80a5-62750a1c4187'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:37.608506 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ac505785-e72d-4e31-80a5-62750a1c4187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '604580b0aaee43419e1b959d9291ce32', 'request_id': 'req-ac505785-e72d-4e31-80a5-62750a1c4187'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:37.617807 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ac505785-e72d-4e31-80a5-62750a1c4187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '604580b0aaee43419e1b959d9291ce32', 'request_id': 'req-ac505785-e72d-4e31-80a5-62750a1c4187'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:37.637939 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ac505785-e72d-4e31-80a5-62750a1c4187 admin admin] The token cache is being invalidate because project 604580b0aaee43419e1b959d9291ce32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:57:37.637939 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ac505785-e72d-4e31-80a5-62750a1c4187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:37.639219 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ac505785-e72d-4e31-80a5-62750a1c4187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:37.640976 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1029/2048] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:57:37 2022] DELETE /identity/v3/projects/604580b0aaee43419e1b959d9291ce32 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:37.645804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9346b9-232d-442b-a7f2-f8a7279852f9 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:37.647416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-db9346b9-232d-442b-a7f2-f8a7279852f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:37.663573 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9346b9-232d-442b-a7f2-f8a7279852f9 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:37.743299 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd63457-4d4f-48b1-963e-afaa1b488961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:37.744183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd63457-4d4f-48b1-963e-afaa1b488961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:37.744468 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd63457-4d4f-48b1-963e-afaa1b488961 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:37.744767 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd63457-4d4f-48b1-963e-afaa1b488961 admin admin] PATH_INFO: `/v3/users/78c82909b60a4055b839e412088effca` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:37.746645 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd63457-4d4f-48b1-963e-afaa1b488961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78c82909b60a4055b839e412088effca)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:37.748732 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd63457-4d4f-48b1-963e-afaa1b488961 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:37.763998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac505785-e72d-4e31-80a5-62750a1c4187 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:37.766474 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ac505785-e72d-4e31-80a5-62750a1c4187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:37.794592 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac505785-e72d-4e31-80a5-62750a1c4187 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:37.802184 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba34ee-9703-4053-a12b-b378ea4420e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:37.803158 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba34ee-9703-4053-a12b-b378ea4420e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:37.803441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba34ee-9703-4053-a12b-b378ea4420e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:37.803717 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba34ee-9703-4053-a12b-b378ea4420e9 admin admin] PATH_INFO: `/v3/projects/e56e1fc498f441bdac7b465540d19184` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:37.805051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba34ee-9703-4053-a12b-b378ea4420e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e56e1fc498f441bdac7b465540d19184)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:37.807002 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba34ee-9703-4053-a12b-b378ea4420e9 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:37.982350 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-abd63457-4d4f-48b1-963e-afaa1b488961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78c82909b60a4055b839e412088effca'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:37.983497 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-abd63457-4d4f-48b1-963e-afaa1b488961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78c82909b60a4055b839e412088effca'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:37.986133 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5fba34ee-9703-4053-a12b-b378ea4420e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e56e1fc498f441bdac7b465540d19184', 'request_id': 'req-5fba34ee-9703-4053-a12b-b378ea4420e9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:38.001356 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-abd63457-4d4f-48b1-963e-afaa1b488961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78c82909b60a4055b839e412088effca'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:38.011882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-abd63457-4d4f-48b1-963e-afaa1b488961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78c82909b60a4055b839e412088effca'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:38.012729 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-abd63457-4d4f-48b1-963e-afaa1b488961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78c82909b60a4055b839e412088effca'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:38.068306 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5fba34ee-9703-4053-a12b-b378ea4420e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e56e1fc498f441bdac7b465540d19184', 'request_id': 'req-5fba34ee-9703-4053-a12b-b378ea4420e9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:38.077266 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5fba34ee-9703-4053-a12b-b378ea4420e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e56e1fc498f441bdac7b465540d19184', 'request_id': 'req-5fba34ee-9703-4053-a12b-b378ea4420e9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:38.095171 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5fba34ee-9703-4053-a12b-b378ea4420e9 admin admin] The token cache is being invalidate because project e56e1fc498f441bdac7b465540d19184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:57:38.095588 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5fba34ee-9703-4053-a12b-b378ea4420e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:38.096715 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5fba34ee-9703-4053-a12b-b378ea4420e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:38.098452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1030/2049] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:57:37 2022] DELETE /identity/v3/projects/e56e1fc498f441bdac7b465540d19184 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:38.103050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba34ee-9703-4053-a12b-b378ea4420e9 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:38.104718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-5fba34ee-9703-4053-a12b-b378ea4420e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:38.138000 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1020/2050] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:57:37 2022] DELETE /identity/v3/users/78c82909b60a4055b839e412088effca => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:38.203212 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba34ee-9703-4053-a12b-b378ea4420e9 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:38.285250 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92367a5-b591-4f69-a9c8-7028fe103652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:38.290365 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92367a5-b591-4f69-a9c8-7028fe103652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:38.290365 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92367a5-b591-4f69-a9c8-7028fe103652 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:38.290365 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92367a5-b591-4f69-a9c8-7028fe103652 admin admin] PATH_INFO: `/v3/users/54f5c6eeda024a9cb6c815350aab1772` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:38.290365 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92367a5-b591-4f69-a9c8-7028fe103652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f5c6eeda024a9cb6c815350aab1772)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:38.292064 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92367a5-b591-4f69-a9c8-7028fe103652 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:38.453072 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f92367a5-b591-4f69-a9c8-7028fe103652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f5c6eeda024a9cb6c815350aab1772'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:38.457002 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f92367a5-b591-4f69-a9c8-7028fe103652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f5c6eeda024a9cb6c815350aab1772'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:38.474362 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f92367a5-b591-4f69-a9c8-7028fe103652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f5c6eeda024a9cb6c815350aab1772'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:38.482868 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f92367a5-b591-4f69-a9c8-7028fe103652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f5c6eeda024a9cb6c815350aab1772'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:38.483975 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f92367a5-b591-4f69-a9c8-7028fe103652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f5c6eeda024a9cb6c815350aab1772'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:38.582449 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1031/2051] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:57:38 2022] DELETE /identity/v3/users/54f5c6eeda024a9cb6c815350aab1772 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:57:38.733646 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd63457-4d4f-48b1-963e-afaa1b488961 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:38.735634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-abd63457-4d4f-48b1-963e-afaa1b488961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:38.757882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd63457-4d4f-48b1-963e-afaa1b488961 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:38.857154 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:38.858070 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:38.858556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:38.858831 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6 admin admin] PATH_INFO: `/v3/projects/0869edd46fe445df9da0bf45297c84b2` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:38.860197 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0869edd46fe445df9da0bf45297c84b2)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:38.862205 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:39.030146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0869edd46fe445df9da0bf45297c84b2', 'request_id': 'req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:39.136496 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0869edd46fe445df9da0bf45297c84b2', 'request_id': 'req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:39.151309 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0869edd46fe445df9da0bf45297c84b2', 'request_id': 'req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:39.164275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6 admin admin] The token cache is being invalidate because project 0869edd46fe445df9da0bf45297c84b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:57:39.164571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:39.165333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:39.166945 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1021/2052] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:57:38 2022] DELETE /identity/v3/projects/0869edd46fe445df9da0bf45297c84b2 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:39.174014 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3888fd-a03a-4b9f-85c0-db1e99bc1852 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:39.178929 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3888fd-a03a-4b9f-85c0-db1e99bc1852 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:39.178929 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3888fd-a03a-4b9f-85c0-db1e99bc1852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:39.194415 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-0c3888fd-a03a-4b9f-85c0-db1e99bc1852 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:39.195672 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-0c3888fd-a03a-4b9f-85c0-db1e99bc1852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:39.259597 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:39.262381 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:39.283135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1032/2053] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:39.293877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dd663-b6cb-465c-9a2a-2bb5b05e5b24 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:39.294163 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dd663-b6cb-465c-9a2a-2bb5b05e5b24 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:39.294463 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dd663-b6cb-465c-9a2a-2bb5b05e5b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:39.304004 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1efd5-c730-4713-84b4-dcc845a1e5e6 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:39.309064 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e44144-b4b2-456a-8be3-e0bc2c125152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:39.309986 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e44144-b4b2-456a-8be3-e0bc2c125152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:39.310668 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e44144-b4b2-456a-8be3-e0bc2c125152 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:39.310668 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e44144-b4b2-456a-8be3-e0bc2c125152 admin admin] PATH_INFO: `/v3/projects/79baa07f7a7746d9ba780393dd8ab8ff` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:39.311799 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e44144-b4b2-456a-8be3-e0bc2c125152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79baa07f7a7746d9ba780393dd8ab8ff)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:39.313786 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e44144-b4b2-456a-8be3-e0bc2c125152 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:39.315597 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-8a8dd663-b6cb-465c-9a2a-2bb5b05e5b24 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:39.316928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8a8dd663-b6cb-465c-9a2a-2bb5b05e5b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:39.325642 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1033/2054] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:39.330029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dd663-b6cb-465c-9a2a-2bb5b05e5b24 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:39.346035 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dd663-b6cb-465c-9a2a-2bb5b05e5b24 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:39.362167 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b56f59-a589-4665-a515-2a4979a88f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:39.362167 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b56f59-a589-4665-a515-2a4979a88f46 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:39.362167 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b56f59-a589-4665-a515-2a4979a88f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:39.362167 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b56f59-a589-4665-a515-2a4979a88f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:39.363233 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b56f59-a589-4665-a515-2a4979a88f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:57:39.364337 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b56f59-a589-4665-a515-2a4979a88f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:39.367044 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b56f59-a589-4665-a515-2a4979a88f46 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:39.379062 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1034/2055] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:57:39.384150 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b56f59-a589-4665-a515-2a4979a88f46 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:39.395806 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b56f59-a589-4665-a515-2a4979a88f46 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:39.402956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe596e3e-c154-4006-bcc3-6b00de3bd4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:39.403743 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe596e3e-c154-4006-bcc3-6b00de3bd4df admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:39.404127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe596e3e-c154-4006-bcc3-6b00de3bd4df admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:39.404414 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe596e3e-c154-4006-bcc3-6b00de3bd4df admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:39.405392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe596e3e-c154-4006-bcc3-6b00de3bd4df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:39.408098 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe596e3e-c154-4006-bcc3-6b00de3bd4df admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:39.461288 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e3e44144-b4b2-456a-8be3-e0bc2c125152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79baa07f7a7746d9ba780393dd8ab8ff', 'request_id': 'req-e3e44144-b4b2-456a-8be3-e0bc2c125152'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:39.519307 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1035/2056] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:57:39 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:57:39.520413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe596e3e-c154-4006-bcc3-6b00de3bd4df admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:39.536189 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e3e44144-b4b2-456a-8be3-e0bc2c125152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79baa07f7a7746d9ba780393dd8ab8ff', 'request_id': 'req-e3e44144-b4b2-456a-8be3-e0bc2c125152'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:39.544379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e3e44144-b4b2-456a-8be3-e0bc2c125152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79baa07f7a7746d9ba780393dd8ab8ff', 'request_id': 'req-e3e44144-b4b2-456a-8be3-e0bc2c125152'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:39.556267 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e3e44144-b4b2-456a-8be3-e0bc2c125152 admin admin] The token cache is being invalidate because project 79baa07f7a7746d9ba780393dd8ab8ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:57:39.556987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e3e44144-b4b2-456a-8be3-e0bc2c125152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:39.557725 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e3e44144-b4b2-456a-8be3-e0bc2c125152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:57:39.559822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1022/2057] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:57:39 2022] DELETE /identity/v3/projects/79baa07f7a7746d9ba780393dd8ab8ff => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:57:39.566537 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff7a2c-00e3-4887-99e2-f4300dd14a15 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:39.566980 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff7a2c-00e3-4887-99e2-f4300dd14a15 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:39.567404 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff7a2c-00e3-4887-99e2-f4300dd14a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:39.593970 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-34ff7a2c-00e3-4887-99e2-f4300dd14a15 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:39.595627 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-34ff7a2c-00e3-4887-99e2-f4300dd14a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:39.619012 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe596e3e-c154-4006-bcc3-6b00de3bd4df admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:39.630381 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80731a53-324f-4278-b8bc-5a12b9fabe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:39.630654 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80731a53-324f-4278-b8bc-5a12b9fabe32 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:39.631165 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80731a53-324f-4278-b8bc-5a12b9fabe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:39.631682 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80731a53-324f-4278-b8bc-5a12b9fabe32 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:39.633063 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80731a53-324f-4278-b8bc-5a12b9fabe32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:39.636612 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80731a53-324f-4278-b8bc-5a12b9fabe32 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:39.696660 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1023/2058] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:57:39.704521 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdba0db-13d0-4a45-994e-52a97ff852fe None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:39.704820 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdba0db-13d0-4a45-994e-52a97ff852fe None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:39.705174 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdba0db-13d0-4a45-994e-52a97ff852fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:39.728642 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1036/2059] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:57:39 2022] POST /identity/v3/users => generated 284 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:57:39.734435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80731a53-324f-4278-b8bc-5a12b9fabe32 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:39.735213 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-bcdba0db-13d0-4a45-994e-52a97ff852fe None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:39.736663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-80731a53-324f-4278-b8bc-5a12b9fabe32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:39.736834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-bcdba0db-13d0-4a45-994e-52a97ff852fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:39.749493 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1024/2060] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:39.752481 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80731a53-324f-4278-b8bc-5a12b9fabe32 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:39.756299 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdba0db-13d0-4a45-994e-52a97ff852fe None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:39.759000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaafe3b-6307-4807-b5ad-594f8c3b0134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:39.759772 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaafe3b-6307-4807-b5ad-594f8c3b0134 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:39.760160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaafe3b-6307-4807-b5ad-594f8c3b0134 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:39.760558 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaafe3b-6307-4807-b5ad-594f8c3b0134 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:39.761409 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaafe3b-6307-4807-b5ad-594f8c3b0134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:39.763438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaafe3b-6307-4807-b5ad-594f8c3b0134 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:39.772611 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdba0db-13d0-4a45-994e-52a97ff852fe None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:39.781073 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608318f8-70ae-4ee5-aea4-72c155ab2f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:39.781886 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608318f8-70ae-4ee5-aea4-72c155ab2f04 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:39.782324 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608318f8-70ae-4ee5-aea4-72c155ab2f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:39.782754 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608318f8-70ae-4ee5-aea4-72c155ab2f04 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:39.783953 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608318f8-70ae-4ee5-aea4-72c155ab2f04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:57:39.784455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608318f8-70ae-4ee5-aea4-72c155ab2f04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:39.784657 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1037/2061] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:57:39.788567 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608318f8-70ae-4ee5-aea4-72c155ab2f04 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:39.791293 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaafe3b-6307-4807-b5ad-594f8c3b0134 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:39.806831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaafe3b-6307-4807-b5ad-594f8c3b0134 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:39.810039 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1025/2062] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:57:39.812873 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891b120-6dca-4428-9106-c616f81ac3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:39.813598 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891b120-6dca-4428-9106-c616f81ac3bc admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:39.813911 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891b120-6dca-4428-9106-c616f81ac3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:39.821385 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891b120-6dca-4428-9106-c616f81ac3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:39.821385 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891b120-6dca-4428-9106-c616f81ac3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:39.821385 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891b120-6dca-4428-9106-c616f81ac3bc admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:39.827164 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608318f8-70ae-4ee5-aea4-72c155ab2f04 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:39.830190 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1038/2063] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:57:39.835244 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891b120-6dca-4428-9106-c616f81ac3bc admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:39.849138 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608318f8-70ae-4ee5-aea4-72c155ab2f04 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:39.850279 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891b120-6dca-4428-9106-c616f81ac3bc admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:39.856791 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1868a-a628-46bd-9b02-4d2302e759c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:39.858031 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1868a-a628-46bd-9b02-4d2302e759c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:39.858434 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6fb05-d172-416f-8575-b73ed74e8a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:39.858621 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1868a-a628-46bd-9b02-4d2302e759c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:39.858905 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1868a-a628-46bd-9b02-4d2302e759c7 admin admin] PATH_INFO: `/v3/projects/a243d57bed454316be947920f1fccc5f/users/67bb07ac0401424aa358881fc7020b06/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:39.859512 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6fb05-d172-416f-8575-b73ed74e8a63 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:39.859952 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6fb05-d172-416f-8575-b73ed74e8a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:39.860396 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6fb05-d172-416f-8575-b73ed74e8a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:39.861182 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6fb05-d172-416f-8575-b73ed74e8a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:39.863740 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6fb05-d172-416f-8575-b73ed74e8a63 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:39.875403 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1868a-a628-46bd-9b02-4d2302e759c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a243d57bed454316be947920f1fccc5f, user_id=67bb07ac0401424aa358881fc7020b06, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:39.878348 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1868a-a628-46bd-9b02-4d2302e759c7 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:39.958744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1039/2064] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:57:39 2022] PUT /identity/v3/projects/a243d57bed454316be947920f1fccc5f/users/67bb07ac0401424aa358881fc7020b06/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:39.976472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35b3f6-f0bc-49bb-b557-3602052b3aed None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:39.977166 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35b3f6-f0bc-49bb-b557-3602052b3aed None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:39.977927 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35b3f6-f0bc-49bb-b557-3602052b3aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:39.993161 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1026/2065] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:57:39 2022] POST /identity/v3/projects => generated 407 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:57:40.007441 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6fb05-d172-416f-8575-b73ed74e8a63 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:40.024867 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-4a35b3f6-f0bc-49bb-b557-3602052b3aed None None] MFA Rules not processed for user `67bb07ac0401424aa358881fc7020b06`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:40.026819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-4a35b3f6-f0bc-49bb-b557-3602052b3aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:40.130330 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6fb05-d172-416f-8575-b73ed74e8a63 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:40.140793 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9ab02-7042-4b36-9382-ff78700400c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:40.142892 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9ab02-7042-4b36-9382-ff78700400c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:40.144063 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9ab02-7042-4b36-9382-ff78700400c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:40.144367 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1040/2066] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:57:40.145793 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9ab02-7042-4b36-9382-ff78700400c2 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:40.147704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9ab02-7042-4b36-9382-ff78700400c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:40.149252 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35b3f6-f0bc-49bb-b557-3602052b3aed None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:40.153338 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9ab02-7042-4b36-9382-ff78700400c2 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:40.165499 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35b3f6-f0bc-49bb-b557-3602052b3aed None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:40.180410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496bea8-c567-41c1-b24e-ebcc9e0a78a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:40.181352 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496bea8-c567-41c1-b24e-ebcc9e0a78a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:40.181500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496bea8-c567-41c1-b24e-ebcc9e0a78a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:40.181702 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496bea8-c567-41c1-b24e-ebcc9e0a78a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:40.182619 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496bea8-c567-41c1-b24e-ebcc9e0a78a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:40.184748 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496bea8-c567-41c1-b24e-ebcc9e0a78a7 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:40.397422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1027/2067] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:57:40 2022] POST /identity/v3/users => generated 304 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:57:40.400180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1041/2068] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:57:40 2022] POST /identity/v3/projects => generated 365 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:57:40.403860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9ab02-7042-4b36-9382-ff78700400c2 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:40.404402 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496bea8-c567-41c1-b24e-ebcc9e0a78a7 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:40.420533 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9ab02-7042-4b36-9382-ff78700400c2 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:40.514225 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496bea8-c567-41c1-b24e-ebcc9e0a78a7 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:40.515324 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c6ddf-e5d7-4886-9075-5ce6dfd220c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:40.516079 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c6ddf-e5d7-4886-9075-5ce6dfd220c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:40.516365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c6ddf-e5d7-4886-9075-5ce6dfd220c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:40.516814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c6ddf-e5d7-4886-9075-5ce6dfd220c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:40.517634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c6ddf-e5d7-4886-9075-5ce6dfd220c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:40.519431 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c6ddf-e5d7-4886-9075-5ce6dfd220c3 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:40.525060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409f8d9-f76e-4652-8c0f-2e8fa2060426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:40.526119 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409f8d9-f76e-4652-8c0f-2e8fa2060426 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:40.526922 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409f8d9-f76e-4652-8c0f-2e8fa2060426 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:40.526922 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409f8d9-f76e-4652-8c0f-2e8fa2060426 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:40.527998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409f8d9-f76e-4652-8c0f-2e8fa2060426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:40.529676 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409f8d9-f76e-4652-8c0f-2e8fa2060426 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:40.537860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1028/2069] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:40.550650 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c6ddf-e5d7-4886-9075-5ce6dfd220c3 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:40.565011 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c6ddf-e5d7-4886-9075-5ce6dfd220c3 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:40.575093 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f794f6d-eb72-42ca-bde8-42e95bf1f306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:40.576253 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f794f6d-eb72-42ca-bde8-42e95bf1f306 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:40.576789 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f794f6d-eb72-42ca-bde8-42e95bf1f306 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:40.577288 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f794f6d-eb72-42ca-bde8-42e95bf1f306 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:40.578494 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f794f6d-eb72-42ca-bde8-42e95bf1f306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:40.581628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f794f6d-eb72-42ca-bde8-42e95bf1f306 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:40.601383 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1029/2070] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:40.607917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f794f6d-eb72-42ca-bde8-42e95bf1f306 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:40.630431 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f794f6d-eb72-42ca-bde8-42e95bf1f306 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:40.644464 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81998943-f6ef-4c64-9507-e2bd6431a703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:40.644464 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81998943-f6ef-4c64-9507-e2bd6431a703 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:40.644464 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81998943-f6ef-4c64-9507-e2bd6431a703 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:40.644464 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81998943-f6ef-4c64-9507-e2bd6431a703 admin admin] PATH_INFO: `/v3/projects/2601bb73304b4ce38bc02cc306365081/users/19fe1655860f4286a56b0bac7c5da932/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:40.648646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1042/2071] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:57:40 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:57:40.653059 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409f8d9-f76e-4652-8c0f-2e8fa2060426 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:40.664313 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81998943-f6ef-4c64-9507-e2bd6431a703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2601bb73304b4ce38bc02cc306365081, user_id=19fe1655860f4286a56b0bac7c5da932, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:40.667923 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409f8d9-f76e-4652-8c0f-2e8fa2060426 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:40.670238 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81998943-f6ef-4c64-9507-e2bd6431a703 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:40.672965 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017da234-fea0-4df4-ba82-ff9e71ced09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:40.673730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017da234-fea0-4df4-ba82-ff9e71ced09d admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:40.674086 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017da234-fea0-4df4-ba82-ff9e71ced09d admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:40.674541 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017da234-fea0-4df4-ba82-ff9e71ced09d admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:40.675268 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017da234-fea0-4df4-ba82-ff9e71ced09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:40.677030 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017da234-fea0-4df4-ba82-ff9e71ced09d admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:40.688511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1043/2072] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:40.693018 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017da234-fea0-4df4-ba82-ff9e71ced09d admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:40.705033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017da234-fea0-4df4-ba82-ff9e71ced09d admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:40.712861 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a34014-89b3-4019-8b98-b3219f24ee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:40.714694 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a34014-89b3-4019-8b98-b3219f24ee70 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:40.714694 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a34014-89b3-4019-8b98-b3219f24ee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:40.714694 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a34014-89b3-4019-8b98-b3219f24ee70 admin admin] PATH_INFO: `/v3/projects/2384ca44300d430fa17efac7187013f6/users/74d87d19d38841fdb55594fa00abab8b/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:40.734550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a34014-89b3-4019-8b98-b3219f24ee70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2384ca44300d430fa17efac7187013f6, user_id=74d87d19d38841fdb55594fa00abab8b, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:40.737341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a34014-89b3-4019-8b98-b3219f24ee70 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:40.762768 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1030/2073] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:57:40 2022] PUT /identity/v3/projects/2601bb73304b4ce38bc02cc306365081/users/19fe1655860f4286a56b0bac7c5da932/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:57:40.780457 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d1511-b8dc-4ff8-b7a2-14946670441d None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:40.782614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d1511-b8dc-4ff8-b7a2-14946670441d None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:40.782614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d1511-b8dc-4ff8-b7a2-14946670441d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:40.815055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-9d0d1511-b8dc-4ff8-b7a2-14946670441d None None] MFA Rules not processed for user `19fe1655860f4286a56b0bac7c5da932`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:40.822803 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9d0d1511-b8dc-4ff8-b7a2-14946670441d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:40.846014 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1044/2074] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:57:40 2022] PUT /identity/v3/projects/2384ca44300d430fa17efac7187013f6/users/74d87d19d38841fdb55594fa00abab8b/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:57:40.850629 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a34014-89b3-4019-8b98-b3219f24ee70 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:40.932742 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1031/2075] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:57:40.939804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d1511-b8dc-4ff8-b7a2-14946670441d None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:40.956997 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a34014-89b3-4019-8b98-b3219f24ee70 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:40.965308 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32091be5-aca1-4388-b60c-92faaa660a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:40.966002 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32091be5-aca1-4388-b60c-92faaa660a5b admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:40.966282 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32091be5-aca1-4388-b60c-92faaa660a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:40.968307 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32091be5-aca1-4388-b60c-92faaa660a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:40.969006 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32091be5-aca1-4388-b60c-92faaa660a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:40.980621 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32091be5-aca1-4388-b60c-92faaa660a5b admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:40.987998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1045/2076] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:57:40.992113 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32091be5-aca1-4388-b60c-92faaa660a5b admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:41.016050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32091be5-aca1-4388-b60c-92faaa660a5b admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:41.025845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ffa40-0ee0-4b12-b54e-5ce9e51f54b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:41.029622 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ffa40-0ee0-4b12-b54e-5ce9e51f54b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:41.030145 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ffa40-0ee0-4b12-b54e-5ce9e51f54b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:41.031033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ffa40-0ee0-4b12-b54e-5ce9e51f54b3 admin admin] PATH_INFO: `/v3/projects/2384ca44300d430fa17efac7187013f6/users/74d87d19d38841fdb55594fa00abab8b/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:41.034239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ffa40-0ee0-4b12-b54e-5ce9e51f54b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2384ca44300d430fa17efac7187013f6, user_id=74d87d19d38841fdb55594fa00abab8b, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:41.040495 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ffa40-0ee0-4b12-b54e-5ce9e51f54b3 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:41.071793 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d1511-b8dc-4ff8-b7a2-14946670441d None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:41.072135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1046/2077] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:57:40 2022] PUT /identity/v3/projects/2384ca44300d430fa17efac7187013f6/users/74d87d19d38841fdb55594fa00abab8b/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:57:41.091718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9caf9-e0b7-48d7-aed1-bfce8e53dbe0 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:41.092004 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9caf9-e0b7-48d7-aed1-bfce8e53dbe0 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:41.092359 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9caf9-e0b7-48d7-aed1-bfce8e53dbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:41.129635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-15e9caf9-e0b7-48d7-aed1-bfce8e53dbe0 None None] MFA Rules not processed for user `74d87d19d38841fdb55594fa00abab8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:41.130711 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-15e9caf9-e0b7-48d7-aed1-bfce8e53dbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:41.166429 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd2b59-d3ae-4189-9117-6200d93d64d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:41.167436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd2b59-d3ae-4189-9117-6200d93d64d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:41.167918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd2b59-d3ae-4189-9117-6200d93d64d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:41.168392 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd2b59-d3ae-4189-9117-6200d93d64d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:41.169581 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd2b59-d3ae-4189-9117-6200d93d64d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:41.172349 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd2b59-d3ae-4189-9117-6200d93d64d4 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:41.218013 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1047/2078] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:41.231519 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9caf9-e0b7-48d7-aed1-bfce8e53dbe0 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:41.233333 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-15e9caf9-e0b7-48d7-aed1-bfce8e53dbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:41.317873 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9caf9-e0b7-48d7-aed1-bfce8e53dbe0 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:41.324429 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533983b7-42a2-407b-8f5f-9817e4073971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:41.325814 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533983b7-42a2-407b-8f5f-9817e4073971 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:41.326296 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533983b7-42a2-407b-8f5f-9817e4073971 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:41.326780 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533983b7-42a2-407b-8f5f-9817e4073971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:41.340932 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533983b7-42a2-407b-8f5f-9817e4073971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:41.342404 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533983b7-42a2-407b-8f5f-9817e4073971 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:41.349376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1032/2079] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:57:40 2022] POST /identity/v3/projects => generated 407 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:57:41.356481 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1048/2080] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:57:41.357897 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd2b59-d3ae-4189-9117-6200d93d64d4 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:41.455325 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd2b59-d3ae-4189-9117-6200d93d64d4 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:41.475478 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41f999-da31-4734-8d04-4800eb83f1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:41.475478 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41f999-da31-4734-8d04-4800eb83f1be admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:41.475478 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41f999-da31-4734-8d04-4800eb83f1be admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:41.475478 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41f999-da31-4734-8d04-4800eb83f1be admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:41.476026 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41f999-da31-4734-8d04-4800eb83f1be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:41.476026 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41f999-da31-4734-8d04-4800eb83f1be admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:41.585798 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1033/2081] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:57:41 2022] POST /identity/v3/users => generated 310 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:57:41.589074 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533983b7-42a2-407b-8f5f-9817e4073971 service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:41.600010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533983b7-42a2-407b-8f5f-9817e4073971 service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:41.605265 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc312bc5-b8f6-485f-bcd0-651f6562a99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:41.606672 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc312bc5-b8f6-485f-bcd0-651f6562a99e admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:41.609210 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc312bc5-b8f6-485f-bcd0-651f6562a99e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:41.609530 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc312bc5-b8f6-485f-bcd0-651f6562a99e admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:41.610549 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc312bc5-b8f6-485f-bcd0-651f6562a99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:41.612230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc312bc5-b8f6-485f-bcd0-651f6562a99e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:41.627580 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1049/2082] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:57:41.633348 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41f999-da31-4734-8d04-4800eb83f1be admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:41.644270 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41f999-da31-4734-8d04-4800eb83f1be admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:41.650503 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1606b-78d0-4d7a-a6b4-829cf893c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:41.651743 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1606b-78d0-4d7a-a6b4-829cf893c89d admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:41.652250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1606b-78d0-4d7a-a6b4-829cf893c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:41.652675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1606b-78d0-4d7a-a6b4-829cf893c89d admin admin] PATH_INFO: `/v3/projects/cfe16c554f9949a7bccb62d45f3c1aff/users/a6a8609ecdc349008fbd7062990171b0/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:41.677605 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1606b-78d0-4d7a-a6b4-829cf893c89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe16c554f9949a7bccb62d45f3c1aff, user_id=a6a8609ecdc349008fbd7062990171b0, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:41.682657 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1606b-78d0-4d7a-a6b4-829cf893c89d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:41.762495 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc312bc5-b8f6-485f-bcd0-651f6562a99e admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:41.811241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1034/2083] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:57:41 2022] PUT /identity/v3/projects/cfe16c554f9949a7bccb62d45f3c1aff/users/a6a8609ecdc349008fbd7062990171b0/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:57:41.816816 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1606b-78d0-4d7a-a6b4-829cf893c89d admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:41.867776 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc312bc5-b8f6-485f-bcd0-651f6562a99e admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:41.920735 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1606b-78d0-4d7a-a6b4-829cf893c89d admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:41.930298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4813dd2-b9a9-4d8a-88dc-cdb8c4d1b7eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:41.930298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4813dd2-b9a9-4d8a-88dc-cdb8c4d1b7eb service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:41.930298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4813dd2-b9a9-4d8a-88dc-cdb8c4d1b7eb service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:41.930298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4813dd2-b9a9-4d8a-88dc-cdb8c4d1b7eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:41.930930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceac55d-c02f-44b1-a78b-4d8385b402f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:41.930930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceac55d-c02f-44b1-a78b-4d8385b402f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:41.930930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceac55d-c02f-44b1-a78b-4d8385b402f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:41.930930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceac55d-c02f-44b1-a78b-4d8385b402f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:41.931372 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceac55d-c02f-44b1-a78b-4d8385b402f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:41.934233 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceac55d-c02f-44b1-a78b-4d8385b402f9 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:41.952634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1035/2084] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:57:41.959192 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceac55d-c02f-44b1-a78b-4d8385b402f9 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:41.976128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceac55d-c02f-44b1-a78b-4d8385b402f9 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:41.987459 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375aa096-27d6-4590-b73d-1dffd066658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:41.987997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aa096-27d6-4590-b73d-1dffd066658a admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:41.988341 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aa096-27d6-4590-b73d-1dffd066658a admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:41.991902 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aa096-27d6-4590-b73d-1dffd066658a admin admin] PATH_INFO: `/v3/projects/cfe16c554f9949a7bccb62d45f3c1aff/users/a6a8609ecdc349008fbd7062990171b0/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:41.991902 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375aa096-27d6-4590-b73d-1dffd066658a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe16c554f9949a7bccb62d45f3c1aff, user_id=a6a8609ecdc349008fbd7062990171b0, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:41.995021 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375aa096-27d6-4590-b73d-1dffd066658a admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:42.007886 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1036/2085] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:57:41 2022] PUT /identity/v3/projects/cfe16c554f9949a7bccb62d45f3c1aff/users/a6a8609ecdc349008fbd7062990171b0/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:57:42.030589 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71226522-9542-421d-a667-38e0c4dba5de None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:42.030848 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71226522-9542-421d-a667-38e0c4dba5de None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:42.031333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71226522-9542-421d-a667-38e0c4dba5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:42.053802 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4813dd2-b9a9-4d8a-88dc-cdb8c4d1b7eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:42.058162 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4813dd2-b9a9-4d8a-88dc-cdb8c4d1b7eb service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:42.078060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1050/2086] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:57:42.081578 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-71226522-9542-421d-a667-38e0c4dba5de None None] MFA Rules not processed for user `a6a8609ecdc349008fbd7062990171b0`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:57:42.083806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-71226522-9542-421d-a667-38e0c4dba5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:42.236236 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1037/2087] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:57:42 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:57:42.372013 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4813dd2-b9a9-4d8a-88dc-cdb8c4d1b7eb service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:42.373721 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e4813dd2-b9a9-4d8a-88dc-cdb8c4d1b7eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:57:42.387037 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4813dd2-b9a9-4d8a-88dc-cdb8c4d1b7eb service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:42.452384 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd51b1-31bf-4fb6-85a6-de7fd693f4b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:42.453254 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd51b1-31bf-4fb6-85a6-de7fd693f4b2 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:42.453671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd51b1-31bf-4fb6-85a6-de7fd693f4b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:42.454056 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd51b1-31bf-4fb6-85a6-de7fd693f4b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:42.466999 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd51b1-31bf-4fb6-85a6-de7fd693f4b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:42.468448 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd51b1-31bf-4fb6-85a6-de7fd693f4b2 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:42.483618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1051/2088] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:42 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:57:43.534790 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71226522-9542-421d-a667-38e0c4dba5de None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:57:43.550636 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71226522-9542-421d-a667-38e0c4dba5de None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:57:43.555562 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43842d7b-ff4d-4d0b-832e-fd6e2fb3e8f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:57:43.556420 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43842d7b-ff4d-4d0b-832e-fd6e2fb3e8f6 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:57:43.556732 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43842d7b-ff4d-4d0b-832e-fd6e2fb3e8f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:57:43.557010 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43842d7b-ff4d-4d0b-832e-fd6e2fb3e8f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:57:43.636250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43842d7b-ff4d-4d0b-832e-fd6e2fb3e8f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:57:43.637704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43842d7b-ff4d-4d0b-832e-fd6e2fb3e8f6 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:57:43.648106 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1038/2089] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:57:43 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:04.197165 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd51b1-31bf-4fb6-85a6-de7fd693f4b2 service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:04.199778 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d6fd51b1-31bf-4fb6-85a6-de7fd693f4b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:04.268990 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43842d7b-ff4d-4d0b-832e-fd6e2fb3e8f6 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:04.439272 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd51b1-31bf-4fb6-85a6-de7fd693f4b2 service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:04.446400 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c40f0-8f93-402d-b427-cac135a0f493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:04.447818 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c40f0-8f93-402d-b427-cac135a0f493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:04.447919 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c40f0-8f93-402d-b427-cac135a0f493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:04.448154 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c40f0-8f93-402d-b427-cac135a0f493 admin admin] PATH_INFO: `/v3/users/246a1e16afa24ab2a53f66b207c7aecd` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:04.449652 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c40f0-8f93-402d-b427-cac135a0f493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=246a1e16afa24ab2a53f66b207c7aecd)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:04.451744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c40f0-8f93-402d-b427-cac135a0f493 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:04.465746 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43842d7b-ff4d-4d0b-832e-fd6e2fb3e8f6 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:04.475938 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355486ff-7597-4bef-9877-a631e5c21a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:04.477703 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355486ff-7597-4bef-9877-a631e5c21a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:04.478207 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355486ff-7597-4bef-9877-a631e5c21a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:04.478725 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355486ff-7597-4bef-9877-a631e5c21a60 admin admin] PATH_INFO: `/v3/users/67bb07ac0401424aa358881fc7020b06` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:04.482181 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355486ff-7597-4bef-9877-a631e5c21a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67bb07ac0401424aa358881fc7020b06)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:04.485171 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355486ff-7597-4bef-9877-a631e5c21a60 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:04.680870 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ae9c40f0-8f93-402d-b427-cac135a0f493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246a1e16afa24ab2a53f66b207c7aecd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:04.681611 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ae9c40f0-8f93-402d-b427-cac135a0f493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246a1e16afa24ab2a53f66b207c7aecd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:04.695700 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ae9c40f0-8f93-402d-b427-cac135a0f493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246a1e16afa24ab2a53f66b207c7aecd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:04.708756 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ae9c40f0-8f93-402d-b427-cac135a0f493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246a1e16afa24ab2a53f66b207c7aecd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:04.709928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ae9c40f0-8f93-402d-b427-cac135a0f493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246a1e16afa24ab2a53f66b207c7aecd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:04.741862 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-355486ff-7597-4bef-9877-a631e5c21a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67bb07ac0401424aa358881fc7020b06'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:04.742735 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-355486ff-7597-4bef-9877-a631e5c21a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67bb07ac0401424aa358881fc7020b06'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:04.759397 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-355486ff-7597-4bef-9877-a631e5c21a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67bb07ac0401424aa358881fc7020b06'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:04.767645 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-355486ff-7597-4bef-9877-a631e5c21a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67bb07ac0401424aa358881fc7020b06'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:04.768433 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-355486ff-7597-4bef-9877-a631e5c21a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67bb07ac0401424aa358881fc7020b06'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:04.841168 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1052/2090] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:04 2022] DELETE /identity/v3/users/246a1e16afa24ab2a53f66b207c7aecd => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:04.841168 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c40f0-8f93-402d-b427-cac135a0f493 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:04.841889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ae9c40f0-8f93-402d-b427-cac135a0f493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:04.918590 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c40f0-8f93-402d-b427-cac135a0f493 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:04.923419 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9ba60-faf9-4ad0-94da-725b9f1a6456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:04.924306 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9ba60-faf9-4ad0-94da-725b9f1a6456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:04.924604 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9ba60-faf9-4ad0-94da-725b9f1a6456 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:04.924957 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9ba60-faf9-4ad0-94da-725b9f1a6456 admin admin] PATH_INFO: `/v3/users/bc2d1d7be96e486fb49aaecd71aebb6d` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:04.927021 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9ba60-faf9-4ad0-94da-725b9f1a6456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc2d1d7be96e486fb49aaecd71aebb6d)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:04.929322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9ba60-faf9-4ad0-94da-725b9f1a6456 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:04.965416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1039/2091] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:04 2022] DELETE /identity/v3/users/67bb07ac0401424aa358881fc7020b06 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:04.966778 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debac4a7-e69a-4179-88bb-791464e1b370 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:04.967146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debac4a7-e69a-4179-88bb-791464e1b370 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:04.967423 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debac4a7-e69a-4179-88bb-791464e1b370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:04.997074 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-debac4a7-e69a-4179-88bb-791464e1b370 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:04.998351 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-debac4a7-e69a-4179-88bb-791464e1b370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:05.060957 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1040/2092] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:05.062618 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e5ed8-c231-43ec-86cf-db54dbdcf2e5 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:05.062903 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e5ed8-c231-43ec-86cf-db54dbdcf2e5 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:05.063176 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e5ed8-c231-43ec-86cf-db54dbdcf2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:05.081335 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-9b4e5ed8-c231-43ec-86cf-db54dbdcf2e5 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:05.082902 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9b4e5ed8-c231-43ec-86cf-db54dbdcf2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:05.091781 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1041/2093] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:05.092474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e5ed8-c231-43ec-86cf-db54dbdcf2e5 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:05.093836 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9b4e5ed8-c231-43ec-86cf-db54dbdcf2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:05.232002 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-8ed9ba60-faf9-4ad0-94da-725b9f1a6456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc2d1d7be96e486fb49aaecd71aebb6d'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:05.232727 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-8ed9ba60-faf9-4ad0-94da-725b9f1a6456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc2d1d7be96e486fb49aaecd71aebb6d'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:05.245058 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e5ed8-c231-43ec-86cf-db54dbdcf2e5 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:05.249382 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3dd49-f8bc-4406-ab88-acc06f3d3a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:05.250176 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3dd49-f8bc-4406-ab88-acc06f3d3a6a service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:05.250461 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3dd49-f8bc-4406-ab88-acc06f3d3a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:05.250729 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3dd49-f8bc-4406-ab88-acc06f3d3a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:05.252777 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-60b3dd49-f8bc-4406-ab88-acc06f3d3a6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:05.255643 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-8ed9ba60-faf9-4ad0-94da-725b9f1a6456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc2d1d7be96e486fb49aaecd71aebb6d'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:05.266574 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3dd49-f8bc-4406-ab88-acc06f3d3a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:05.268043 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3dd49-f8bc-4406-ab88-acc06f3d3a6a service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:05.268887 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-8ed9ba60-faf9-4ad0-94da-725b9f1a6456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc2d1d7be96e486fb49aaecd71aebb6d'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:05.270813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-8ed9ba60-faf9-4ad0-94da-725b9f1a6456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc2d1d7be96e486fb49aaecd71aebb6d'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:05.280266 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1042/2094] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:05.281997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3dd49-f8bc-4406-ab88-acc06f3d3a6a service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:05.283488 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-60b3dd49-f8bc-4406-ab88-acc06f3d3a6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:05.296228 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3dd49-f8bc-4406-ab88-acc06f3d3a6a service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:05.302066 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b1721-d4e7-47d0-ad72-5ddbdeb8ac8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:05.303089 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b1721-d4e7-47d0-ad72-5ddbdeb8ac8f service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:05.308988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b1721-d4e7-47d0-ad72-5ddbdeb8ac8f service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:05.308988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b1721-d4e7-47d0-ad72-5ddbdeb8ac8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:05.308988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-007b1721-d4e7-47d0-ad72-5ddbdeb8ac8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:05.323497 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b1721-d4e7-47d0-ad72-5ddbdeb8ac8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:05.325135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b1721-d4e7-47d0-ad72-5ddbdeb8ac8f service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:05.339563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1043/2095] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:05.371831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1053/2096] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:04 2022] DELETE /identity/v3/users/bc2d1d7be96e486fb49aaecd71aebb6d => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:05.780354 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b1721-d4e7-47d0-ad72-5ddbdeb8ac8f service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:05.783886 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-007b1721-d4e7-47d0-ad72-5ddbdeb8ac8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:05.806569 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b1721-d4e7-47d0-ad72-5ddbdeb8ac8f service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:05.969577 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e651a64-1b9a-4be1-b834-283146a98718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:05.971705 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e651a64-1b9a-4be1-b834-283146a98718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:05.974649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e651a64-1b9a-4be1-b834-283146a98718 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:05.975247 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e651a64-1b9a-4be1-b834-283146a98718 admin admin] PATH_INFO: `/v3/projects/34a0c2418f5346fbbb18e392ff11722a` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:05.980076 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e651a64-1b9a-4be1-b834-283146a98718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a0c2418f5346fbbb18e392ff11722a)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:05.984675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e651a64-1b9a-4be1-b834-283146a98718 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:06.179920 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9ba60-faf9-4ad0-94da-725b9f1a6456 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:06.184793 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8ed9ba60-faf9-4ad0-94da-725b9f1a6456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:06.208244 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9ba60-faf9-4ad0-94da-725b9f1a6456 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:06.236087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-5e651a64-1b9a-4be1-b834-283146a98718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a0c2418f5346fbbb18e392ff11722a', 'request_id': 'req-5e651a64-1b9a-4be1-b834-283146a98718'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:06.302013 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71949158-4b32-42d0-9654-2bf3ce1acb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:06.302894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71949158-4b32-42d0-9654-2bf3ce1acb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:06.303177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71949158-4b32-42d0-9654-2bf3ce1acb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:06.303450 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71949158-4b32-42d0-9654-2bf3ce1acb75 admin admin] PATH_INFO: `/v3/projects/19541936c13a4fd58689e30f0767ae2e` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:06.305786 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71949158-4b32-42d0-9654-2bf3ce1acb75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19541936c13a4fd58689e30f0767ae2e)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:06.307791 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71949158-4b32-42d0-9654-2bf3ce1acb75 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:06.349921 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-5e651a64-1b9a-4be1-b834-283146a98718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a0c2418f5346fbbb18e392ff11722a', 'request_id': 'req-5e651a64-1b9a-4be1-b834-283146a98718'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:06.358169 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-5e651a64-1b9a-4be1-b834-283146a98718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a0c2418f5346fbbb18e392ff11722a', 'request_id': 'req-5e651a64-1b9a-4be1-b834-283146a98718'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:06.373752 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-5e651a64-1b9a-4be1-b834-283146a98718 admin admin] The token cache is being invalidate because project 34a0c2418f5346fbbb18e392ff11722a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:06.374374 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-5e651a64-1b9a-4be1-b834-283146a98718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:06.375171 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-5e651a64-1b9a-4be1-b834-283146a98718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:06.376928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1044/2097] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:05 2022] DELETE /identity/v3/projects/34a0c2418f5346fbbb18e392ff11722a => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:06.379863 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e651a64-1b9a-4be1-b834-283146a98718 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:06.380198 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5e651a64-1b9a-4be1-b834-283146a98718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:06.403971 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e651a64-1b9a-4be1-b834-283146a98718 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:06.409191 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4edb1-7d9b-45ac-b6a7-9cfb2ac1556f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:06.414570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4edb1-7d9b-45ac-b6a7-9cfb2ac1556f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:06.414570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4edb1-7d9b-45ac-b6a7-9cfb2ac1556f admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:06.414570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4edb1-7d9b-45ac-b6a7-9cfb2ac1556f admin admin] PATH_INFO: `/v3/projects/a243d57bed454316be947920f1fccc5f` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:06.414570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4edb1-7d9b-45ac-b6a7-9cfb2ac1556f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a243d57bed454316be947920f1fccc5f)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:06.414570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4edb1-7d9b-45ac-b6a7-9cfb2ac1556f admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:06.479824 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-71949158-4b32-42d0-9654-2bf3ce1acb75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19541936c13a4fd58689e30f0767ae2e', 'request_id': 'req-71949158-4b32-42d0-9654-2bf3ce1acb75'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:06.549075 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-c1e4edb1-7d9b-45ac-b6a7-9cfb2ac1556f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a243d57bed454316be947920f1fccc5f', 'request_id': 'req-c1e4edb1-7d9b-45ac-b6a7-9cfb2ac1556f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:06.564416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-71949158-4b32-42d0-9654-2bf3ce1acb75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19541936c13a4fd58689e30f0767ae2e', 'request_id': 'req-71949158-4b32-42d0-9654-2bf3ce1acb75'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:06.575763 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-71949158-4b32-42d0-9654-2bf3ce1acb75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19541936c13a4fd58689e30f0767ae2e', 'request_id': 'req-71949158-4b32-42d0-9654-2bf3ce1acb75'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:06.591011 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-71949158-4b32-42d0-9654-2bf3ce1acb75 admin admin] The token cache is being invalidate because project 19541936c13a4fd58689e30f0767ae2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:06.591336 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-71949158-4b32-42d0-9654-2bf3ce1acb75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:06.591992 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-71949158-4b32-42d0-9654-2bf3ce1acb75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:06.593616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1054/2098] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:06 2022] DELETE /identity/v3/projects/19541936c13a4fd58689e30f0767ae2e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:06.598008 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71949158-4b32-42d0-9654-2bf3ce1acb75 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:06.599582 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-71949158-4b32-42d0-9654-2bf3ce1acb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:06.643943 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-c1e4edb1-7d9b-45ac-b6a7-9cfb2ac1556f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a243d57bed454316be947920f1fccc5f', 'request_id': 'req-c1e4edb1-7d9b-45ac-b6a7-9cfb2ac1556f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:06.651617 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-c1e4edb1-7d9b-45ac-b6a7-9cfb2ac1556f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a243d57bed454316be947920f1fccc5f', 'request_id': 'req-c1e4edb1-7d9b-45ac-b6a7-9cfb2ac1556f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:06.666339 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-c1e4edb1-7d9b-45ac-b6a7-9cfb2ac1556f admin admin] The token cache is being invalidate because project a243d57bed454316be947920f1fccc5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:06.666757 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-c1e4edb1-7d9b-45ac-b6a7-9cfb2ac1556f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:06.667500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-c1e4edb1-7d9b-45ac-b6a7-9cfb2ac1556f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:06.669240 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1045/2099] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:06 2022] DELETE /identity/v3/projects/a243d57bed454316be947920f1fccc5f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:06.670821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9640d-66e0-4ff4-9fb6-a4ed484ee5df None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:06.671325 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9640d-66e0-4ff4-9fb6-a4ed484ee5df None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:06.671849 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9640d-66e0-4ff4-9fb6-a4ed484ee5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:06.677994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71949158-4b32-42d0-9654-2bf3ce1acb75 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:06.720103 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d3e9640d-66e0-4ff4-9fb6-a4ed484ee5df None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:06.721659 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d3e9640d-66e0-4ff4-9fb6-a4ed484ee5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:06.743033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17787f33-4359-4ca4-8bf8-5a76cd7e573a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:06.743933 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17787f33-4359-4ca4-8bf8-5a76cd7e573a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:06.744234 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17787f33-4359-4ca4-8bf8-5a76cd7e573a admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:06.744562 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17787f33-4359-4ca4-8bf8-5a76cd7e573a admin admin] PATH_INFO: `/v3/users/f12c518350e249f4945253f49e09c14f` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:06.746505 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17787f33-4359-4ca4-8bf8-5a76cd7e573a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f12c518350e249f4945253f49e09c14f)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:06.748831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17787f33-4359-4ca4-8bf8-5a76cd7e573a admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:06.798771 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1046/2100] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:06.799880 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9640d-66e0-4ff4-9fb6-a4ed484ee5df None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:06.801305 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d3e9640d-66e0-4ff4-9fb6-a4ed484ee5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:06.815288 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9640d-66e0-4ff4-9fb6-a4ed484ee5df None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:06.821179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499a890-154c-41d5-ae03-ade62666c680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:06.822098 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499a890-154c-41d5-ae03-ade62666c680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:06.822379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499a890-154c-41d5-ae03-ade62666c680 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:06.822647 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499a890-154c-41d5-ae03-ade62666c680 admin admin] PATH_INFO: `/v3/users/49e680d10e5049fc84158960a5f94449` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:06.823857 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499a890-154c-41d5-ae03-ade62666c680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49e680d10e5049fc84158960a5f94449)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:06.826006 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499a890-154c-41d5-ae03-ade62666c680 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:07.049534 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-17787f33-4359-4ca4-8bf8-5a76cd7e573a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f12c518350e249f4945253f49e09c14f'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.050413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-17787f33-4359-4ca4-8bf8-5a76cd7e573a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f12c518350e249f4945253f49e09c14f'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.064462 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-17787f33-4359-4ca4-8bf8-5a76cd7e573a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f12c518350e249f4945253f49e09c14f'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.073520 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-17787f33-4359-4ca4-8bf8-5a76cd7e573a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f12c518350e249f4945253f49e09c14f'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.074556 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-17787f33-4359-4ca4-8bf8-5a76cd7e573a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f12c518350e249f4945253f49e09c14f'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.163245 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e499a890-154c-41d5-ae03-ade62666c680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49e680d10e5049fc84158960a5f94449'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.164073 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e499a890-154c-41d5-ae03-ade62666c680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49e680d10e5049fc84158960a5f94449'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.177475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e499a890-154c-41d5-ae03-ade62666c680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49e680d10e5049fc84158960a5f94449'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.184323 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e499a890-154c-41d5-ae03-ade62666c680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49e680d10e5049fc84158960a5f94449'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.185082 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e499a890-154c-41d5-ae03-ade62666c680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49e680d10e5049fc84158960a5f94449'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.301276 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1055/2101] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:06 2022] DELETE /identity/v3/users/f12c518350e249f4945253f49e09c14f => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:07.302015 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17787f33-4359-4ca4-8bf8-5a76cd7e573a admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:07.303420 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-17787f33-4359-4ca4-8bf8-5a76cd7e573a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:07.401413 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1047/2102] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:06 2022] DELETE /identity/v3/users/49e680d10e5049fc84158960a5f94449 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:07.404052 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b67d7-136e-4269-9a1e-a94213d24e47 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:07.404532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b67d7-136e-4269-9a1e-a94213d24e47 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:07.405098 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b67d7-136e-4269-9a1e-a94213d24e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:07.433229 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-3e9b67d7-136e-4269-9a1e-a94213d24e47 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:07.435081 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-3e9b67d7-136e-4269-9a1e-a94213d24e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:07.517764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1048/2103] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:07.519056 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b67d7-136e-4269-9a1e-a94213d24e47 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:07.523964 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-3e9b67d7-136e-4269-9a1e-a94213d24e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:07.528557 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17787f33-4359-4ca4-8bf8-5a76cd7e573a admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:07.534064 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82325b4-519e-4816-8414-21ee85973934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:07.535014 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82325b4-519e-4816-8414-21ee85973934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:07.536739 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82325b4-519e-4816-8414-21ee85973934 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:07.536739 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82325b4-519e-4816-8414-21ee85973934 admin admin] PATH_INFO: `/v3/users/74d87d19d38841fdb55594fa00abab8b` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:07.537112 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b67d7-136e-4269-9a1e-a94213d24e47 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:07.537379 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82325b4-519e-4816-8414-21ee85973934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d87d19d38841fdb55594fa00abab8b)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:07.539393 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82325b4-519e-4816-8414-21ee85973934 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:07.543292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d6578-e691-4da1-9f6e-240709ab36e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:07.544272 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d6578-e691-4da1-9f6e-240709ab36e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:07.544553 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d6578-e691-4da1-9f6e-240709ab36e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:07.544863 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d6578-e691-4da1-9f6e-240709ab36e3 admin admin] PATH_INFO: `/v3/users/19fe1655860f4286a56b0bac7c5da932` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:07.546194 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d6578-e691-4da1-9f6e-240709ab36e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19fe1655860f4286a56b0bac7c5da932)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:07.548177 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d6578-e691-4da1-9f6e-240709ab36e3 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:07.798174 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b82325b4-519e-4816-8414-21ee85973934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d87d19d38841fdb55594fa00abab8b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.798852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b82325b4-519e-4816-8414-21ee85973934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d87d19d38841fdb55594fa00abab8b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.812085 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b82325b4-519e-4816-8414-21ee85973934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d87d19d38841fdb55594fa00abab8b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.820447 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b82325b4-519e-4816-8414-21ee85973934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d87d19d38841fdb55594fa00abab8b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.821668 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b82325b4-519e-4816-8414-21ee85973934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d87d19d38841fdb55594fa00abab8b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.827162 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-711d6578-e691-4da1-9f6e-240709ab36e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19fe1655860f4286a56b0bac7c5da932'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.827847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-711d6578-e691-4da1-9f6e-240709ab36e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19fe1655860f4286a56b0bac7c5da932'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.844024 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-711d6578-e691-4da1-9f6e-240709ab36e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19fe1655860f4286a56b0bac7c5da932'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.851960 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-711d6578-e691-4da1-9f6e-240709ab36e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19fe1655860f4286a56b0bac7c5da932'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.852688 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-711d6578-e691-4da1-9f6e-240709ab36e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19fe1655860f4286a56b0bac7c5da932'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:07.911312 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1056/2104] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:07 2022] DELETE /identity/v3/users/74d87d19d38841fdb55594fa00abab8b => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:07.913683 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6d3f9-93f1-4a90-ae83-5e4939f419a6 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:07.914218 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6d3f9-93f1-4a90-ae83-5e4939f419a6 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:07.915015 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6d3f9-93f1-4a90-ae83-5e4939f419a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:07.942834 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-c2c6d3f9-93f1-4a90-ae83-5e4939f419a6 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:07.942834 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c2c6d3f9-93f1-4a90-ae83-5e4939f419a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:08.047072 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1049/2105] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:07 2022] DELETE /identity/v3/users/19fe1655860f4286a56b0bac7c5da932 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:08.047703 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d6578-e691-4da1-9f6e-240709ab36e3 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:08.052161 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-711d6578-e691-4da1-9f6e-240709ab36e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:08.072478 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1057/2106] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:08.073793 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6d3f9-93f1-4a90-ae83-5e4939f419a6 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:08.075320 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c2c6d3f9-93f1-4a90-ae83-5e4939f419a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:08.093929 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6d3f9-93f1-4a90-ae83-5e4939f419a6 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:08.173822 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a307093-f46a-425b-9488-5ba94b12403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:08.177248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a307093-f46a-425b-9488-5ba94b12403e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:08.177248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a307093-f46a-425b-9488-5ba94b12403e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:08.177248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a307093-f46a-425b-9488-5ba94b12403e admin admin] PATH_INFO: `/v3/projects/4218388b76f347109f7e05fb03269617` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:08.177712 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d6578-e691-4da1-9f6e-240709ab36e3 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:08.177837 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a307093-f46a-425b-9488-5ba94b12403e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4218388b76f347109f7e05fb03269617)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:08.179914 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a307093-f46a-425b-9488-5ba94b12403e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:08.183817 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7e360-7246-4b73-9c07-691f320e3eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:08.184601 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7e360-7246-4b73-9c07-691f320e3eaf admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:08.184887 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7e360-7246-4b73-9c07-691f320e3eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:08.185162 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7e360-7246-4b73-9c07-691f320e3eaf admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:08.185903 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7e360-7246-4b73-9c07-691f320e3eaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:58:08.186210 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7e360-7246-4b73-9c07-691f320e3eaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:08.187825 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7e360-7246-4b73-9c07-691f320e3eaf admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:08.200997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1050/2107] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:58:08.203752 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6b78c-7740-40ea-8a3f-4e73e4512e8f None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:08.205237 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6b78c-7740-40ea-8a3f-4e73e4512e8f None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:08.205237 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6b78c-7740-40ea-8a3f-4e73e4512e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:08.226929 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-02c6b78c-7740-40ea-8a3f-4e73e4512e8f None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:08.231508 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-02c6b78c-7740-40ea-8a3f-4e73e4512e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:08.236537 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1051/2108] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:08.237536 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6b78c-7740-40ea-8a3f-4e73e4512e8f None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:08.239739 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-02c6b78c-7740-40ea-8a3f-4e73e4512e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:08.320265 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6b78c-7740-40ea-8a3f-4e73e4512e8f None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:08.327053 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dba2ec-7fb7-4b56-9298-4a22c9dfeb2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:08.328225 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dba2ec-7fb7-4b56-9298-4a22c9dfeb2a service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:08.328739 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dba2ec-7fb7-4b56-9298-4a22c9dfeb2a service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:08.329220 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dba2ec-7fb7-4b56-9298-4a22c9dfeb2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:08.341192 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9a307093-f46a-425b-9488-5ba94b12403e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4218388b76f347109f7e05fb03269617', 'request_id': 'req-9a307093-f46a-425b-9488-5ba94b12403e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:08.348348 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dba2ec-7fb7-4b56-9298-4a22c9dfeb2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:08.351070 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dba2ec-7fb7-4b56-9298-4a22c9dfeb2a service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:08.369840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1052/2109] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:08.371249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dba2ec-7fb7-4b56-9298-4a22c9dfeb2a service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:08.373644 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b9dba2ec-7fb7-4b56-9298-4a22c9dfeb2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:08.398508 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dba2ec-7fb7-4b56-9298-4a22c9dfeb2a service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:08.444777 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9a307093-f46a-425b-9488-5ba94b12403e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4218388b76f347109f7e05fb03269617', 'request_id': 'req-9a307093-f46a-425b-9488-5ba94b12403e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:08.456760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9a307093-f46a-425b-9488-5ba94b12403e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4218388b76f347109f7e05fb03269617', 'request_id': 'req-9a307093-f46a-425b-9488-5ba94b12403e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:08.490485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9a307093-f46a-425b-9488-5ba94b12403e admin admin] The token cache is being invalidate because project 4218388b76f347109f7e05fb03269617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:08.492137 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9a307093-f46a-425b-9488-5ba94b12403e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:08.493595 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9a307093-f46a-425b-9488-5ba94b12403e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:08.497118 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1058/2110] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:08 2022] DELETE /identity/v3/projects/4218388b76f347109f7e05fb03269617 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:08.499231 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a307093-f46a-425b-9488-5ba94b12403e admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:08.504515 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-9a307093-f46a-425b-9488-5ba94b12403e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:08.515537 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ee110-e5b3-45ad-a9c2-608c3ef3004d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:08.517282 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ee110-e5b3-45ad-a9c2-608c3ef3004d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:08.518149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ee110-e5b3-45ad-a9c2-608c3ef3004d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:08.518305 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ee110-e5b3-45ad-a9c2-608c3ef3004d admin admin] PATH_INFO: `/v3/users/efbc2b41331a4c739f1cc95cc6bc1a2b` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:08.520393 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ee110-e5b3-45ad-a9c2-608c3ef3004d admin admin] RBAC: Authorizing `identity:delete_user(user_id=efbc2b41331a4c739f1cc95cc6bc1a2b)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:08.521290 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a307093-f46a-425b-9488-5ba94b12403e admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:08.522657 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ee110-e5b3-45ad-a9c2-608c3ef3004d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:08.532300 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8ffc4-18c7-4a63-ad39-f94efcce55d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:08.533671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8ffc4-18c7-4a63-ad39-f94efcce55d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:08.533671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8ffc4-18c7-4a63-ad39-f94efcce55d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:08.534428 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8ffc4-18c7-4a63-ad39-f94efcce55d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:08.535427 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8ffc4-18c7-4a63-ad39-f94efcce55d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:08.539367 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8ffc4-18c7-4a63-ad39-f94efcce55d0 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:08.701826 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1059/2111] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:58:08 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:08.701826 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8ffc4-18c7-4a63-ad39-f94efcce55d0 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:08.701826 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-48a8ffc4-18c7-4a63-ad39-f94efcce55d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:08.780845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8ffc4-18c7-4a63-ad39-f94efcce55d0 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:08.789151 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d570417-15d5-4b17-bdb4-59ae0db3c008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:08.794313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d570417-15d5-4b17-bdb4-59ae0db3c008 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:08.794313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d570417-15d5-4b17-bdb4-59ae0db3c008 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:08.794313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d570417-15d5-4b17-bdb4-59ae0db3c008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:08.794313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-3d570417-15d5-4b17-bdb4-59ae0db3c008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:08.845646 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-2e9ee110-e5b3-45ad-a9c2-608c3ef3004d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efbc2b41331a4c739f1cc95cc6bc1a2b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:08.846761 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-2e9ee110-e5b3-45ad-a9c2-608c3ef3004d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efbc2b41331a4c739f1cc95cc6bc1a2b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:08.868476 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-2e9ee110-e5b3-45ad-a9c2-608c3ef3004d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efbc2b41331a4c739f1cc95cc6bc1a2b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:08.882483 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-2e9ee110-e5b3-45ad-a9c2-608c3ef3004d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efbc2b41331a4c739f1cc95cc6bc1a2b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:08.883855 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-2e9ee110-e5b3-45ad-a9c2-608c3ef3004d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efbc2b41331a4c739f1cc95cc6bc1a2b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:08.897195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d570417-15d5-4b17-bdb4-59ae0db3c008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:08.898954 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d570417-15d5-4b17-bdb4-59ae0db3c008 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:08.912037 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1060/2112] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:08.913212 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2941a34-7d79-4a53-b96c-729754721954 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:08.913497 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2941a34-7d79-4a53-b96c-729754721954 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:08.913772 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2941a34-7d79-4a53-b96c-729754721954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:08.947898 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-a2941a34-7d79-4a53-b96c-729754721954 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:08.949349 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-a2941a34-7d79-4a53-b96c-729754721954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:08.963914 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1061/2113] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:08.965258 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2941a34-7d79-4a53-b96c-729754721954 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:08.966702 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-a2941a34-7d79-4a53-b96c-729754721954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:08.978961 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1053/2114] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:08 2022] DELETE /identity/v3/users/efbc2b41331a4c739f1cc95cc6bc1a2b => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:08.981355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ee110-e5b3-45ad-a9c2-608c3ef3004d admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:08.981691 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-2e9ee110-e5b3-45ad-a9c2-608c3ef3004d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:08.994679 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2941a34-7d79-4a53-b96c-729754721954 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:09.075299 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ee110-e5b3-45ad-a9c2-608c3ef3004d admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:09.077887 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f4a92-6414-457a-9558-fa298a5c26c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:09.079180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f4a92-6414-457a-9558-fa298a5c26c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:09.080152 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f4a92-6414-457a-9558-fa298a5c26c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:09.080828 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f4a92-6414-457a-9558-fa298a5c26c7 admin admin] PATH_INFO: `/v3/projects/2384ca44300d430fa17efac7187013f6` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:09.082769 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc66bbe-4094-474a-9de0-110ae33a38fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:09.083249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc66bbe-4094-474a-9de0-110ae33a38fc admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:09.083789 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc66bbe-4094-474a-9de0-110ae33a38fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:09.084070 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc66bbe-4094-474a-9de0-110ae33a38fc admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:09.084248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f4a92-6414-457a-9558-fa298a5c26c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2384ca44300d430fa17efac7187013f6)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:09.085216 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc66bbe-4094-474a-9de0-110ae33a38fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:09.087194 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f4a92-6414-457a-9558-fa298a5c26c7 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:09.087366 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc66bbe-4094-474a-9de0-110ae33a38fc admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:09.211751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1054/2115] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:58:08 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:09.213809 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21a3d-c71a-4f8c-9509-18aa1d3de1bf None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:09.214416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21a3d-c71a-4f8c-9509-18aa1d3de1bf None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:09.214750 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21a3d-c71a-4f8c-9509-18aa1d3de1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:09.235963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-9af21a3d-c71a-4f8c-9509-18aa1d3de1bf None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:09.237252 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9af21a3d-c71a-4f8c-9509-18aa1d3de1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:09.249424 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1055/2116] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:09.251752 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bfb19-7f92-4e69-aa11-bd70201e5792 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:09.252221 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bfb19-7f92-4e69-aa11-bd70201e5792 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:09.254484 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bfb19-7f92-4e69-aa11-bd70201e5792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:09.273558 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-fb7bfb19-7f92-4e69-aa11-bd70201e5792 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:09.275449 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-fb7bfb19-7f92-4e69-aa11-bd70201e5792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:09.280984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ae9f4a92-6414-457a-9558-fa298a5c26c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2384ca44300d430fa17efac7187013f6', 'request_id': 'req-ae9f4a92-6414-457a-9558-fa298a5c26c7'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:09.375865 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ae9f4a92-6414-457a-9558-fa298a5c26c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2384ca44300d430fa17efac7187013f6', 'request_id': 'req-ae9f4a92-6414-457a-9558-fa298a5c26c7'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:09.384686 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ae9f4a92-6414-457a-9558-fa298a5c26c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2384ca44300d430fa17efac7187013f6', 'request_id': 'req-ae9f4a92-6414-457a-9558-fa298a5c26c7'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:09.396205 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1056/2117] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:09.396787 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bfb19-7f92-4e69-aa11-bd70201e5792 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:09.398821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-fb7bfb19-7f92-4e69-aa11-bd70201e5792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:09.404863 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ae9f4a92-6414-457a-9558-fa298a5c26c7 admin admin] The token cache is being invalidate because project 2384ca44300d430fa17efac7187013f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:09.405394 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ae9f4a92-6414-457a-9558-fa298a5c26c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:09.406398 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ae9f4a92-6414-457a-9558-fa298a5c26c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:09.408566 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1062/2118] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:08 2022] DELETE /identity/v3/projects/2384ca44300d430fa17efac7187013f6 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:09.409713 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f4a92-6414-457a-9558-fa298a5c26c7 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:09.415748 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ae9f4a92-6414-457a-9558-fa298a5c26c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:09.419506 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bfb19-7f92-4e69-aa11-bd70201e5792 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:09.426154 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f16dbf-fdae-4f7d-86c9-de5d0afec0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:09.427935 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f16dbf-fdae-4f7d-86c9-de5d0afec0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:09.428748 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f16dbf-fdae-4f7d-86c9-de5d0afec0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:09.429206 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f16dbf-fdae-4f7d-86c9-de5d0afec0a4 admin admin] PATH_INFO: `/v3/projects/305c41ea276f49cf92de0d997322f130` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:09.431390 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f16dbf-fdae-4f7d-86c9-de5d0afec0a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=305c41ea276f49cf92de0d997322f130)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:09.432459 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f4a92-6414-457a-9558-fa298a5c26c7 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:09.434329 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f16dbf-fdae-4f7d-86c9-de5d0afec0a4 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:09.472676 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac283f6a-dcdb-44d8-813d-f1770b7f571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:09.474328 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac283f6a-dcdb-44d8-813d-f1770b7f571b admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:09.474877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac283f6a-dcdb-44d8-813d-f1770b7f571b admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:09.475626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac283f6a-dcdb-44d8-813d-f1770b7f571b admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:09.477201 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac283f6a-dcdb-44d8-813d-f1770b7f571b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:09.480357 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac283f6a-dcdb-44d8-813d-f1770b7f571b admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:09.498037 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1063/2119] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:09.502379 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac283f6a-dcdb-44d8-813d-f1770b7f571b admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:09.505721 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ac283f6a-dcdb-44d8-813d-f1770b7f571b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:09.520454 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac283f6a-dcdb-44d8-813d-f1770b7f571b admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:09.525927 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb692d-7490-4868-91ac-b7eacc6902ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:09.526607 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb692d-7490-4868-91ac-b7eacc6902ef admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:09.526902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb692d-7490-4868-91ac-b7eacc6902ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:09.527170 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb692d-7490-4868-91ac-b7eacc6902ef admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:09.527915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb692d-7490-4868-91ac-b7eacc6902ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:58:09.530408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb692d-7490-4868-91ac-b7eacc6902ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:09.530408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb692d-7490-4868-91ac-b7eacc6902ef admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:09.543893 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1064/2120] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:58:09.548316 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb692d-7490-4868-91ac-b7eacc6902ef admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:09.550129 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-34fb692d-7490-4868-91ac-b7eacc6902ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:09.576719 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-17f16dbf-fdae-4f7d-86c9-de5d0afec0a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '305c41ea276f49cf92de0d997322f130', 'request_id': 'req-17f16dbf-fdae-4f7d-86c9-de5d0afec0a4'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:09.653045 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb692d-7490-4868-91ac-b7eacc6902ef admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:09.667346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-17f16dbf-fdae-4f7d-86c9-de5d0afec0a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '305c41ea276f49cf92de0d997322f130', 'request_id': 'req-17f16dbf-fdae-4f7d-86c9-de5d0afec0a4'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:09.687114 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-17f16dbf-fdae-4f7d-86c9-de5d0afec0a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '305c41ea276f49cf92de0d997322f130', 'request_id': 'req-17f16dbf-fdae-4f7d-86c9-de5d0afec0a4'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:09.713007 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-17f16dbf-fdae-4f7d-86c9-de5d0afec0a4 admin admin] The token cache is being invalidate because project 305c41ea276f49cf92de0d997322f130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:09.713007 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-17f16dbf-fdae-4f7d-86c9-de5d0afec0a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:09.714903 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-17f16dbf-fdae-4f7d-86c9-de5d0afec0a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:09.717623 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1057/2121] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:09 2022] DELETE /identity/v3/projects/305c41ea276f49cf92de0d997322f130 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:09.721700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d0648-d0af-4c1d-b740-4d52f4665915 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:09.722026 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d0648-d0af-4c1d-b740-4d52f4665915 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:09.722320 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d0648-d0af-4c1d-b740-4d52f4665915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:09.739493 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9c44a-b2f5-4908-8304-587105e9cc32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:09.740462 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9c44a-b2f5-4908-8304-587105e9cc32 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:09.740947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9c44a-b2f5-4908-8304-587105e9cc32 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:09.741334 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9c44a-b2f5-4908-8304-587105e9cc32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:09.743096 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-ec0d0648-d0af-4c1d-b740-4d52f4665915 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:09.744232 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-fbb9c44a-b2f5-4908-8304-587105e9cc32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:09.744402 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ec0d0648-d0af-4c1d-b740-4d52f4665915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:09.824025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1058/2122] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:09.825726 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d0648-d0af-4c1d-b740-4d52f4665915 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:09.827309 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ec0d0648-d0af-4c1d-b740-4d52f4665915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:09.837029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9c44a-b2f5-4908-8304-587105e9cc32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:09.838580 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9c44a-b2f5-4908-8304-587105e9cc32 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:09.841171 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d0648-d0af-4c1d-b740-4d52f4665915 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:09.846631 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69283597-a48b-47ae-a8f5-56b764bf86b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:09.847543 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69283597-a48b-47ae-a8f5-56b764bf86b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:09.847816 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69283597-a48b-47ae-a8f5-56b764bf86b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:09.848273 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69283597-a48b-47ae-a8f5-56b764bf86b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:09.849101 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69283597-a48b-47ae-a8f5-56b764bf86b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:09.850521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1065/2123] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:09.851284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9c44a-b2f5-4908-8304-587105e9cc32 service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:09.852441 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69283597-a48b-47ae-a8f5-56b764bf86b9 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:09.853714 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-fbb9c44a-b2f5-4908-8304-587105e9cc32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:09.868410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9c44a-b2f5-4908-8304-587105e9cc32 service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:09.874261 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e77062-7db7-49a7-a3c9-92d3a4dc57e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:09.875089 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e77062-7db7-49a7-a3c9-92d3a4dc57e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:09.875381 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e77062-7db7-49a7-a3c9-92d3a4dc57e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:09.875659 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e77062-7db7-49a7-a3c9-92d3a4dc57e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:09.876471 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e77062-7db7-49a7-a3c9-92d3a4dc57e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:09.877761 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1059/2124] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:09.880616 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69283597-a48b-47ae-a8f5-56b764bf86b9 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:09.882696 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e77062-7db7-49a7-a3c9-92d3a4dc57e6 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:09.883736 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-69283597-a48b-47ae-a8f5-56b764bf86b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:09.906410 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69283597-a48b-47ae-a8f5-56b764bf86b9 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:09.915724 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bed0a-16e5-475c-b2d4-c405f02a6dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:09.917103 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bed0a-16e5-475c-b2d4-c405f02a6dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:09.917274 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bed0a-16e5-475c-b2d4-c405f02a6dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:09.917546 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bed0a-16e5-475c-b2d4-c405f02a6dd4 admin admin] PATH_INFO: `/v3/projects/2601bb73304b4ce38bc02cc306365081` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:09.919812 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bed0a-16e5-475c-b2d4-c405f02a6dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2601bb73304b4ce38bc02cc306365081)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:09.923402 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bed0a-16e5-475c-b2d4-c405f02a6dd4 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:09.986384 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1066/2125] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:58:09 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:09.988023 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e77062-7db7-49a7-a3c9-92d3a4dc57e6 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:09.991772 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-27e77062-7db7-49a7-a3c9-92d3a4dc57e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:10.065934 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e77062-7db7-49a7-a3c9-92d3a4dc57e6 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:10.073572 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee28fc-ea52-4105-8172-fd4b10a9dcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:10.074667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee28fc-ea52-4105-8172-fd4b10a9dcc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:10.074965 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee28fc-ea52-4105-8172-fd4b10a9dcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:10.075245 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee28fc-ea52-4105-8172-fd4b10a9dcc9 admin admin] PATH_INFO: `/v3/users/c909d396c95f43ca840ffba562790081` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:10.076546 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee28fc-ea52-4105-8172-fd4b10a9dcc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c909d396c95f43ca840ffba562790081)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:10.078850 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee28fc-ea52-4105-8172-fd4b10a9dcc9 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:10.114570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ff2bed0a-16e5-475c-b2d4-c405f02a6dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2601bb73304b4ce38bc02cc306365081', 'request_id': 'req-ff2bed0a-16e5-475c-b2d4-c405f02a6dd4'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:10.237702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ff2bed0a-16e5-475c-b2d4-c405f02a6dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2601bb73304b4ce38bc02cc306365081', 'request_id': 'req-ff2bed0a-16e5-475c-b2d4-c405f02a6dd4'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:10.247773 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ff2bed0a-16e5-475c-b2d4-c405f02a6dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2601bb73304b4ce38bc02cc306365081', 'request_id': 'req-ff2bed0a-16e5-475c-b2d4-c405f02a6dd4'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:10.259830 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ff2bed0a-16e5-475c-b2d4-c405f02a6dd4 admin admin] The token cache is being invalidate because project 2601bb73304b4ce38bc02cc306365081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:10.260122 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ff2bed0a-16e5-475c-b2d4-c405f02a6dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:10.260877 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ff2bed0a-16e5-475c-b2d4-c405f02a6dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:10.262629 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1060/2126] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:09 2022] DELETE /identity/v3/projects/2601bb73304b4ce38bc02cc306365081 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:10.263964 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d581ad-2d03-4aa4-bd77-f24697f9dade None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:10.264249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d581ad-2d03-4aa4-bd77-f24697f9dade None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:10.264527 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d581ad-2d03-4aa4-bd77-f24697f9dade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:10.283871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-64d581ad-2d03-4aa4-bd77-f24697f9dade None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:10.285781 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-64d581ad-2d03-4aa4-bd77-f24697f9dade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:10.336324 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-89ee28fc-ea52-4105-8172-fd4b10a9dcc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c909d396c95f43ca840ffba562790081'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:10.336841 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-89ee28fc-ea52-4105-8172-fd4b10a9dcc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c909d396c95f43ca840ffba562790081'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:10.353040 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-89ee28fc-ea52-4105-8172-fd4b10a9dcc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c909d396c95f43ca840ffba562790081'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:10.359803 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1061/2127] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:10.360677 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d581ad-2d03-4aa4-bd77-f24697f9dade None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:10.362041 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-64d581ad-2d03-4aa4-bd77-f24697f9dade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:10.365594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-89ee28fc-ea52-4105-8172-fd4b10a9dcc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c909d396c95f43ca840ffba562790081'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:10.366324 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-89ee28fc-ea52-4105-8172-fd4b10a9dcc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c909d396c95f43ca840ffba562790081'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:10.377404 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d581ad-2d03-4aa4-bd77-f24697f9dade None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:10.383478 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4f488-0097-498f-9f19-4929c525ddf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:10.384387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4f488-0097-498f-9f19-4929c525ddf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:10.384705 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4f488-0097-498f-9f19-4929c525ddf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:10.384986 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4f488-0097-498f-9f19-4929c525ddf7 admin admin] PATH_INFO: `/v3/projects/a65a6dd5b01d4404afb6a740fb56fd54/users/f7fe7ea486834f6e9e8a7685d9c36bac/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:10.404355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4f488-0097-498f-9f19-4929c525ddf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65a6dd5b01d4404afb6a740fb56fd54, user_id=f7fe7ea486834f6e9e8a7685d9c36bac, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:10.409796 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4f488-0097-498f-9f19-4929c525ddf7 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:10.463584 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1067/2128] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:09 2022] DELETE /identity/v3/users/c909d396c95f43ca840ffba562790081 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:10.464805 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee28fc-ea52-4105-8172-fd4b10a9dcc9 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:10.466159 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-89ee28fc-ea52-4105-8172-fd4b10a9dcc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:10.492986 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1062/2129] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:10 2022] PUT /identity/v3/projects/a65a6dd5b01d4404afb6a740fb56fd54/users/f7fe7ea486834f6e9e8a7685d9c36bac/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:10.495434 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4f488-0097-498f-9f19-4929c525ddf7 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:10.498791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d6c4f488-0097-498f-9f19-4929c525ddf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:10.567359 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee28fc-ea52-4105-8172-fd4b10a9dcc9 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:10.576185 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b3d82-dcfb-472f-b5f9-6bf01af8f041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:10.576428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4f488-0097-498f-9f19-4929c525ddf7 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:10.577542 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b3d82-dcfb-472f-b5f9-6bf01af8f041 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:10.578104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b3d82-dcfb-472f-b5f9-6bf01af8f041 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:10.578854 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b3d82-dcfb-472f-b5f9-6bf01af8f041 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:10.580119 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b3d82-dcfb-472f-b5f9-6bf01af8f041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:10.581190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa65e6-382c-4039-8f0e-8e804e99e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:10.582585 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa65e6-382c-4039-8f0e-8e804e99e51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:10.582865 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa65e6-382c-4039-8f0e-8e804e99e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:10.583136 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa65e6-382c-4039-8f0e-8e804e99e51a admin admin] PATH_INFO: `/v3/users/a6a8609ecdc349008fbd7062990171b0` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:10.584512 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa65e6-382c-4039-8f0e-8e804e99e51a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a8609ecdc349008fbd7062990171b0)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:10.585275 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b3d82-dcfb-472f-b5f9-6bf01af8f041 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:10.586458 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa65e6-382c-4039-8f0e-8e804e99e51a admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:10.721931 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1068/2130] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:58:10 2022] POST /identity/v3/users => generated 288 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:10.725511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b3d82-dcfb-472f-b5f9-6bf01af8f041 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:10.747614 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b3d82-dcfb-472f-b5f9-6bf01af8f041 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:10.755429 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106457ca-8107-431e-8b2b-133b3ca1f9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:10.756201 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106457ca-8107-431e-8b2b-133b3ca1f9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:10.756509 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106457ca-8107-431e-8b2b-133b3ca1f9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:10.756825 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106457ca-8107-431e-8b2b-133b3ca1f9f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:10.757854 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106457ca-8107-431e-8b2b-133b3ca1f9f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:58:10.758257 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106457ca-8107-431e-8b2b-133b3ca1f9f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:10.760033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106457ca-8107-431e-8b2b-133b3ca1f9f6 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:10.774479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1069/2131] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:58:10.775308 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106457ca-8107-431e-8b2b-133b3ca1f9f6 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:10.777062 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-106457ca-8107-431e-8b2b-133b3ca1f9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:10.790829 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106457ca-8107-431e-8b2b-133b3ca1f9f6 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:10.795905 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb779c-9590-47ce-a37e-1dade680c08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:10.799072 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb779c-9590-47ce-a37e-1dade680c08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:10.799072 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb779c-9590-47ce-a37e-1dade680c08f admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:10.799072 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb779c-9590-47ce-a37e-1dade680c08f admin admin] PATH_INFO: `/v3/projects/33303cdc7d464025b9cf72d046f8ad69` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:10.799072 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb779c-9590-47ce-a37e-1dade680c08f admin admin] RBAC: Authorizing `identity:delete_project(project_id=33303cdc7d464025b9cf72d046f8ad69)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:10.801152 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb779c-9590-47ce-a37e-1dade680c08f admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:10.980783 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-beaa65e6-382c-4039-8f0e-8e804e99e51a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a8609ecdc349008fbd7062990171b0'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:10.985970 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-beaa65e6-382c-4039-8f0e-8e804e99e51a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a8609ecdc349008fbd7062990171b0'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:10.995552 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-beaa65e6-382c-4039-8f0e-8e804e99e51a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a8609ecdc349008fbd7062990171b0'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:11.003542 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-beaa65e6-382c-4039-8f0e-8e804e99e51a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a8609ecdc349008fbd7062990171b0'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:11.004763 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-beaa65e6-382c-4039-8f0e-8e804e99e51a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a8609ecdc349008fbd7062990171b0'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:11.054904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b9bb779c-9590-47ce-a37e-1dade680c08f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33303cdc7d464025b9cf72d046f8ad69', 'request_id': 'req-b9bb779c-9590-47ce-a37e-1dade680c08f'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:11.134385 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1063/2132] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:10 2022] DELETE /identity/v3/users/a6a8609ecdc349008fbd7062990171b0 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:11.140609 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba1d4c-9376-497a-9c51-00c9a85a5e97 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:11.140609 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba1d4c-9376-497a-9c51-00c9a85a5e97 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:11.140609 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba1d4c-9376-497a-9c51-00c9a85a5e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:11.177234 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-a9ba1d4c-9376-497a-9c51-00c9a85a5e97 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:11.182712 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a9ba1d4c-9376-497a-9c51-00c9a85a5e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:11.198292 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b9bb779c-9590-47ce-a37e-1dade680c08f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33303cdc7d464025b9cf72d046f8ad69', 'request_id': 'req-b9bb779c-9590-47ce-a37e-1dade680c08f'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:11.209882 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b9bb779c-9590-47ce-a37e-1dade680c08f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33303cdc7d464025b9cf72d046f8ad69', 'request_id': 'req-b9bb779c-9590-47ce-a37e-1dade680c08f'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:11.226922 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b9bb779c-9590-47ce-a37e-1dade680c08f admin admin] The token cache is being invalidate because project 33303cdc7d464025b9cf72d046f8ad69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:11.227217 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b9bb779c-9590-47ce-a37e-1dade680c08f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:11.227963 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-b9bb779c-9590-47ce-a37e-1dade680c08f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:11.229809 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1070/2133] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:10 2022] DELETE /identity/v3/projects/33303cdc7d464025b9cf72d046f8ad69 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:11.235115 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb779c-9590-47ce-a37e-1dade680c08f admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:11.240048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b9bb779c-9590-47ce-a37e-1dade680c08f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:11.252232 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1064/2134] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:11.253338 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba1d4c-9376-497a-9c51-00c9a85a5e97 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:11.257383 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a9ba1d4c-9376-497a-9c51-00c9a85a5e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:11.270974 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba1d4c-9376-497a-9c51-00c9a85a5e97 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:11.278262 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f3c94-827f-4d23-9206-5be88bb10ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:11.278981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f3c94-827f-4d23-9206-5be88bb10ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:11.279414 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f3c94-827f-4d23-9206-5be88bb10ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:11.280184 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f3c94-827f-4d23-9206-5be88bb10ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:11.281561 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f3c94-827f-4d23-9206-5be88bb10ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:11.285653 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f3c94-827f-4d23-9206-5be88bb10ae0 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:11.342918 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb779c-9590-47ce-a37e-1dade680c08f admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:11.348424 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72dfef-c0a4-40bd-868c-4af595d5b483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:11.349284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72dfef-c0a4-40bd-868c-4af595d5b483 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:11.350438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72dfef-c0a4-40bd-868c-4af595d5b483 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:11.350438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72dfef-c0a4-40bd-868c-4af595d5b483 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:11.350832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72dfef-c0a4-40bd-868c-4af595d5b483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:11.352203 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72dfef-c0a4-40bd-868c-4af595d5b483 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:11.367216 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1071/2135] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:11.367216 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72dfef-c0a4-40bd-868c-4af595d5b483 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:11.369832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-9f72dfef-c0a4-40bd-868c-4af595d5b483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:11.382544 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72dfef-c0a4-40bd-868c-4af595d5b483 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:11.387746 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06131f8-167e-42b6-8154-e27d1f27f9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:11.390775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06131f8-167e-42b6-8154-e27d1f27f9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:11.390775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06131f8-167e-42b6-8154-e27d1f27f9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:11.390775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06131f8-167e-42b6-8154-e27d1f27f9dc admin admin] PATH_INFO: `/v3/projects/cccc76fe60184d24ac21e7da76eca218` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:11.390775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06131f8-167e-42b6-8154-e27d1f27f9dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cccc76fe60184d24ac21e7da76eca218)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:11.392741 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06131f8-167e-42b6-8154-e27d1f27f9dc admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:11.400400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1065/2136] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:58:11 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:11.400400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746f688-0d20-4989-961e-142cfbe1babd None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:11.400400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746f688-0d20-4989-961e-142cfbe1babd None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:11.400400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746f688-0d20-4989-961e-142cfbe1babd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:11.422941 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-f746f688-0d20-4989-961e-142cfbe1babd None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:11.423828 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f746f688-0d20-4989-961e-142cfbe1babd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:11.497439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e06131f8-167e-42b6-8154-e27d1f27f9dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cccc76fe60184d24ac21e7da76eca218', 'request_id': 'req-e06131f8-167e-42b6-8154-e27d1f27f9dc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:11.516925 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1066/2137] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:11.518671 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746f688-0d20-4989-961e-142cfbe1babd None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:11.522310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f746f688-0d20-4989-961e-142cfbe1babd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:11.570181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e06131f8-167e-42b6-8154-e27d1f27f9dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cccc76fe60184d24ac21e7da76eca218', 'request_id': 'req-e06131f8-167e-42b6-8154-e27d1f27f9dc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:11.578284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e06131f8-167e-42b6-8154-e27d1f27f9dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cccc76fe60184d24ac21e7da76eca218', 'request_id': 'req-e06131f8-167e-42b6-8154-e27d1f27f9dc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:11.598822 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e06131f8-167e-42b6-8154-e27d1f27f9dc admin admin] The token cache is being invalidate because project cccc76fe60184d24ac21e7da76eca218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:11.599366 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e06131f8-167e-42b6-8154-e27d1f27f9dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:11.600489 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e06131f8-167e-42b6-8154-e27d1f27f9dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:11.601590 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746f688-0d20-4989-961e-142cfbe1babd None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:11.603249 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1072/2138] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:11 2022] DELETE /identity/v3/projects/cccc76fe60184d24ac21e7da76eca218 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:11.606641 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06131f8-167e-42b6-8154-e27d1f27f9dc admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:11.607367 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e06131f8-167e-42b6-8154-e27d1f27f9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:11.668322 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf75dd-cd3f-46b8-af50-bdc19e555963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:11.668755 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf75dd-cd3f-46b8-af50-bdc19e555963 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:11.669040 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf75dd-cd3f-46b8-af50-bdc19e555963 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:11.669314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf75dd-cd3f-46b8-af50-bdc19e555963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:11.671269 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9edf75dd-cd3f-46b8-af50-bdc19e555963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:11.714734 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06131f8-167e-42b6-8154-e27d1f27f9dc admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:11.719766 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41f1a9-025b-4378-95c4-479d9a7a894a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:11.720550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41f1a9-025b-4378-95c4-479d9a7a894a admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:11.720926 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41f1a9-025b-4378-95c4-479d9a7a894a admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:11.721263 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41f1a9-025b-4378-95c4-479d9a7a894a admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:11.722060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41f1a9-025b-4378-95c4-479d9a7a894a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:11.724265 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41f1a9-025b-4378-95c4-479d9a7a894a admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:11.734443 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1073/2139] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:11.735243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41f1a9-025b-4378-95c4-479d9a7a894a admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:11.748832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-1f41f1a9-025b-4378-95c4-479d9a7a894a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:11.766265 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf75dd-cd3f-46b8-af50-bdc19e555963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:11.766728 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41f1a9-025b-4378-95c4-479d9a7a894a admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:11.767126 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf75dd-cd3f-46b8-af50-bdc19e555963 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:11.770832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec8a11-435f-4a4e-a6dd-8c3e01f38896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:11.771785 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8a11-435f-4a4e-a6dd-8c3e01f38896 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:11.772285 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8a11-435f-4a4e-a6dd-8c3e01f38896 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:11.772656 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8a11-435f-4a4e-a6dd-8c3e01f38896 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:11.773439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec8a11-435f-4a4e-a6dd-8c3e01f38896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:11.775849 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec8a11-435f-4a4e-a6dd-8c3e01f38896 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:11.777781 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1067/2140] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:11.779744 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35ee22-1ff5-4396-ac5d-060ed6e77757 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:11.780158 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35ee22-1ff5-4396-ac5d-060ed6e77757 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:11.780725 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35ee22-1ff5-4396-ac5d-060ed6e77757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:11.807048 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-3a35ee22-1ff5-4396-ac5d-060ed6e77757 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:11.808304 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-3a35ee22-1ff5-4396-ac5d-060ed6e77757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:11.817344 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1068/2141] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:11.820707 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ee8b3-0222-47e9-a2cc-982ec4071761 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:11.820707 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ee8b3-0222-47e9-a2cc-982ec4071761 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:11.820707 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ee8b3-0222-47e9-a2cc-982ec4071761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:11.847827 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-8e9ee8b3-0222-47e9-a2cc-982ec4071761 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:11.849071 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-8e9ee8b3-0222-47e9-a2cc-982ec4071761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:11.857275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1069/2142] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:11.858028 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ee8b3-0222-47e9-a2cc-982ec4071761 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:11.868381 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ee8b3-0222-47e9-a2cc-982ec4071761 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:11.873204 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14832e5e-2ab5-49e5-8c0f-0976271b8f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:11.874078 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14832e5e-2ab5-49e5-8c0f-0976271b8f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:11.874358 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14832e5e-2ab5-49e5-8c0f-0976271b8f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:11.874626 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14832e5e-2ab5-49e5-8c0f-0976271b8f68 admin admin] PATH_INFO: `/v3/projects/964a4184ca724d51b6fcd29dc91b2dad/users/8153df770a944c0cbb937c095cfb104b/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:11.889161 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1074/2143] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:58:11 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:11.890354 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec8a11-435f-4a4e-a6dd-8c3e01f38896 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:11.892055 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-5cec8a11-435f-4a4e-a6dd-8c3e01f38896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:11.896049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14832e5e-2ab5-49e5-8c0f-0976271b8f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=964a4184ca724d51b6fcd29dc91b2dad, user_id=8153df770a944c0cbb937c095cfb104b, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:11.899616 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14832e5e-2ab5-49e5-8c0f-0976271b8f68 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:11.907521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec8a11-435f-4a4e-a6dd-8c3e01f38896 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:11.918820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbb3b0-b8cf-4705-bbdc-590ef90cb50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:11.919694 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbb3b0-b8cf-4705-bbdc-590ef90cb50a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:11.919971 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbb3b0-b8cf-4705-bbdc-590ef90cb50a admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:11.920434 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbb3b0-b8cf-4705-bbdc-590ef90cb50a admin admin] PATH_INFO: `/v3/projects/cfe16c554f9949a7bccb62d45f3c1aff` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:11.922406 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbb3b0-b8cf-4705-bbdc-590ef90cb50a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe16c554f9949a7bccb62d45f3c1aff)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:11.923754 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbb3b0-b8cf-4705-bbdc-590ef90cb50a admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:12.044816 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1070/2144] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:11 2022] PUT /identity/v3/projects/964a4184ca724d51b6fcd29dc91b2dad/users/8153df770a944c0cbb937c095cfb104b/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:12.045587 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14832e5e-2ab5-49e5-8c0f-0976271b8f68 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:12.103336 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e9bbb3b0-b8cf-4705-bbdc-590ef90cb50a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe16c554f9949a7bccb62d45f3c1aff', 'request_id': 'req-e9bbb3b0-b8cf-4705-bbdc-590ef90cb50a'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:12.143095 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14832e5e-2ab5-49e5-8c0f-0976271b8f68 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:12.203991 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e9bbb3b0-b8cf-4705-bbdc-590ef90cb50a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe16c554f9949a7bccb62d45f3c1aff', 'request_id': 'req-e9bbb3b0-b8cf-4705-bbdc-590ef90cb50a'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:12.211299 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e9bbb3b0-b8cf-4705-bbdc-590ef90cb50a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe16c554f9949a7bccb62d45f3c1aff', 'request_id': 'req-e9bbb3b0-b8cf-4705-bbdc-590ef90cb50a'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:12.223651 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e9bbb3b0-b8cf-4705-bbdc-590ef90cb50a admin admin] The token cache is being invalidate because project cfe16c554f9949a7bccb62d45f3c1aff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:12.223973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e9bbb3b0-b8cf-4705-bbdc-590ef90cb50a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:12.224726 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e9bbb3b0-b8cf-4705-bbdc-590ef90cb50a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:12.230732 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1075/2145] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:11 2022] DELETE /identity/v3/projects/cfe16c554f9949a7bccb62d45f3c1aff => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:12.230732 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf602d-d0c9-4cef-a75e-646bee1b3274 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:12.230732 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf602d-d0c9-4cef-a75e-646bee1b3274 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:12.230732 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf602d-d0c9-4cef-a75e-646bee1b3274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:12.232749 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec60577-df55-4d8a-b119-869286616154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:12.233904 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec60577-df55-4d8a-b119-869286616154 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:12.234386 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec60577-df55-4d8a-b119-869286616154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:12.234865 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec60577-df55-4d8a-b119-869286616154 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:12.236237 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec60577-df55-4d8a-b119-869286616154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:58:12.236772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec60577-df55-4d8a-b119-869286616154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:12.240495 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec60577-df55-4d8a-b119-869286616154 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:12.249103 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-d4cf602d-d0c9-4cef-a75e-646bee1b3274 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:12.249462 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d4cf602d-d0c9-4cef-a75e-646bee1b3274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:12.258735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1076/2146] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:12.259536 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf602d-d0c9-4cef-a75e-646bee1b3274 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:12.261042 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d4cf602d-d0c9-4cef-a75e-646bee1b3274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:12.261800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1071/2147] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:58:12.265275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f2dc2-824f-4cf5-a78f-135c84f26266 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:12.265275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f2dc2-824f-4cf5-a78f-135c84f26266 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:12.265275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f2dc2-824f-4cf5-a78f-135c84f26266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:12.277611 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf602d-d0c9-4cef-a75e-646bee1b3274 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:12.279751 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e3f07-1c83-4f58-9308-906d7b9a5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:12.280446 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e3f07-1c83-4f58-9308-906d7b9a5313 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:12.280834 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e3f07-1c83-4f58-9308-906d7b9a5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:12.281034 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e3f07-1c83-4f58-9308-906d7b9a5313 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:12.281837 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e3f07-1c83-4f58-9308-906d7b9a5313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:12.283374 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e3f07-1c83-4f58-9308-906d7b9a5313 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:12.295367 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1077/2148] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:12.296814 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd67d69-033b-45dc-9231-9c32a28edff7 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:12.297105 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd67d69-033b-45dc-9231-9c32a28edff7 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:12.297383 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd67d69-033b-45dc-9231-9c32a28edff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:12.312842 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-ed5f2dc2-824f-4cf5-a78f-135c84f26266 None None] MFA Rules not processed for user `8153df770a944c0cbb937c095cfb104b`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:12.314223 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ed5f2dc2-824f-4cf5-a78f-135c84f26266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:12.336120 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-bbd67d69-033b-45dc-9231-9c32a28edff7 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:12.338237 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-bbd67d69-033b-45dc-9231-9c32a28edff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:12.364640 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1078/2149] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:12.364640 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd67d69-033b-45dc-9231-9c32a28edff7 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:12.377324 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd67d69-033b-45dc-9231-9c32a28edff7 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:12.383294 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaebe3-7149-4e20-8dd6-0d5aca62793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:12.384942 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaebe3-7149-4e20-8dd6-0d5aca62793a admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:12.385153 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaebe3-7149-4e20-8dd6-0d5aca62793a admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:12.385327 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaebe3-7149-4e20-8dd6-0d5aca62793a admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:12.386927 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaebe3-7149-4e20-8dd6-0d5aca62793a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:58:12.387249 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaebe3-7149-4e20-8dd6-0d5aca62793a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:12.389889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaebe3-7149-4e20-8dd6-0d5aca62793a admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:12.393365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1072/2150] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:12.394800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f2dc2-824f-4cf5-a78f-135c84f26266 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:12.396310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ed5f2dc2-824f-4cf5-a78f-135c84f26266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:12.412454 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f2dc2-824f-4cf5-a78f-135c84f26266 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:12.420251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b771f0a-fda6-42f2-9bd5-9dddb3c765e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:12.420251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b771f0a-fda6-42f2-9bd5-9dddb3c765e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:12.420251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b771f0a-fda6-42f2-9bd5-9dddb3c765e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:12.420251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b771f0a-fda6-42f2-9bd5-9dddb3c765e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:12.420733 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b771f0a-fda6-42f2-9bd5-9dddb3c765e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:12.421938 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1079/2151] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:58:12.422490 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b771f0a-fda6-42f2-9bd5-9dddb3c765e2 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:12.422870 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaebe3-7149-4e20-8dd6-0d5aca62793a admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:12.435734 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaebe3-7149-4e20-8dd6-0d5aca62793a admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:12.441272 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e1b94-1cf4-4f2f-9971-5c2107de76cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:12.441966 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e1b94-1cf4-4f2f-9971-5c2107de76cc admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:12.442315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e1b94-1cf4-4f2f-9971-5c2107de76cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:12.442547 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e1b94-1cf4-4f2f-9971-5c2107de76cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:12.443373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e1b94-1cf4-4f2f-9971-5c2107de76cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:12.458891 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e1b94-1cf4-4f2f-9971-5c2107de76cc admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:12.485175 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1080/2152] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:12.491132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bb450-8cce-47ec-aec3-e4ab66df3055 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:12.491132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bb450-8cce-47ec-aec3-e4ab66df3055 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:12.491132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bb450-8cce-47ec-aec3-e4ab66df3055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:12.509215 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-9a2bb450-8cce-47ec-aec3-e4ab66df3055 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:12.510492 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-9a2bb450-8cce-47ec-aec3-e4ab66df3055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:12.518966 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1081/2153] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:12.520182 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bb450-8cce-47ec-aec3-e4ab66df3055 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:12.523411 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-9a2bb450-8cce-47ec-aec3-e4ab66df3055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:12.558600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1073/2154] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:58:12 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:12.558600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b771f0a-fda6-42f2-9bd5-9dddb3c765e2 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:12.598139 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bb450-8cce-47ec-aec3-e4ab66df3055 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:12.633477 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b771f0a-fda6-42f2-9bd5-9dddb3c765e2 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:12.638392 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e419ce-e030-4030-b00d-fb6b688c9053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:12.639090 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e419ce-e030-4030-b00d-fb6b688c9053 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:12.639505 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e419ce-e030-4030-b00d-fb6b688c9053 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:12.639717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e419ce-e030-4030-b00d-fb6b688c9053 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:12.640906 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e419ce-e030-4030-b00d-fb6b688c9053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:12.642362 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e419ce-e030-4030-b00d-fb6b688c9053 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:12.658954 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830b497-8def-492c-ab69-827dc71e9ef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:12.659712 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830b497-8def-492c-ab69-827dc71e9ef2 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:12.661523 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830b497-8def-492c-ab69-827dc71e9ef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:12.661523 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830b497-8def-492c-ab69-827dc71e9ef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:12.726412 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830b497-8def-492c-ab69-827dc71e9ef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:12.730499 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830b497-8def-492c-ab69-827dc71e9ef2 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:12.748010 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1074/2155] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:58:12 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:12.748010 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e419ce-e030-4030-b00d-fb6b688c9053 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:12.758079 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1082/2156] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:12.758421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830b497-8def-492c-ab69-827dc71e9ef2 service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:12.773016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830b497-8def-492c-ab69-827dc71e9ef2 service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:12.811922 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e419ce-e030-4030-b00d-fb6b688c9053 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:12.818385 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d14a73-4505-431a-9fe5-a176c958650b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:12.819284 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d14a73-4505-431a-9fe5-a176c958650b admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:12.819652 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d14a73-4505-431a-9fe5-a176c958650b admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:12.820080 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d14a73-4505-431a-9fe5-a176c958650b admin admin] PATH_INFO: `/v3/projects/a17d1274e5e94ba487aa3e8cc4f99475/users/1d0a337ad1394a96bd2478db5c1f7fba/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:12.837407 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d14a73-4505-431a-9fe5-a176c958650b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17d1274e5e94ba487aa3e8cc4f99475, user_id=1d0a337ad1394a96bd2478db5c1f7fba, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:12.842822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d14a73-4505-431a-9fe5-a176c958650b admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:12.851322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a970f-07b0-4658-aa26-831a2e141ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:12.852094 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a970f-07b0-4658-aa26-831a2e141ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:12.852379 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a970f-07b0-4658-aa26-831a2e141ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:12.852835 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a970f-07b0-4658-aa26-831a2e141ed1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:12.853576 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a970f-07b0-4658-aa26-831a2e141ed1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:58:12.853891 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a970f-07b0-4658-aa26-831a2e141ed1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:12.855510 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a970f-07b0-4658-aa26-831a2e141ed1 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:12.870900 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1083/2157] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:58:12.871780 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a970f-07b0-4658-aa26-831a2e141ed1 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:12.882273 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a970f-07b0-4658-aa26-831a2e141ed1 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:12.887410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d748e1-f71c-47b5-826f-3511cdcbb7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:12.888118 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d748e1-f71c-47b5-826f-3511cdcbb7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:12.895110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d748e1-f71c-47b5-826f-3511cdcbb7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:12.895110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d748e1-f71c-47b5-826f-3511cdcbb7a2 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:12.895110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d748e1-f71c-47b5-826f-3511cdcbb7a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:12.895110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d748e1-f71c-47b5-826f-3511cdcbb7a2 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:12.955637 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1075/2158] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:12 2022] PUT /identity/v3/projects/a17d1274e5e94ba487aa3e8cc4f99475/users/1d0a337ad1394a96bd2478db5c1f7fba/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:12.957775 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d14a73-4505-431a-9fe5-a176c958650b admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:12.982977 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1084/2159] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:58:12 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:12.985461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d748e1-f71c-47b5-826f-3511cdcbb7a2 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:12.994760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d748e1-f71c-47b5-826f-3511cdcbb7a2 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:13.038970 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d14a73-4505-431a-9fe5-a176c958650b admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:13.043850 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a6774-206b-4ebf-8e1d-b41ea2faa770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:13.047189 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a6774-206b-4ebf-8e1d-b41ea2faa770 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:13.047189 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a6774-206b-4ebf-8e1d-b41ea2faa770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:13.047189 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a6774-206b-4ebf-8e1d-b41ea2faa770 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:13.047189 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a6774-206b-4ebf-8e1d-b41ea2faa770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:13.047710 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a6774-206b-4ebf-8e1d-b41ea2faa770 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:13.058840 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9634cf6-c482-48d7-a1f8-83016707e19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:13.059521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9634cf6-c482-48d7-a1f8-83016707e19e admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:13.059860 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9634cf6-c482-48d7-a1f8-83016707e19e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:13.060076 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9634cf6-c482-48d7-a1f8-83016707e19e admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:13.060854 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9634cf6-c482-48d7-a1f8-83016707e19e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:13.062792 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9634cf6-c482-48d7-a1f8-83016707e19e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:13.152900 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1076/2160] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:58:12 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:13.154667 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66546e-9071-4b17-ba5c-8f89e304a82d None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:13.154954 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66546e-9071-4b17-ba5c-8f89e304a82d None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:13.155415 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66546e-9071-4b17-ba5c-8f89e304a82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:13.180129 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1085/2161] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:58:12 2022] POST /identity/v3/projects => generated 387 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:13.185334 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9634cf6-c482-48d7-a1f8-83016707e19e admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:13.189791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-1f66546e-9071-4b17-ba5c-8f89e304a82d None None] MFA Rules not processed for user `1d0a337ad1394a96bd2478db5c1f7fba`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:13.192230 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1f66546e-9071-4b17-ba5c-8f89e304a82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:13.276405 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1077/2162] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:13.277768 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66546e-9071-4b17-ba5c-8f89e304a82d None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:13.291977 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9634cf6-c482-48d7-a1f8-83016707e19e admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:13.295306 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66546e-9071-4b17-ba5c-8f89e304a82d None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:13.301542 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1728e9-93ed-421e-b46a-efaf5fe067ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:13.302534 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1728e9-93ed-421e-b46a-efaf5fe067ad admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:13.303044 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1728e9-93ed-421e-b46a-efaf5fe067ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:13.303482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1728e9-93ed-421e-b46a-efaf5fe067ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:13.304435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1728e9-93ed-421e-b46a-efaf5fe067ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:13.306139 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1728e9-93ed-421e-b46a-efaf5fe067ad admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:13.322247 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c01f8-e1e9-41cf-bcba-9b84180624dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:13.322247 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c01f8-e1e9-41cf-bcba-9b84180624dc admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:13.322247 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c01f8-e1e9-41cf-bcba-9b84180624dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:13.322247 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c01f8-e1e9-41cf-bcba-9b84180624dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:13.323063 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c01f8-e1e9-41cf-bcba-9b84180624dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:13.323155 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1078/2163] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:13.323155 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1728e9-93ed-421e-b46a-efaf5fe067ad admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:13.329297 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c01f8-e1e9-41cf-bcba-9b84180624dc admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:13.330175 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1728e9-93ed-421e-b46a-efaf5fe067ad admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:13.336048 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80550acc-64f7-4dc7-9b98-764398e14911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:13.336761 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80550acc-64f7-4dc7-9b98-764398e14911 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:13.337122 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80550acc-64f7-4dc7-9b98-764398e14911 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:13.337746 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80550acc-64f7-4dc7-9b98-764398e14911 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:13.338222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80550acc-64f7-4dc7-9b98-764398e14911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:13.341422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80550acc-64f7-4dc7-9b98-764398e14911 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:13.353376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1086/2164] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:13.354337 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c01f8-e1e9-41cf-bcba-9b84180624dc admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:13.357396 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ed6c01f8-e1e9-41cf-bcba-9b84180624dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:13.439756 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c01f8-e1e9-41cf-bcba-9b84180624dc admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:13.444962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af47ce-0314-4bfa-a9a6-fdfe1864f2bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:13.445625 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af47ce-0314-4bfa-a9a6-fdfe1864f2bd service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:13.446704 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af47ce-0314-4bfa-a9a6-fdfe1864f2bd service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:13.446991 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af47ce-0314-4bfa-a9a6-fdfe1864f2bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:13.456929 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af47ce-0314-4bfa-a9a6-fdfe1864f2bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:13.458510 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af47ce-0314-4bfa-a9a6-fdfe1864f2bd service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:13.473953 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1087/2165] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:13.474117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af47ce-0314-4bfa-a9a6-fdfe1864f2bd service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:13.481534 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1079/2166] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:58:13 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:13.484420 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80550acc-64f7-4dc7-9b98-764398e14911 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:13.490486 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af47ce-0314-4bfa-a9a6-fdfe1864f2bd service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:13.497684 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc51d9-ff3d-4dfe-acbe-98e2b029e9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:13.498474 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc51d9-ff3d-4dfe-acbe-98e2b029e9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:13.498763 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc51d9-ff3d-4dfe-acbe-98e2b029e9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:13.499040 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc51d9-ff3d-4dfe-acbe-98e2b029e9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:13.499813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc51d9-ff3d-4dfe-acbe-98e2b029e9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:13.500401 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80550acc-64f7-4dc7-9b98-764398e14911 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:13.501637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc51d9-ff3d-4dfe-acbe-98e2b029e9d7 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:13.510598 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ed5a4-a81c-4938-8a02-7f9dfbe80782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:13.516014 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ed5a4-a81c-4938-8a02-7f9dfbe80782 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:13.516014 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ed5a4-a81c-4938-8a02-7f9dfbe80782 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:13.516014 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ed5a4-a81c-4938-8a02-7f9dfbe80782 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:13.516014 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ed5a4-a81c-4938-8a02-7f9dfbe80782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:13.516014 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ed5a4-a81c-4938-8a02-7f9dfbe80782 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:13.518938 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1088/2167] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:13.519925 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc51d9-ff3d-4dfe-acbe-98e2b029e9d7 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:13.530522 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc51d9-ff3d-4dfe-acbe-98e2b029e9d7 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:13.533662 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1080/2168] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:13.534587 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ed5a4-a81c-4938-8a02-7f9dfbe80782 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:13.544853 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bcfbc-367f-4a81-9f33-86f956e58b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:13.546155 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ed5a4-a81c-4938-8a02-7f9dfbe80782 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:13.546356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bcfbc-367f-4a81-9f33-86f956e58b13 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:13.546954 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bcfbc-367f-4a81-9f33-86f956e58b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:13.547616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bcfbc-367f-4a81-9f33-86f956e58b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:13.548856 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bcfbc-367f-4a81-9f33-86f956e58b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:13.552169 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514dc72-f633-459a-a6e3-b6815a69ebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:13.553314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514dc72-f633-459a-a6e3-b6815a69ebeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:13.558185 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514dc72-f633-459a-a6e3-b6815a69ebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:13.558185 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514dc72-f633-459a-a6e3-b6815a69ebeb admin admin] PATH_INFO: `/v3/users/1d0a337ad1394a96bd2478db5c1f7fba` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:13.558185 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514dc72-f633-459a-a6e3-b6815a69ebeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d0a337ad1394a96bd2478db5c1f7fba)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:13.558496 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514dc72-f633-459a-a6e3-b6815a69ebeb admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:13.571158 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bcfbc-367f-4a81-9f33-86f956e58b13 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:13.600181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1089/2169] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:13.601572 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bcfbc-367f-4a81-9f33-86f956e58b13 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:13.619581 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bcfbc-367f-4a81-9f33-86f956e58b13 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:13.635650 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4936-4cf8-41a1-8075-197dd404b05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:13.637898 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4936-4cf8-41a1-8075-197dd404b05e admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:13.639107 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4936-4cf8-41a1-8075-197dd404b05e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:13.639655 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4936-4cf8-41a1-8075-197dd404b05e admin admin] PATH_INFO: `/v3/projects/a722a831444840338a0ad039c978f78e/users/5083ed10d64f44e88c764af6b89bc055/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:13.670705 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b4936-4cf8-41a1-8075-197dd404b05e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a722a831444840338a0ad039c978f78e, user_id=5083ed10d64f44e88c764af6b89bc055, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:13.674136 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b4936-4cf8-41a1-8075-197dd404b05e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:13.730882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3514dc72-f633-459a-a6e3-b6815a69ebeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d0a337ad1394a96bd2478db5c1f7fba'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:13.731905 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3514dc72-f633-459a-a6e3-b6815a69ebeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d0a337ad1394a96bd2478db5c1f7fba'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:13.757580 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3514dc72-f633-459a-a6e3-b6815a69ebeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d0a337ad1394a96bd2478db5c1f7fba'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:13.776675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3514dc72-f633-459a-a6e3-b6815a69ebeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d0a337ad1394a96bd2478db5c1f7fba'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:13.776675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3514dc72-f633-459a-a6e3-b6815a69ebeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d0a337ad1394a96bd2478db5c1f7fba'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:13.816626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1090/2170] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:13 2022] PUT /identity/v3/projects/a722a831444840338a0ad039c978f78e/users/5083ed10d64f44e88c764af6b89bc055/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:13.818193 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4936-4cf8-41a1-8075-197dd404b05e admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:13.820964 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-de7b4936-4cf8-41a1-8075-197dd404b05e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:13.900353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1081/2171] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:13 2022] DELETE /identity/v3/users/1d0a337ad1394a96bd2478db5c1f7fba => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:13.901620 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514dc72-f633-459a-a6e3-b6815a69ebeb admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:13.903469 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-3514dc72-f633-459a-a6e3-b6815a69ebeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:13.929850 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4936-4cf8-41a1-8075-197dd404b05e admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:13.991156 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514dc72-f633-459a-a6e3-b6815a69ebeb admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:13.997438 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41572e8-e557-4734-9134-2c9bdd9e4731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:13.998283 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41572e8-e557-4734-9134-2c9bdd9e4731 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:13.998637 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41572e8-e557-4734-9134-2c9bdd9e4731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:13.998981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41572e8-e557-4734-9134-2c9bdd9e4731 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:13.999831 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41572e8-e557-4734-9134-2c9bdd9e4731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:14.001538 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41572e8-e557-4734-9134-2c9bdd9e4731 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:14.002239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7bee1-d3ba-45c7-9e70-b8b8d6cfd32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:14.003296 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7bee1-d3ba-45c7-9e70-b8b8d6cfd32b admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:14.003607 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7bee1-d3ba-45c7-9e70-b8b8d6cfd32b admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:14.004122 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7bee1-d3ba-45c7-9e70-b8b8d6cfd32b admin admin] PATH_INFO: `/v3/projects/aff3ead5693f4968ba8b017a37de9515/users/e36f70bd4f934b35b4eea53f7914865a/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:14.013532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1082/2172] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:14.015143 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3edf8f-c657-4908-bcc1-3334bad46772 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:14.015433 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3edf8f-c657-4908-bcc1-3334bad46772 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:14.015725 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3edf8f-c657-4908-bcc1-3334bad46772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:14.025876 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7bee1-d3ba-45c7-9e70-b8b8d6cfd32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff3ead5693f4968ba8b017a37de9515, user_id=e36f70bd4f934b35b4eea53f7914865a, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:14.029117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7bee1-d3ba-45c7-9e70-b8b8d6cfd32b admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:14.049873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-5c3edf8f-c657-4908-bcc1-3334bad46772 None None] MFA Rules not processed for user `5083ed10d64f44e88c764af6b89bc055`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:14.051860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5c3edf8f-c657-4908-bcc1-3334bad46772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:14.122955 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1083/2173] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:14.124393 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a6b62-73bf-4c84-a7a9-7d645156c949 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:14.124832 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a6b62-73bf-4c84-a7a9-7d645156c949 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:14.125172 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a6b62-73bf-4c84-a7a9-7d645156c949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:14.143985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-fe2a6b62-73bf-4c84-a7a9-7d645156c949 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:14.146069 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-fe2a6b62-73bf-4c84-a7a9-7d645156c949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:14.169320 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1084/2174] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:14.169320 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a6b62-73bf-4c84-a7a9-7d645156c949 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:14.177263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a6b62-73bf-4c84-a7a9-7d645156c949 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:14.182760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65786ed-8739-47f0-8618-cd1d031a5859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:14.183745 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65786ed-8739-47f0-8618-cd1d031a5859 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:14.184026 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65786ed-8739-47f0-8618-cd1d031a5859 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:14.184295 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65786ed-8739-47f0-8618-cd1d031a5859 admin admin] PATH_INFO: `/v3/projects/da408bef149e4417a6bfb1a30862ab9b/users/9f9fa464ad1347b7989f0fe8e018e1d9/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:14.200534 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65786ed-8739-47f0-8618-cd1d031a5859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da408bef149e4417a6bfb1a30862ab9b, user_id=9f9fa464ad1347b7989f0fe8e018e1d9, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:14.203377 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65786ed-8739-47f0-8618-cd1d031a5859 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:14.245054 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1091/2175] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:13 2022] PUT /identity/v3/projects/aff3ead5693f4968ba8b017a37de9515/users/e36f70bd4f934b35b4eea53f7914865a/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:14.246440 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7bee1-d3ba-45c7-9e70-b8b8d6cfd32b admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:14.248400 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-87c7bee1-d3ba-45c7-9e70-b8b8d6cfd32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:14.312806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1085/2176] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:14 2022] PUT /identity/v3/projects/da408bef149e4417a6bfb1a30862ab9b/users/9f9fa464ad1347b7989f0fe8e018e1d9/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:14.312806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65786ed-8739-47f0-8618-cd1d031a5859 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:14.312806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c65786ed-8739-47f0-8618-cd1d031a5859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:14.333349 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7bee1-d3ba-45c7-9e70-b8b8d6cfd32b admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:14.390283 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65786ed-8739-47f0-8618-cd1d031a5859 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:14.397128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f34aa-9fae-4822-a33d-7224eb5c3ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:14.398099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f34aa-9fae-4822-a33d-7224eb5c3ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:14.400113 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f34aa-9fae-4822-a33d-7224eb5c3ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:14.400113 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f34aa-9fae-4822-a33d-7224eb5c3ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:14.405484 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd44206-15fa-42fd-94e2-cf2f56fbd259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:14.406136 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd44206-15fa-42fd-94e2-cf2f56fbd259 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:14.406418 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd44206-15fa-42fd-94e2-cf2f56fbd259 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:14.406684 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd44206-15fa-42fd-94e2-cf2f56fbd259 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:14.407526 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd44206-15fa-42fd-94e2-cf2f56fbd259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:14.409572 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd44206-15fa-42fd-94e2-cf2f56fbd259 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:14.495400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f34aa-9fae-4822-a33d-7224eb5c3ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:14.497149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f34aa-9fae-4822-a33d-7224eb5c3ce8 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:14.508790 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1086/2177] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:14.510157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3ad5c-668b-4b5d-9fb7-6bdd65b10a3e None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:14.510463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3ad5c-668b-4b5d-9fb7-6bdd65b10a3e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:14.510726 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3ad5c-668b-4b5d-9fb7-6bdd65b10a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:14.540493 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d6d3ad5c-668b-4b5d-9fb7-6bdd65b10a3e None None] MFA Rules not processed for user `e36f70bd4f934b35b4eea53f7914865a`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:14.541754 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d6d3ad5c-668b-4b5d-9fb7-6bdd65b10a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:14.601778 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1092/2178] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:58:14 2022] POST /identity/v3/projects => generated 383 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:14.606309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e319b-00c5-4f87-9dcc-a18ef04ac2a7 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:14.606309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e319b-00c5-4f87-9dcc-a18ef04ac2a7 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:14.606309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e319b-00c5-4f87-9dcc-a18ef04ac2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:14.659596 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1087/2179] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:14.661481 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3ad5c-668b-4b5d-9fb7-6bdd65b10a3e None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:14.679659 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-fa8e319b-00c5-4f87-9dcc-a18ef04ac2a7 None None] MFA Rules not processed for user `9f9fa464ad1347b7989f0fe8e018e1d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:14.681442 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-fa8e319b-00c5-4f87-9dcc-a18ef04ac2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:14.681875 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3ad5c-668b-4b5d-9fb7-6bdd65b10a3e None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:14.779899 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1093/2180] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:14.779899 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e319b-00c5-4f87-9dcc-a18ef04ac2a7 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:14.780279 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-fa8e319b-00c5-4f87-9dcc-a18ef04ac2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:14.804170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8d515-b9d3-4087-b5b6-000da106823d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:14.804170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8d515-b9d3-4087-b5b6-000da106823d admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:14.804170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8d515-b9d3-4087-b5b6-000da106823d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:14.804170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8d515-b9d3-4087-b5b6-000da106823d admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:14.804935 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8d515-b9d3-4087-b5b6-000da106823d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:14.804935 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8d515-b9d3-4087-b5b6-000da106823d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:14.897750 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e319b-00c5-4f87-9dcc-a18ef04ac2a7 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:14.905139 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545e402-4270-4fca-9b93-2b97e085172a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:14.905997 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e402-4270-4fca-9b93-2b97e085172a service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:14.906392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e402-4270-4fca-9b93-2b97e085172a service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:14.906766 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e402-4270-4fca-9b93-2b97e085172a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:14.983214 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1088/2181] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:58:14 2022] POST /identity/v3/users => generated 298 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:14.983392 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8d515-b9d3-4087-b5b6-000da106823d admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:15.010740 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8d515-b9d3-4087-b5b6-000da106823d admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:15.016184 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca1baa-e556-49fb-b45c-2a85248b2f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:15.016916 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca1baa-e556-49fb-b45c-2a85248b2f3d admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:15.017221 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca1baa-e556-49fb-b45c-2a85248b2f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:15.017498 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca1baa-e556-49fb-b45c-2a85248b2f3d admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:15.018390 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca1baa-e556-49fb-b45c-2a85248b2f3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:15.021326 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca1baa-e556-49fb-b45c-2a85248b2f3d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:15.029465 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545e402-4270-4fca-9b93-2b97e085172a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:15.037173 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545e402-4270-4fca-9b93-2b97e085172a service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:15.053541 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1094/2182] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:15.054755 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545e402-4270-4fca-9b93-2b97e085172a service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:15.068180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545e402-4270-4fca-9b93-2b97e085172a service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:15.074806 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcefad5-6cf1-479e-a620-815f0c07ffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:15.075602 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcefad5-6cf1-479e-a620-815f0c07ffba admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:15.076094 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcefad5-6cf1-479e-a620-815f0c07ffba admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:15.076446 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcefad5-6cf1-479e-a620-815f0c07ffba admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:15.077380 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcefad5-6cf1-479e-a620-815f0c07ffba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:15.079101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcefad5-6cf1-479e-a620-815f0c07ffba admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:15.093022 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1095/2183] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:15.097177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcefad5-6cf1-479e-a620-815f0c07ffba admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:15.112771 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcefad5-6cf1-479e-a620-815f0c07ffba admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:15.122239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb975b-d7b3-42c1-a128-1453d79d206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:15.123885 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb975b-d7b3-42c1-a128-1453d79d206c admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:15.123885 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb975b-d7b3-42c1-a128-1453d79d206c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:15.123885 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb975b-d7b3-42c1-a128-1453d79d206c admin admin] PATH_INFO: `/v3/projects/dfba87b709b543698027450cbd1a7cbe/users/4c2817199f424699aa9b8162985cb3e9/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:15.126096 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1089/2184] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:58:14 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:15.133879 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca1baa-e556-49fb-b45c-2a85248b2f3d admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:15.157585 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb975b-d7b3-42c1-a128-1453d79d206c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfba87b709b543698027450cbd1a7cbe, user_id=4c2817199f424699aa9b8162985cb3e9, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:15.162200 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb975b-d7b3-42c1-a128-1453d79d206c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:15.233527 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1096/2185] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:15 2022] PUT /identity/v3/projects/dfba87b709b543698027450cbd1a7cbe/users/4c2817199f424699aa9b8162985cb3e9/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:58:15.238451 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca1baa-e556-49fb-b45c-2a85248b2f3d admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:15.238733 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb975b-d7b3-42c1-a128-1453d79d206c admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:15.314958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5183e03-2b1a-4d40-9e2c-31fc31b70350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:15.315797 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5183e03-2b1a-4d40-9e2c-31fc31b70350 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:15.316736 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5183e03-2b1a-4d40-9e2c-31fc31b70350 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:15.317012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5183e03-2b1a-4d40-9e2c-31fc31b70350 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:15.317713 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5183e03-2b1a-4d40-9e2c-31fc31b70350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:15.319710 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5183e03-2b1a-4d40-9e2c-31fc31b70350 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:15.332488 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb975b-d7b3-42c1-a128-1453d79d206c admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:15.339497 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd296664-6def-4158-b1fe-ac867df8422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:15.340180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd296664-6def-4158-b1fe-ac867df8422f admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:15.340463 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd296664-6def-4158-b1fe-ac867df8422f admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:15.340772 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd296664-6def-4158-b1fe-ac867df8422f admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:15.341510 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd296664-6def-4158-b1fe-ac867df8422f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:15.343182 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd296664-6def-4158-b1fe-ac867df8422f admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:15.353487 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1097/2186] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:15.357673 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd296664-6def-4158-b1fe-ac867df8422f admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:15.367511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd296664-6def-4158-b1fe-ac867df8422f admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:15.372131 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550a525-58af-4edb-b57d-8d3386bed348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:15.373072 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550a525-58af-4edb-b57d-8d3386bed348 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:15.373349 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550a525-58af-4edb-b57d-8d3386bed348 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:15.373621 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550a525-58af-4edb-b57d-8d3386bed348 admin admin] PATH_INFO: `/v3/projects/dfba87b709b543698027450cbd1a7cbe/users/4c2817199f424699aa9b8162985cb3e9/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:15.375606 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550a525-58af-4edb-b57d-8d3386bed348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfba87b709b543698027450cbd1a7cbe, user_id=4c2817199f424699aa9b8162985cb3e9, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:15.378288 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550a525-58af-4edb-b57d-8d3386bed348 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:15.389313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1098/2187] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:15 2022] PUT /identity/v3/projects/dfba87b709b543698027450cbd1a7cbe/users/4c2817199f424699aa9b8162985cb3e9/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:58:15.400152 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dd960-2b19-4ce2-b927-1f51a964f22b None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:15.400435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dd960-2b19-4ce2-b927-1f51a964f22b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:15.400739 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dd960-2b19-4ce2-b927-1f51a964f22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:15.430388 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-596dd960-2b19-4ce2-b927-1f51a964f22b None None] MFA Rules not processed for user `4c2817199f424699aa9b8162985cb3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:15.431665 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-596dd960-2b19-4ce2-b927-1f51a964f22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:15.471145 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1090/2188] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:58:15 2022] POST /identity/v3/users => generated 298 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:15.475290 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5183e03-2b1a-4d40-9e2c-31fc31b70350 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:15.486848 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5183e03-2b1a-4d40-9e2c-31fc31b70350 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:15.527208 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1099/2189] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:58:15.528557 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dd960-2b19-4ce2-b927-1f51a964f22b None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:15.535573 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-596dd960-2b19-4ce2-b927-1f51a964f22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:15.585463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375c0cc-f100-4295-8d81-b674861bc373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:15.586324 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375c0cc-f100-4295-8d81-b674861bc373 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:15.586488 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375c0cc-f100-4295-8d81-b674861bc373 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:15.586734 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375c0cc-f100-4295-8d81-b674861bc373 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:15.587421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375c0cc-f100-4295-8d81-b674861bc373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:15.589070 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375c0cc-f100-4295-8d81-b674861bc373 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:15.601142 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1091/2190] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:15.602198 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375c0cc-f100-4295-8d81-b674861bc373 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:15.604103 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1375c0cc-f100-4295-8d81-b674861bc373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:15.648631 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dd960-2b19-4ce2-b927-1f51a964f22b None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:15.656194 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724916ab-009d-4b2b-bb85-95bfcfb4626c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:15.657287 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724916ab-009d-4b2b-bb85-95bfcfb4626c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:15.657583 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724916ab-009d-4b2b-bb85-95bfcfb4626c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:15.657930 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724916ab-009d-4b2b-bb85-95bfcfb4626c admin admin] PATH_INFO: `/v3/projects/a17d1274e5e94ba487aa3e8cc4f99475` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:15.660728 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724916ab-009d-4b2b-bb85-95bfcfb4626c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a17d1274e5e94ba487aa3e8cc4f99475)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:15.663831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724916ab-009d-4b2b-bb85-95bfcfb4626c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:15.694644 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375c0cc-f100-4295-8d81-b674861bc373 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:15.698895 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec27a9-61f9-41ad-bd27-125a650ae9a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:15.699570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec27a9-61f9-41ad-bd27-125a650ae9a8 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:15.699855 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec27a9-61f9-41ad-bd27-125a650ae9a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:15.700129 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec27a9-61f9-41ad-bd27-125a650ae9a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:15.714767 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec27a9-61f9-41ad-bd27-125a650ae9a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:15.716308 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec27a9-61f9-41ad-bd27-125a650ae9a8 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:15.730432 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1092/2191] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:15.731363 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec27a9-61f9-41ad-bd27-125a650ae9a8 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:15.746979 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec27a9-61f9-41ad-bd27-125a650ae9a8 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:15.753115 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad3a36-0f06-4c0d-ae3a-39c138072c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:15.760975 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad3a36-0f06-4c0d-ae3a-39c138072c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:15.760975 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad3a36-0f06-4c0d-ae3a-39c138072c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:15.760975 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad3a36-0f06-4c0d-ae3a-39c138072c4d admin admin] PATH_INFO: `/v3/projects/12f14c4216cf43d8a289a6c889298d49/users/4078602367694da4b8faff08db86c3b6/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:15.778031 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad3a36-0f06-4c0d-ae3a-39c138072c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f14c4216cf43d8a289a6c889298d49, user_id=4078602367694da4b8faff08db86c3b6, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:15.781801 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad3a36-0f06-4c0d-ae3a-39c138072c4d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:15.917280 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1093/2192] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:15 2022] PUT /identity/v3/projects/12f14c4216cf43d8a289a6c889298d49/users/4078602367694da4b8faff08db86c3b6/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:15.921160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad3a36-0f06-4c0d-ae3a-39c138072c4d admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:15.937106 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-724916ab-009d-4b2b-bb85-95bfcfb4626c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a17d1274e5e94ba487aa3e8cc4f99475', 'request_id': 'req-724916ab-009d-4b2b-bb85-95bfcfb4626c'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:16.039123 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-724916ab-009d-4b2b-bb85-95bfcfb4626c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a17d1274e5e94ba487aa3e8cc4f99475', 'request_id': 'req-724916ab-009d-4b2b-bb85-95bfcfb4626c'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:16.056613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-724916ab-009d-4b2b-bb85-95bfcfb4626c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a17d1274e5e94ba487aa3e8cc4f99475', 'request_id': 'req-724916ab-009d-4b2b-bb85-95bfcfb4626c'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:16.091451 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-724916ab-009d-4b2b-bb85-95bfcfb4626c admin admin] The token cache is being invalidate because project a17d1274e5e94ba487aa3e8cc4f99475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:16.093262 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad3a36-0f06-4c0d-ae3a-39c138072c4d admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:16.093804 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-724916ab-009d-4b2b-bb85-95bfcfb4626c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:16.095878 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-724916ab-009d-4b2b-bb85-95bfcfb4626c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:16.104310 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1100/2193] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:15 2022] DELETE /identity/v3/projects/a17d1274e5e94ba487aa3e8cc4f99475 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:16.109241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b4fd9-1fb0-4d51-ae86-55200bc9dd82 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:16.109981 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b4fd9-1fb0-4d51-ae86-55200bc9dd82 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:16.110620 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b4fd9-1fb0-4d51-ae86-55200bc9dd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:16.151145 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-f82b4fd9-1fb0-4d51-ae86-55200bc9dd82 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:16.154120 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f82b4fd9-1fb0-4d51-ae86-55200bc9dd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:16.263010 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913ef23-f70a-470e-9235-73af44fe17ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:16.263708 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913ef23-f70a-470e-9235-73af44fe17ed admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:16.263988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913ef23-f70a-470e-9235-73af44fe17ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:16.264589 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1101/2194] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:16.265909 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b4fd9-1fb0-4d51-ae86-55200bc9dd82 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:16.267392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f82b4fd9-1fb0-4d51-ae86-55200bc9dd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:16.271847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913ef23-f70a-470e-9235-73af44fe17ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:16.272899 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913ef23-f70a-470e-9235-73af44fe17ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:16.274540 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913ef23-f70a-470e-9235-73af44fe17ed admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:16.289490 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1094/2195] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:16.289490 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaf995-fc40-4e57-ab12-d5f3f42cfcf7 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:16.289490 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaf995-fc40-4e57-ab12-d5f3f42cfcf7 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:16.289490 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaf995-fc40-4e57-ab12-d5f3f42cfcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:16.311813 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-dabaf995-fc40-4e57-ab12-d5f3f42cfcf7 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:16.311813 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-dabaf995-fc40-4e57-ab12-d5f3f42cfcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:16.326098 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1095/2196] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:16.327430 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabaf995-fc40-4e57-ab12-d5f3f42cfcf7 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:16.329044 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-dabaf995-fc40-4e57-ab12-d5f3f42cfcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:16.344755 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabaf995-fc40-4e57-ab12-d5f3f42cfcf7 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:16.356143 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6560c-579c-40ed-afe9-a2ab78dfb37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:16.357597 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6560c-579c-40ed-afe9-a2ab78dfb37f admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:16.357883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6560c-579c-40ed-afe9-a2ab78dfb37f admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:16.358179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6560c-579c-40ed-afe9-a2ab78dfb37f admin admin] PATH_INFO: `/v3/projects/12f14c4216cf43d8a289a6c889298d49/users/4078602367694da4b8faff08db86c3b6/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:16.360845 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6560c-579c-40ed-afe9-a2ab78dfb37f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f14c4216cf43d8a289a6c889298d49, user_id=4078602367694da4b8faff08db86c3b6, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:16.380265 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b4fd9-1fb0-4d51-ae86-55200bc9dd82 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:16.386028 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6560c-579c-40ed-afe9-a2ab78dfb37f admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:16.388153 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd99855-8788-46d1-8a5c-fff11232a504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:16.389257 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd99855-8788-46d1-8a5c-fff11232a504 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:16.389875 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd99855-8788-46d1-8a5c-fff11232a504 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:16.390253 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd99855-8788-46d1-8a5c-fff11232a504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:16.393411 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-cbd99855-8788-46d1-8a5c-fff11232a504 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:16.420881 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1096/2197] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:16 2022] PUT /identity/v3/projects/12f14c4216cf43d8a289a6c889298d49/users/4078602367694da4b8faff08db86c3b6/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:16.429511 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6560c-579c-40ed-afe9-a2ab78dfb37f admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:16.530086 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd99855-8788-46d1-8a5c-fff11232a504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:16.531726 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd99855-8788-46d1-8a5c-fff11232a504 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:16.545016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1102/2198] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:16.547455 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e01ac8-9f3b-46bd-8e51-dcf3429eb933 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:16.549915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e01ac8-9f3b-46bd-8e51-dcf3429eb933 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:16.550226 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e01ac8-9f3b-46bd-8e51-dcf3429eb933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:16.608782 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6560c-579c-40ed-afe9-a2ab78dfb37f admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:16.625408 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41fb76-0a58-4460-a9c0-d2422824ea30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:16.626297 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41fb76-0a58-4460-a9c0-d2422824ea30 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:16.627555 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41fb76-0a58-4460-a9c0-d2422824ea30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:16.628007 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41fb76-0a58-4460-a9c0-d2422824ea30 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:16.629015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41fb76-0a58-4460-a9c0-d2422824ea30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:58:16.630991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41fb76-0a58-4460-a9c0-d2422824ea30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:16.639756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41fb76-0a58-4460-a9c0-d2422824ea30 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:16.645840 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-76e01ac8-9f3b-46bd-8e51-dcf3429eb933 None None] MFA Rules not processed for user `4078602367694da4b8faff08db86c3b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:16.648351 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-76e01ac8-9f3b-46bd-8e51-dcf3429eb933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:16.671640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1097/2199] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:58:16.676924 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41fb76-0a58-4460-a9c0-d2422824ea30 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:16.696135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41fb76-0a58-4460-a9c0-d2422824ea30 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:16.717010 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796bbaf-06db-487e-953b-0ffe77ff702a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:16.718281 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796bbaf-06db-487e-953b-0ffe77ff702a admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:16.718566 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796bbaf-06db-487e-953b-0ffe77ff702a admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:16.719016 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796bbaf-06db-487e-953b-0ffe77ff702a admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:16.719740 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796bbaf-06db-487e-953b-0ffe77ff702a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:16.724209 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796bbaf-06db-487e-953b-0ffe77ff702a admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:16.798033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1103/2200] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:16.850258 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1098/2201] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:58:16 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:16.851519 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e01ac8-9f3b-46bd-8e51-dcf3429eb933 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:16.870744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e01ac8-9f3b-46bd-8e51-dcf3429eb933 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:16.921014 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796bbaf-06db-487e-953b-0ffe77ff702a admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:16.922839 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a796bbaf-06db-487e-953b-0ffe77ff702a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:17.023753 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997347d-965e-468d-bacb-b7bf3394e4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:17.024881 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997347d-965e-468d-bacb-b7bf3394e4fd admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:17.025316 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997347d-965e-468d-bacb-b7bf3394e4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:17.025842 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997347d-965e-468d-bacb-b7bf3394e4fd admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:17.029046 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997347d-965e-468d-bacb-b7bf3394e4fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:17.029921 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997347d-965e-468d-bacb-b7bf3394e4fd admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:17.048943 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796bbaf-06db-487e-953b-0ffe77ff702a admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:17.053803 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d661ae1-34fb-4d6f-8e00-610eac5ab758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:17.054467 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d661ae1-34fb-4d6f-8e00-610eac5ab758 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:17.054747 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d661ae1-34fb-4d6f-8e00-610eac5ab758 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:17.057903 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d661ae1-34fb-4d6f-8e00-610eac5ab758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:17.135661 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d661ae1-34fb-4d6f-8e00-610eac5ab758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:17.137914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d661ae1-34fb-4d6f-8e00-610eac5ab758 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:17.145864 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1104/2202] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:58:16 2022] POST /identity/v3/users => generated 287 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:17.151370 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997347d-965e-468d-bacb-b7bf3394e4fd admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:17.152478 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1099/2203] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:58:17.165322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997347d-965e-468d-bacb-b7bf3394e4fd admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:17.171134 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c7477-1761-403a-8567-de059a8fbb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:17.172047 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c7477-1761-403a-8567-de059a8fbb29 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:17.172424 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c7477-1761-403a-8567-de059a8fbb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:17.172836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c7477-1761-403a-8567-de059a8fbb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:17.174618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c7477-1761-403a-8567-de059a8fbb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:17.176462 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c7477-1761-403a-8567-de059a8fbb29 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:17.188152 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1105/2204] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:58:17.192760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d661ae1-34fb-4d6f-8e00-610eac5ab758 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:17.205602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d661ae1-34fb-4d6f-8e00-610eac5ab758 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:17.212177 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797145de-3ce9-45c7-b93e-4c8e21f7c675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:17.213200 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797145de-3ce9-45c7-b93e-4c8e21f7c675 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:17.213658 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797145de-3ce9-45c7-b93e-4c8e21f7c675 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:17.214073 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797145de-3ce9-45c7-b93e-4c8e21f7c675 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:17.215204 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797145de-3ce9-45c7-b93e-4c8e21f7c675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:17.217086 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797145de-3ce9-45c7-b93e-4c8e21f7c675 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:17.235169 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1100/2205] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:17.236391 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c7477-1761-403a-8567-de059a8fbb29 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:17.247720 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c7477-1761-403a-8567-de059a8fbb29 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:17.254983 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f49b00-2e09-4992-b007-8225a4cbbdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:17.256262 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f49b00-2e09-4992-b007-8225a4cbbdd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:17.256707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f49b00-2e09-4992-b007-8225a4cbbdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:17.257594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f49b00-2e09-4992-b007-8225a4cbbdd3 admin admin] PATH_INFO: `/v3/projects/f46eb89de2af4cf397780d5edbca27ad/users/31578f57fff04d8c8fc66631ab07fcc0/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:17.289509 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f49b00-2e09-4992-b007-8225a4cbbdd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f46eb89de2af4cf397780d5edbca27ad, user_id=31578f57fff04d8c8fc66631ab07fcc0, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:17.293065 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f49b00-2e09-4992-b007-8225a4cbbdd3 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:17.366591 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1106/2206] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:17 2022] PUT /identity/v3/projects/f46eb89de2af4cf397780d5edbca27ad/users/31578f57fff04d8c8fc66631ab07fcc0/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:17.373164 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71a76b-1178-45fd-a058-5cd38baec27d None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:17.373501 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71a76b-1178-45fd-a058-5cd38baec27d None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:17.373770 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71a76b-1178-45fd-a058-5cd38baec27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:17.397214 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-eb71a76b-1178-45fd-a058-5cd38baec27d None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:17.398500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-eb71a76b-1178-45fd-a058-5cd38baec27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:17.491126 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ae94-4ef2-4dc0-a877-2ac9eb082c21 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:17.492206 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ae94-4ef2-4dc0-a877-2ac9eb082c21 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:17.492770 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ae94-4ef2-4dc0-a877-2ac9eb082c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:17.504699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1101/2207] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:58:17.515584 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71a76b-1178-45fd-a058-5cd38baec27d None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:17.517140 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-eb71a76b-1178-45fd-a058-5cd38baec27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:17.530222 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-f497ae94-4ef2-4dc0-a877-2ac9eb082c21 None None] MFA Rules not processed for user `e36f70bd4f934b35b4eea53f7914865a`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:17.531746 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f497ae94-4ef2-4dc0-a877-2ac9eb082c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:17.590195 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71a76b-1178-45fd-a058-5cd38baec27d None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:17.597018 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f03a1-f732-41fa-a822-39ed738ec606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:17.602365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f03a1-f732-41fa-a822-39ed738ec606 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:17.602365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f03a1-f732-41fa-a822-39ed738ec606 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:17.602365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f03a1-f732-41fa-a822-39ed738ec606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:17.608853 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f03a1-f732-41fa-a822-39ed738ec606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:17.611658 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f03a1-f732-41fa-a822-39ed738ec606 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:17.623027 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1102/2208] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:17.639888 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1107/2209] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:19.368560 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f03a1-f732-41fa-a822-39ed738ec606 service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:19.395550 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f03a1-f732-41fa-a822-39ed738ec606 service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:19.431150 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84296058-6ca0-43a3-8b72-720bd1f0cfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:19.432253 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84296058-6ca0-43a3-8b72-720bd1f0cfe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:19.432548 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84296058-6ca0-43a3-8b72-720bd1f0cfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:19.432885 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84296058-6ca0-43a3-8b72-720bd1f0cfe1 admin admin] PATH_INFO: `/v3/users/9f9fa464ad1347b7989f0fe8e018e1d9` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:19.435736 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84296058-6ca0-43a3-8b72-720bd1f0cfe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f9fa464ad1347b7989f0fe8e018e1d9)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:19.437987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84296058-6ca0-43a3-8b72-720bd1f0cfe1 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:19.514532 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497ae94-4ef2-4dc0-a877-2ac9eb082c21 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:19.516917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f497ae94-4ef2-4dc0-a877-2ac9eb082c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:19.542884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497ae94-4ef2-4dc0-a877-2ac9eb082c21 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:19.548547 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a5cf4-e5fc-495d-995f-660900ef2819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:19.550997 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a5cf4-e5fc-495d-995f-660900ef2819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:19.550997 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a5cf4-e5fc-495d-995f-660900ef2819 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:19.550997 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a5cf4-e5fc-495d-995f-660900ef2819 admin admin] PATH_INFO: `/v3/users/8153df770a944c0cbb937c095cfb104b` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:19.552108 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a5cf4-e5fc-495d-995f-660900ef2819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8153df770a944c0cbb937c095cfb104b)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:19.553928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a5cf4-e5fc-495d-995f-660900ef2819 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:19.718262 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-84296058-6ca0-43a3-8b72-720bd1f0cfe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f9fa464ad1347b7989f0fe8e018e1d9'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:19.719627 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-84296058-6ca0-43a3-8b72-720bd1f0cfe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f9fa464ad1347b7989f0fe8e018e1d9'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:19.741278 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-84296058-6ca0-43a3-8b72-720bd1f0cfe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f9fa464ad1347b7989f0fe8e018e1d9'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:19.761741 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-84296058-6ca0-43a3-8b72-720bd1f0cfe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f9fa464ad1347b7989f0fe8e018e1d9'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:19.763772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-84296058-6ca0-43a3-8b72-720bd1f0cfe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f9fa464ad1347b7989f0fe8e018e1d9'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:19.829914 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-0e2a5cf4-e5fc-495d-995f-660900ef2819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8153df770a944c0cbb937c095cfb104b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:19.830745 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-0e2a5cf4-e5fc-495d-995f-660900ef2819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8153df770a944c0cbb937c095cfb104b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:19.871895 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-0e2a5cf4-e5fc-495d-995f-660900ef2819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8153df770a944c0cbb937c095cfb104b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:19.892610 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-0e2a5cf4-e5fc-495d-995f-660900ef2819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8153df770a944c0cbb937c095cfb104b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:19.894771 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-0e2a5cf4-e5fc-495d-995f-660900ef2819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8153df770a944c0cbb937c095cfb104b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:19.919918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1103/2210] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:19 2022] DELETE /identity/v3/users/9f9fa464ad1347b7989f0fe8e018e1d9 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:19.924844 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80babb0a-95aa-4e9f-83a3-2c3a33f2faa6 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:19.925151 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80babb0a-95aa-4e9f-83a3-2c3a33f2faa6 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:19.926008 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80babb0a-95aa-4e9f-83a3-2c3a33f2faa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:19.953726 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-80babb0a-95aa-4e9f-83a3-2c3a33f2faa6 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:19.955876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-80babb0a-95aa-4e9f-83a3-2c3a33f2faa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:20.011781 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1108/2211] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:19 2022] DELETE /identity/v3/users/8153df770a944c0cbb937c095cfb104b => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:58:20.017152 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a544e-9cc5-421f-bc13-e8c2e29f5849 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:20.017663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a544e-9cc5-421f-bc13-e8c2e29f5849 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:20.018298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a544e-9cc5-421f-bc13-e8c2e29f5849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:20.083170 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-226a544e-9cc5-421f-bc13-e8c2e29f5849 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:20.084475 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-226a544e-9cc5-421f-bc13-e8c2e29f5849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:20.117381 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1104/2212] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:20.122814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33600-18c9-41ea-b3af-4392937e4665 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:20.123108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33600-18c9-41ea-b3af-4392937e4665 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:20.123387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33600-18c9-41ea-b3af-4392937e4665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:20.178918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-7fd33600-18c9-41ea-b3af-4392937e4665 None None] MFA Rules not processed for user `31578f57fff04d8c8fc66631ab07fcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:20.180149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-7fd33600-18c9-41ea-b3af-4392937e4665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:20.233524 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1109/2213] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:20.235680 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a544e-9cc5-421f-bc13-e8c2e29f5849 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:20.242572 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-226a544e-9cc5-421f-bc13-e8c2e29f5849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:20.360603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1105/2214] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:20.362111 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd33600-18c9-41ea-b3af-4392937e4665 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:20.364243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-7fd33600-18c9-41ea-b3af-4392937e4665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:20.395096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a544e-9cc5-421f-bc13-e8c2e29f5849 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:20.402044 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74957a8c-5d54-4024-9a23-06fdaa43d608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:20.402720 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74957a8c-5d54-4024-9a23-06fdaa43d608 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:20.410113 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74957a8c-5d54-4024-9a23-06fdaa43d608 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:20.410113 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74957a8c-5d54-4024-9a23-06fdaa43d608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:20.418916 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74957a8c-5d54-4024-9a23-06fdaa43d608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:20.422681 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74957a8c-5d54-4024-9a23-06fdaa43d608 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:20.435213 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1110/2215] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:20.436550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf95d5-8c7b-4e50-83e1-51eecd16f568 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:20.437157 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf95d5-8c7b-4e50-83e1-51eecd16f568 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:20.437440 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf95d5-8c7b-4e50-83e1-51eecd16f568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:20.460821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd33600-18c9-41ea-b3af-4392937e4665 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:20.466063 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd79b0-94e3-4a56-80b1-c4e0e640d4a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:20.466737 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd79b0-94e3-4a56-80b1-c4e0e640d4a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:20.467019 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd79b0-94e3-4a56-80b1-c4e0e640d4a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:20.467300 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd79b0-94e3-4a56-80b1-c4e0e640d4a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:20.478527 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd79b0-94e3-4a56-80b1-c4e0e640d4a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:20.481710 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd79b0-94e3-4a56-80b1-c4e0e640d4a8 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:20.498091 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1106/2216] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:20.498340 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd79b0-94e3-4a56-80b1-c4e0e640d4a8 service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:20.500022 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-69bd79b0-94e3-4a56-80b1-c4e0e640d4a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:20.501766 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-bebf95d5-8c7b-4e50-83e1-51eecd16f568 None None] MFA Rules not processed for user `f7fe7ea486834f6e9e8a7685d9c36bac`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:20.504246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-bebf95d5-8c7b-4e50-83e1-51eecd16f568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:20.660431 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1111/2217] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:20.662376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf95d5-8c7b-4e50-83e1-51eecd16f568 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:20.663882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd79b0-94e3-4a56-80b1-c4e0e640d4a8 service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:20.664857 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-bebf95d5-8c7b-4e50-83e1-51eecd16f568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:20.679387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fca48-3725-4d94-90e1-8efe7cc2f6dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:20.680247 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fca48-3725-4d94-90e1-8efe7cc2f6dc service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:20.682687 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fca48-3725-4d94-90e1-8efe7cc2f6dc service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:20.683712 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fca48-3725-4d94-90e1-8efe7cc2f6dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:20.696745 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf95d5-8c7b-4e50-83e1-51eecd16f568 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:20.714050 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fca48-3725-4d94-90e1-8efe7cc2f6dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:20.715306 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b61540-62bd-42f0-96e3-fe051f4c1b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:20.716253 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fca48-3725-4d94-90e1-8efe7cc2f6dc service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:20.716641 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b61540-62bd-42f0-96e3-fe051f4c1b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:20.717072 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b61540-62bd-42f0-96e3-fe051f4c1b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:20.719259 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b61540-62bd-42f0-96e3-fe051f4c1b9a admin admin] PATH_INFO: `/v3/users/5083ed10d64f44e88c764af6b89bc055` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:20.719259 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b61540-62bd-42f0-96e3-fe051f4c1b9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5083ed10d64f44e88c764af6b89bc055)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:20.721689 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b61540-62bd-42f0-96e3-fe051f4c1b9a admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:20.739837 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1107/2218] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:20.755613 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fca48-3725-4d94-90e1-8efe7cc2f6dc service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:20.761043 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-8e2fca48-3725-4d94-90e1-8efe7cc2f6dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:20.958056 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fca48-3725-4d94-90e1-8efe7cc2f6dc service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:20.966801 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b9314-5dc4-404a-9807-c43ec7fac0d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:20.967290 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b9314-5dc4-404a-9807-c43ec7fac0d1 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:20.967624 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b9314-5dc4-404a-9807-c43ec7fac0d1 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:20.967900 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b9314-5dc4-404a-9807-c43ec7fac0d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:20.982266 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b9314-5dc4-404a-9807-c43ec7fac0d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:20.984562 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b9314-5dc4-404a-9807-c43ec7fac0d1 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:20.997539 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1108/2219] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:21.001377 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d9b61540-62bd-42f0-96e3-fe051f4c1b9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5083ed10d64f44e88c764af6b89bc055'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:21.005070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d9b61540-62bd-42f0-96e3-fe051f4c1b9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5083ed10d64f44e88c764af6b89bc055'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:21.024728 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d9b61540-62bd-42f0-96e3-fe051f4c1b9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5083ed10d64f44e88c764af6b89bc055'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:21.037314 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d9b61540-62bd-42f0-96e3-fe051f4c1b9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5083ed10d64f44e88c764af6b89bc055'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:21.038697 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d9b61540-62bd-42f0-96e3-fe051f4c1b9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5083ed10d64f44e88c764af6b89bc055'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:21.132709 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1112/2220] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:20 2022] DELETE /identity/v3/users/5083ed10d64f44e88c764af6b89bc055 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:21.139006 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c046e2d-ed0c-4a1e-ab77-038f047da969 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:21.139554 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c046e2d-ed0c-4a1e-ab77-038f047da969 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:21.139663 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c046e2d-ed0c-4a1e-ab77-038f047da969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:21.197048 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-8c046e2d-ed0c-4a1e-ab77-038f047da969 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:21.198909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-8c046e2d-ed0c-4a1e-ab77-038f047da969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:21.351499 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b61540-62bd-42f0-96e3-fe051f4c1b9a admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:21.352901 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d9b61540-62bd-42f0-96e3-fe051f4c1b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:21.368564 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1109/2221] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:21.377087 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b61540-62bd-42f0-96e3-fe051f4c1b9a admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:21.381726 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c046e2d-ed0c-4a1e-ab77-038f047da969 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:21.384278 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:21.385889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-8c046e2d-ed0c-4a1e-ab77-038f047da969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:21.401812 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:21.401812 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:21.401812 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c admin admin] PATH_INFO: `/v3/projects/da408bef149e4417a6bfb1a30862ab9b` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:21.401812 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da408bef149e4417a6bfb1a30862ab9b)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:21.401812 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:21.475465 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c046e2d-ed0c-4a1e-ab77-038f047da969 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:21.479983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc622d-75ca-420d-8393-dbb72c777d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:21.480868 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc622d-75ca-420d-8393-dbb72c777d42 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:21.481150 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc622d-75ca-420d-8393-dbb72c777d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:21.481417 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc622d-75ca-420d-8393-dbb72c777d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:21.497176 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc622d-75ca-420d-8393-dbb72c777d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:21.498812 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc622d-75ca-420d-8393-dbb72c777d42 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:21.511586 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1110/2222] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:21.511822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc622d-75ca-420d-8393-dbb72c777d42 service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:21.513295 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ecfc622d-75ca-420d-8393-dbb72c777d42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:21.529502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc622d-75ca-420d-8393-dbb72c777d42 service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:21.543023 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da408bef149e4417a6bfb1a30862ab9b', 'request_id': 'req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:21.614723 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b53196-12e7-43cb-a64d-e5db9ac36265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:21.616003 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b53196-12e7-43cb-a64d-e5db9ac36265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:21.616473 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b53196-12e7-43cb-a64d-e5db9ac36265 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:21.616975 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b53196-12e7-43cb-a64d-e5db9ac36265 admin admin] PATH_INFO: `/v3/projects/964a4184ca724d51b6fcd29dc91b2dad` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:21.619083 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b53196-12e7-43cb-a64d-e5db9ac36265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=964a4184ca724d51b6fcd29dc91b2dad)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:21.622776 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b53196-12e7-43cb-a64d-e5db9ac36265 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:21.650453 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da408bef149e4417a6bfb1a30862ab9b', 'request_id': 'req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:21.676104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da408bef149e4417a6bfb1a30862ab9b', 'request_id': 'req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:21.711912 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c admin admin] The token cache is being invalidate because project da408bef149e4417a6bfb1a30862ab9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:21.712453 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:21.713858 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:21.720023 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1113/2223] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:21 2022] DELETE /identity/v3/projects/da408bef149e4417a6bfb1a30862ab9b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:58:21.727656 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:21.727656 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:21.759637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0846f1-1544-4f1e-bf3c-11b66fec3b5c admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:21.767742 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956e647-ee77-4f0a-a8b6-d4e133aad044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:21.769823 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956e647-ee77-4f0a-a8b6-d4e133aad044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:21.770384 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956e647-ee77-4f0a-a8b6-d4e133aad044 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:21.770663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956e647-ee77-4f0a-a8b6-d4e133aad044 admin admin] PATH_INFO: `/v3/users/4078602367694da4b8faff08db86c3b6` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:21.772737 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956e647-ee77-4f0a-a8b6-d4e133aad044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4078602367694da4b8faff08db86c3b6)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:21.775208 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956e647-ee77-4f0a-a8b6-d4e133aad044 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:21.832098 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-f6b53196-12e7-43cb-a64d-e5db9ac36265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '964a4184ca724d51b6fcd29dc91b2dad', 'request_id': 'req-f6b53196-12e7-43cb-a64d-e5db9ac36265'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:21.963421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-f6b53196-12e7-43cb-a64d-e5db9ac36265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '964a4184ca724d51b6fcd29dc91b2dad', 'request_id': 'req-f6b53196-12e7-43cb-a64d-e5db9ac36265'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:21.983687 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-f6b53196-12e7-43cb-a64d-e5db9ac36265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '964a4184ca724d51b6fcd29dc91b2dad', 'request_id': 'req-f6b53196-12e7-43cb-a64d-e5db9ac36265'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:22.034393 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-f6b53196-12e7-43cb-a64d-e5db9ac36265 admin admin] The token cache is being invalidate because project 964a4184ca724d51b6fcd29dc91b2dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:22.034806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-f6b53196-12e7-43cb-a64d-e5db9ac36265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:22.037292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-f6b53196-12e7-43cb-a64d-e5db9ac36265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:22.040913 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1111/2224] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:21 2022] DELETE /identity/v3/projects/964a4184ca724d51b6fcd29dc91b2dad => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:22.103157 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-7956e647-ee77-4f0a-a8b6-d4e133aad044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4078602367694da4b8faff08db86c3b6'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:22.113906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-7956e647-ee77-4f0a-a8b6-d4e133aad044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4078602367694da4b8faff08db86c3b6'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:22.135798 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-7956e647-ee77-4f0a-a8b6-d4e133aad044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4078602367694da4b8faff08db86c3b6'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:22.148815 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-7956e647-ee77-4f0a-a8b6-d4e133aad044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4078602367694da4b8faff08db86c3b6'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:22.156401 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-7956e647-ee77-4f0a-a8b6-d4e133aad044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4078602367694da4b8faff08db86c3b6'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:22.254062 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b53196-12e7-43cb-a64d-e5db9ac36265 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:22.255987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f6b53196-12e7-43cb-a64d-e5db9ac36265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:22.264392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1114/2225] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:21 2022] DELETE /identity/v3/users/4078602367694da4b8faff08db86c3b6 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:58:22.396921 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b53196-12e7-43cb-a64d-e5db9ac36265 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:22.461773 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef9f90-bee5-47be-9e88-a58d93319e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:22.462643 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef9f90-bee5-47be-9e88-a58d93319e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:22.462922 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef9f90-bee5-47be-9e88-a58d93319e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:22.463190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef9f90-bee5-47be-9e88-a58d93319e97 admin admin] PATH_INFO: `/v3/projects/a722a831444840338a0ad039c978f78e` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:22.464709 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef9f90-bee5-47be-9e88-a58d93319e97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a722a831444840338a0ad039c978f78e)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:22.466633 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef9f90-bee5-47be-9e88-a58d93319e97 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:22.659424 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-edef9f90-bee5-47be-9e88-a58d93319e97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a722a831444840338a0ad039c978f78e', 'request_id': 'req-edef9f90-bee5-47be-9e88-a58d93319e97'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:22.856016 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-edef9f90-bee5-47be-9e88-a58d93319e97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a722a831444840338a0ad039c978f78e', 'request_id': 'req-edef9f90-bee5-47be-9e88-a58d93319e97'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:22.863784 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-edef9f90-bee5-47be-9e88-a58d93319e97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a722a831444840338a0ad039c978f78e', 'request_id': 'req-edef9f90-bee5-47be-9e88-a58d93319e97'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:22.877298 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-edef9f90-bee5-47be-9e88-a58d93319e97 admin admin] The token cache is being invalidate because project a722a831444840338a0ad039c978f78e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:22.877572 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-edef9f90-bee5-47be-9e88-a58d93319e97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:22.878257 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-edef9f90-bee5-47be-9e88-a58d93319e97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:22.880368 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1112/2226] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:22 2022] DELETE /identity/v3/projects/a722a831444840338a0ad039c978f78e => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:58:22.884852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956e647-ee77-4f0a-a8b6-d4e133aad044 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:22.886781 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-7956e647-ee77-4f0a-a8b6-d4e133aad044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:22.892947 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef9f90-bee5-47be-9e88-a58d93319e97 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:22.897388 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-edef9f90-bee5-47be-9e88-a58d93319e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:22.952779 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956e647-ee77-4f0a-a8b6-d4e133aad044 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:23.020737 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef9f90-bee5-47be-9e88-a58d93319e97 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:23.026681 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69cdb63-aeec-48a0-be0b-9b8d2c020a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:23.027749 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cdb63-aeec-48a0-be0b-9b8d2c020a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:23.028140 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cdb63-aeec-48a0-be0b-9b8d2c020a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:23.028521 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cdb63-aeec-48a0-be0b-9b8d2c020a6b admin admin] PATH_INFO: `/v3/projects/12f14c4216cf43d8a289a6c889298d49` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:23.030117 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69cdb63-aeec-48a0-be0b-9b8d2c020a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f14c4216cf43d8a289a6c889298d49)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:23.033090 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69cdb63-aeec-48a0-be0b-9b8d2c020a6b admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:23.081685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fa7e8-6823-4025-9f8f-32109da53fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:23.086562 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fa7e8-6823-4025-9f8f-32109da53fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:23.088218 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fa7e8-6823-4025-9f8f-32109da53fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:23.089643 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fa7e8-6823-4025-9f8f-32109da53fbf admin admin] PATH_INFO: `/v3/users/4c2817199f424699aa9b8162985cb3e9` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:23.092955 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fa7e8-6823-4025-9f8f-32109da53fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c2817199f424699aa9b8162985cb3e9)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:23.099340 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fa7e8-6823-4025-9f8f-32109da53fbf admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:23.270884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-f69cdb63-aeec-48a0-be0b-9b8d2c020a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f14c4216cf43d8a289a6c889298d49', 'request_id': 'req-f69cdb63-aeec-48a0-be0b-9b8d2c020a6b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:23.373006 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-7b4fa7e8-6823-4025-9f8f-32109da53fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c2817199f424699aa9b8162985cb3e9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:23.373806 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-7b4fa7e8-6823-4025-9f8f-32109da53fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c2817199f424699aa9b8162985cb3e9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:23.382114 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-f69cdb63-aeec-48a0-be0b-9b8d2c020a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f14c4216cf43d8a289a6c889298d49', 'request_id': 'req-f69cdb63-aeec-48a0-be0b-9b8d2c020a6b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:23.391926 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-f69cdb63-aeec-48a0-be0b-9b8d2c020a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f14c4216cf43d8a289a6c889298d49', 'request_id': 'req-f69cdb63-aeec-48a0-be0b-9b8d2c020a6b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:23.393690 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-7b4fa7e8-6823-4025-9f8f-32109da53fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c2817199f424699aa9b8162985cb3e9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:23.413491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-7b4fa7e8-6823-4025-9f8f-32109da53fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c2817199f424699aa9b8162985cb3e9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:23.415047 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-7b4fa7e8-6823-4025-9f8f-32109da53fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c2817199f424699aa9b8162985cb3e9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:23.426893 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-f69cdb63-aeec-48a0-be0b-9b8d2c020a6b admin admin] The token cache is being invalidate because project 12f14c4216cf43d8a289a6c889298d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:23.428261 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-f69cdb63-aeec-48a0-be0b-9b8d2c020a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:23.429108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-f69cdb63-aeec-48a0-be0b-9b8d2c020a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:23.437865 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1113/2227] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:22 2022] DELETE /identity/v3/projects/12f14c4216cf43d8a289a6c889298d49 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:23.440557 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174263ca-a24f-44e1-8c46-f58337378aa3 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:23.440897 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174263ca-a24f-44e1-8c46-f58337378aa3 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:23.441878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174263ca-a24f-44e1-8c46-f58337378aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:23.464176 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-174263ca-a24f-44e1-8c46-f58337378aa3 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:23.467231 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-174263ca-a24f-44e1-8c46-f58337378aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:23.537962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1115/2228] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:22 2022] DELETE /identity/v3/users/4c2817199f424699aa9b8162985cb3e9 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:23.572153 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1114/2229] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:23.580331 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe70dc-04db-482b-b9b5-5f642699bc45 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:23.580860 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe70dc-04db-482b-b9b5-5f642699bc45 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:23.581260 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe70dc-04db-482b-b9b5-5f642699bc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:23.611795 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-27fe70dc-04db-482b-b9b5-5f642699bc45 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:23.614372 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-27fe70dc-04db-482b-b9b5-5f642699bc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:23.781340 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1116/2230] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:23.786613 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174263ca-a24f-44e1-8c46-f58337378aa3 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:23.836675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174263ca-a24f-44e1-8c46-f58337378aa3 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:23.855983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c203ab-a546-4c39-96ab-94a5137e2c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:23.857807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c203ab-a546-4c39-96ab-94a5137e2c8b admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:23.858403 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c203ab-a546-4c39-96ab-94a5137e2c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:23.860430 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c203ab-a546-4c39-96ab-94a5137e2c8b admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:23.862330 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c203ab-a546-4c39-96ab-94a5137e2c8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:58:23.863691 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c203ab-a546-4c39-96ab-94a5137e2c8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:23.869442 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c203ab-a546-4c39-96ab-94a5137e2c8b admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:23.914029 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1115/2231] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:58:23.921497 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe70dc-04db-482b-b9b5-5f642699bc45 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:23.946687 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe70dc-04db-482b-b9b5-5f642699bc45 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:23.953519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346fec6-abe9-4ce5-b006-ae2bae57adf5 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:23.954092 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346fec6-abe9-4ce5-b006-ae2bae57adf5 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:23.954473 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346fec6-abe9-4ce5-b006-ae2bae57adf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:23.965849 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc80c02-8ea8-46a4-bcb1-c2ab922f3643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:23.967013 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc80c02-8ea8-46a4-bcb1-c2ab922f3643 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:23.967512 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc80c02-8ea8-46a4-bcb1-c2ab922f3643 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:23.967999 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc80c02-8ea8-46a4-bcb1-c2ab922f3643 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:23.969106 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc80c02-8ea8-46a4-bcb1-c2ab922f3643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:23.971686 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc80c02-8ea8-46a4-bcb1-c2ab922f3643 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:23.998236 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-8346fec6-abe9-4ce5-b006-ae2bae57adf5 None None] MFA Rules not processed for user `31578f57fff04d8c8fc66631ab07fcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:23.999502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-8346fec6-abe9-4ce5-b006-ae2bae57adf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:24.088912 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1116/2232] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:58:24.138011 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1117/2233] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:58:23 2022] POST /identity/v3/projects => generated 373 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:24.143129 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346fec6-abe9-4ce5-b006-ae2bae57adf5 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:24.161683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346fec6-abe9-4ce5-b006-ae2bae57adf5 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:24.286226 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268e5b5-1035-4a22-a155-0d31ebaa7725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:24.287075 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268e5b5-1035-4a22-a155-0d31ebaa7725 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:24.287358 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268e5b5-1035-4a22-a155-0d31ebaa7725 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:24.288411 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268e5b5-1035-4a22-a155-0d31ebaa7725 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:24.288541 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268e5b5-1035-4a22-a155-0d31ebaa7725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:24.290761 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268e5b5-1035-4a22-a155-0d31ebaa7725 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:24.422190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1117/2234] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:58:24 2022] POST /identity/v3/users => generated 287 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:24.426779 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc80c02-8ea8-46a4-bcb1-c2ab922f3643 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:24.443260 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc80c02-8ea8-46a4-bcb1-c2ab922f3643 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:24.452357 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eeee17-f666-4c2d-a7fb-3e3d4317c180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:24.455766 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeee17-f666-4c2d-a7fb-3e3d4317c180 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:24.455766 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeee17-f666-4c2d-a7fb-3e3d4317c180 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:24.455766 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeee17-f666-4c2d-a7fb-3e3d4317c180 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:24.456053 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eeee17-f666-4c2d-a7fb-3e3d4317c180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:24.458522 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eeee17-f666-4c2d-a7fb-3e3d4317c180 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:24.483243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1118/2235] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:24.483351 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268e5b5-1035-4a22-a155-0d31ebaa7725 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:24.532967 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268e5b5-1035-4a22-a155-0d31ebaa7725 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:24.575185 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1c1b5-730b-4228-92f9-295d186b73ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:24.576434 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1c1b5-730b-4228-92f9-295d186b73ae admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:24.578032 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1c1b5-730b-4228-92f9-295d186b73ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:24.578294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1c1b5-730b-4228-92f9-295d186b73ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:24.582148 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1c1b5-730b-4228-92f9-295d186b73ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:24.598013 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1c1b5-730b-4228-92f9-295d186b73ae admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:24.635766 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1118/2236] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:24.636531 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eeee17-f666-4c2d-a7fb-3e3d4317c180 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:24.651638 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eeee17-f666-4c2d-a7fb-3e3d4317c180 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:24.657255 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e4c8d-735b-4025-8ead-91f68d3b939f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:24.658177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e4c8d-735b-4025-8ead-91f68d3b939f admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:24.658458 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e4c8d-735b-4025-8ead-91f68d3b939f admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:24.658800 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e4c8d-735b-4025-8ead-91f68d3b939f admin admin] PATH_INFO: `/v3/projects/8cc0220c12d74490ae0b912e998d2334/users/3f133e3d56dc4aa08dc8ec23368b78e1/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:24.686796 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e4c8d-735b-4025-8ead-91f68d3b939f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc0220c12d74490ae0b912e998d2334, user_id=3f133e3d56dc4aa08dc8ec23368b78e1, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:24.689598 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e4c8d-735b-4025-8ead-91f68d3b939f admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:24.786522 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1119/2237] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:24 2022] PUT /identity/v3/projects/8cc0220c12d74490ae0b912e998d2334/users/3f133e3d56dc4aa08dc8ec23368b78e1/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:24.799878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccb4b8-418d-41f9-bda0-c44e321a97cc None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:24.801008 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccb4b8-418d-41f9-bda0-c44e321a97cc None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:24.804613 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccb4b8-418d-41f9-bda0-c44e321a97cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:24.862248 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d5ccb4b8-418d-41f9-bda0-c44e321a97cc None None] MFA Rules not processed for user `3f133e3d56dc4aa08dc8ec23368b78e1`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:24.865078 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d5ccb4b8-418d-41f9-bda0-c44e321a97cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:25.049519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1119/2238] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:25.050834 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e4c8d-735b-4025-8ead-91f68d3b939f admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:25.110417 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccb4b8-418d-41f9-bda0-c44e321a97cc None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:25.113472 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d5ccb4b8-418d-41f9-bda0-c44e321a97cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:25.255427 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e4c8d-735b-4025-8ead-91f68d3b939f admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:25.260731 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b2778-1fbf-4e67-ba7e-6e0c389d19d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:25.262104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b2778-1fbf-4e67-ba7e-6e0c389d19d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:25.262559 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b2778-1fbf-4e67-ba7e-6e0c389d19d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:25.262979 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b2778-1fbf-4e67-ba7e-6e0c389d19d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:25.264840 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b2778-1fbf-4e67-ba7e-6e0c389d19d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:25.267402 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b2778-1fbf-4e67-ba7e-6e0c389d19d3 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:25.293282 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccb4b8-418d-41f9-bda0-c44e321a97cc None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:25.302463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a8a86-e1a3-479e-811f-9f2dbce92505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:25.303292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a8a86-e1a3-479e-811f-9f2dbce92505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:25.303574 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a8a86-e1a3-479e-811f-9f2dbce92505 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:25.303852 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a8a86-e1a3-479e-811f-9f2dbce92505 admin admin] PATH_INFO: `/v3/projects/dfba87b709b543698027450cbd1a7cbe` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:25.305350 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a8a86-e1a3-479e-811f-9f2dbce92505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfba87b709b543698027450cbd1a7cbe)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:25.307574 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a8a86-e1a3-479e-811f-9f2dbce92505 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:25.387114 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1120/2239] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:58:25 2022] POST /identity/v3/projects => generated 373 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:25.398408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b2778-1fbf-4e67-ba7e-6e0c389d19d3 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:25.472055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9e6a8a86-e1a3-479e-811f-9f2dbce92505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfba87b709b543698027450cbd1a7cbe', 'request_id': 'req-9e6a8a86-e1a3-479e-811f-9f2dbce92505'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:25.522078 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b2778-1fbf-4e67-ba7e-6e0c389d19d3 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:25.650251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9e6a8a86-e1a3-479e-811f-9f2dbce92505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfba87b709b543698027450cbd1a7cbe', 'request_id': 'req-9e6a8a86-e1a3-479e-811f-9f2dbce92505'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:25.660416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9e6a8a86-e1a3-479e-811f-9f2dbce92505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfba87b709b543698027450cbd1a7cbe', 'request_id': 'req-9e6a8a86-e1a3-479e-811f-9f2dbce92505'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:25.678302 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbb662-4db0-4f3b-8448-f78ee15dddd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:25.679002 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9e6a8a86-e1a3-479e-811f-9f2dbce92505 admin admin] The token cache is being invalidate because project dfba87b709b543698027450cbd1a7cbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:25.679300 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9e6a8a86-e1a3-479e-811f-9f2dbce92505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:25.679985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-9e6a8a86-e1a3-479e-811f-9f2dbce92505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:25.680262 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbb662-4db0-4f3b-8448-f78ee15dddd4 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:25.680702 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbb662-4db0-4f3b-8448-f78ee15dddd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:25.681166 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbb662-4db0-4f3b-8448-f78ee15dddd4 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:25.682386 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbb662-4db0-4f3b-8448-f78ee15dddd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:25.684808 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbb662-4db0-4f3b-8448-f78ee15dddd4 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:25.685423 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1120/2240] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:25 2022] DELETE /identity/v3/projects/dfba87b709b543698027450cbd1a7cbe => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:25.687058 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a22471-c488-4ae8-80b2-4f7c426ce8bc None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:25.687994 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a22471-c488-4ae8-80b2-4f7c426ce8bc None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:25.687994 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a22471-c488-4ae8-80b2-4f7c426ce8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:25.718965 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-00a22471-c488-4ae8-80b2-4f7c426ce8bc None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:25.720214 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-00a22471-c488-4ae8-80b2-4f7c426ce8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:25.732071 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1121/2241] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:25.740949 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff0600-5712-4f63-912a-3be01d8d14e7 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:25.741240 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff0600-5712-4f63-912a-3be01d8d14e7 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:25.741574 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff0600-5712-4f63-912a-3be01d8d14e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:25.790698 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-f4ff0600-5712-4f63-912a-3be01d8d14e7 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:25.792275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f4ff0600-5712-4f63-912a-3be01d8d14e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:25.811814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1122/2242] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:58:25.812802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff0600-5712-4f63-912a-3be01d8d14e7 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:25.824264 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff0600-5712-4f63-912a-3be01d8d14e7 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:25.829659 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb9727-d9bc-44b6-8b9e-ec4edba8aa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:25.830338 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb9727-d9bc-44b6-8b9e-ec4edba8aa19 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:25.830622 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb9727-d9bc-44b6-8b9e-ec4edba8aa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:25.830989 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb9727-d9bc-44b6-8b9e-ec4edba8aa19 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:25.831776 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb9727-d9bc-44b6-8b9e-ec4edba8aa19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:58:25.832083 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb9727-d9bc-44b6-8b9e-ec4edba8aa19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:25.833729 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb9727-d9bc-44b6-8b9e-ec4edba8aa19 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:25.862724 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1123/2243] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:58:25.865616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1121/2244] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:58:25 2022] POST /identity/v3/users => generated 293 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:58:25.870615 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb9727-d9bc-44b6-8b9e-ec4edba8aa19 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:25.871109 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbb662-4db0-4f3b-8448-f78ee15dddd4 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:25.873946 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e5fbb662-4db0-4f3b-8448-f78ee15dddd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:25.886254 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb9727-d9bc-44b6-8b9e-ec4edba8aa19 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:25.893138 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bc7f9-576d-46de-84e8-9004dbb7dec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:25.893821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bc7f9-576d-46de-84e8-9004dbb7dec7 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:25.894310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bc7f9-576d-46de-84e8-9004dbb7dec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:25.894591 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bc7f9-576d-46de-84e8-9004dbb7dec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:25.895292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bc7f9-576d-46de-84e8-9004dbb7dec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:25.897104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbb662-4db0-4f3b-8448-f78ee15dddd4 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:25.907501 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5918d6c-abfe-4f06-b4e9-fc8dbef21dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:25.913376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5918d6c-abfe-4f06-b4e9-fc8dbef21dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:25.914160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5918d6c-abfe-4f06-b4e9-fc8dbef21dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:25.914447 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5918d6c-abfe-4f06-b4e9-fc8dbef21dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:25.915296 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5918d6c-abfe-4f06-b4e9-fc8dbef21dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:25.917387 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5918d6c-abfe-4f06-b4e9-fc8dbef21dc3 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:25.917999 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bc7f9-576d-46de-84e8-9004dbb7dec7 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:25.948053 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1122/2245] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:25.951329 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5918d6c-abfe-4f06-b4e9-fc8dbef21dc3 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:25.976503 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5918d6c-abfe-4f06-b4e9-fc8dbef21dc3 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:26.001129 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fece8-60cd-400d-9527-771fcb1b7b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:26.002308 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fece8-60cd-400d-9527-771fcb1b7b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:26.002734 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fece8-60cd-400d-9527-771fcb1b7b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:26.003169 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fece8-60cd-400d-9527-771fcb1b7b5f admin admin] PATH_INFO: `/v3/projects/3700879a97804b06bcbd3026128c3169/users/550338dda1ab4a1a92311e9ad608135f/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:26.029235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fece8-60cd-400d-9527-771fcb1b7b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3700879a97804b06bcbd3026128c3169, user_id=550338dda1ab4a1a92311e9ad608135f, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:26.032148 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fece8-60cd-400d-9527-771fcb1b7b5f admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:26.061840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1124/2246] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:58:25 2022] POST /identity/v3/projects => generated 369 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:26.066447 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bc7f9-576d-46de-84e8-9004dbb7dec7 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:26.169336 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bc7f9-576d-46de-84e8-9004dbb7dec7 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:26.175307 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d0894-e4b0-48b0-8d05-56944b1b7d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:26.176385 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d0894-e4b0-48b0-8d05-56944b1b7d87 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:26.177144 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d0894-e4b0-48b0-8d05-56944b1b7d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:26.177534 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d0894-e4b0-48b0-8d05-56944b1b7d87 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:26.178334 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d0894-e4b0-48b0-8d05-56944b1b7d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:26.187327 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1123/2247] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:25 2022] PUT /identity/v3/projects/3700879a97804b06bcbd3026128c3169/users/550338dda1ab4a1a92311e9ad608135f/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:26.188664 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9bdf9-ea01-4222-b1c0-6dd65a72be64 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:26.188960 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9bdf9-ea01-4222-b1c0-6dd65a72be64 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:26.189277 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9bdf9-ea01-4222-b1c0-6dd65a72be64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:26.191450 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d0894-e4b0-48b0-8d05-56944b1b7d87 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:26.220346 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-6af9bdf9-ea01-4222-b1c0-6dd65a72be64 None None] MFA Rules not processed for user `f7fe7ea486834f6e9e8a7685d9c36bac`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:26.222935 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-6af9bdf9-ea01-4222-b1c0-6dd65a72be64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:26.298802 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1124/2248] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:26.300083 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9bdf9-ea01-4222-b1c0-6dd65a72be64 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:26.314032 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1125/2249] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:58:26 2022] POST /identity/v3/users => generated 285 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:26.322269 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d0894-e4b0-48b0-8d05-56944b1b7d87 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:26.352715 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d0894-e4b0-48b0-8d05-56944b1b7d87 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:26.429525 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9bdf9-ea01-4222-b1c0-6dd65a72be64 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:26.435071 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ee41b-9740-46ed-a0ac-449f81f1a4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:26.435813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ee41b-9740-46ed-a0ac-449f81f1a4ad admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:26.436096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ee41b-9740-46ed-a0ac-449f81f1a4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:26.436369 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ee41b-9740-46ed-a0ac-449f81f1a4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:26.437158 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ee41b-9740-46ed-a0ac-449f81f1a4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:26.439357 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ee41b-9740-46ed-a0ac-449f81f1a4ad admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:26.453756 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1125/2250] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:26.458368 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ee41b-9740-46ed-a0ac-449f81f1a4ad admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:26.478096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ee41b-9740-46ed-a0ac-449f81f1a4ad admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:26.488531 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ce530-76f4-4746-a7d0-e8f94419fd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:26.490028 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ce530-76f4-4746-a7d0-e8f94419fd92 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:26.490143 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d587da-abc0-4c38-bf6b-01d95dee3c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:26.490595 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ce530-76f4-4746-a7d0-e8f94419fd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:26.491108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ce530-76f4-4746-a7d0-e8f94419fd92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:26.492104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ce530-76f4-4746-a7d0-e8f94419fd92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:26.492268 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d587da-abc0-4c38-bf6b-01d95dee3c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:26.492797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d587da-abc0-4c38-bf6b-01d95dee3c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:26.493303 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d587da-abc0-4c38-bf6b-01d95dee3c3a admin admin] PATH_INFO: `/v3/projects/3700879a97804b06bcbd3026128c3169/users/550338dda1ab4a1a92311e9ad608135f/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:26.494979 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ce530-76f4-4746-a7d0-e8f94419fd92 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:26.497626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d587da-abc0-4c38-bf6b-01d95dee3c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3700879a97804b06bcbd3026128c3169, user_id=550338dda1ab4a1a92311e9ad608135f, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:26.503026 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d587da-abc0-4c38-bf6b-01d95dee3c3a admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:26.508643 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1126/2251] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:26.513012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ce530-76f4-4746-a7d0-e8f94419fd92 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:26.527931 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ce530-76f4-4746-a7d0-e8f94419fd92 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:26.542255 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1126/2252] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:26 2022] PUT /identity/v3/projects/3700879a97804b06bcbd3026128c3169/users/550338dda1ab4a1a92311e9ad608135f/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:26.548038 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e7735-60fd-4197-8886-395b4dab87ca None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:26.548038 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e7735-60fd-4197-8886-395b4dab87ca None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:26.548038 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e7735-60fd-4197-8886-395b4dab87ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:26.631908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-c24e7735-60fd-4197-8886-395b4dab87ca None None] MFA Rules not processed for user `550338dda1ab4a1a92311e9ad608135f`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:26.633179 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c24e7735-60fd-4197-8886-395b4dab87ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:26.685125 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b32a1-c15e-49bc-994f-9ab8762fb3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:26.686350 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b32a1-c15e-49bc-994f-9ab8762fb3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:26.686350 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b32a1-c15e-49bc-994f-9ab8762fb3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:26.686568 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b32a1-c15e-49bc-994f-9ab8762fb3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:26.687128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b32a1-c15e-49bc-994f-9ab8762fb3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:26.688835 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b32a1-c15e-49bc-994f-9ab8762fb3e3 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:26.705778 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1127/2253] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:58:26.707448 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b32a1-c15e-49bc-994f-9ab8762fb3e3 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:26.750268 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b32a1-c15e-49bc-994f-9ab8762fb3e3 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:26.762838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff98dd-74db-47e6-be2e-daabb52728e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:26.766895 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff98dd-74db-47e6-be2e-daabb52728e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:26.767370 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff98dd-74db-47e6-be2e-daabb52728e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:26.768308 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff98dd-74db-47e6-be2e-daabb52728e4 admin admin] PATH_INFO: `/v3/projects/dcbeefbcd4704e288b1a04bcf783e2c8/users/30b3175cdac244f6a479e4c764c9dfe2/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:26.797096 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff98dd-74db-47e6-be2e-daabb52728e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcbeefbcd4704e288b1a04bcf783e2c8, user_id=30b3175cdac244f6a479e4c764c9dfe2, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:26.800883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff98dd-74db-47e6-be2e-daabb52728e4 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:26.801726 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1127/2254] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:26.812822 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e7735-60fd-4197-8886-395b4dab87ca None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:26.814611 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c24e7735-60fd-4197-8886-395b4dab87ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:26.896943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e7735-60fd-4197-8886-395b4dab87ca None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:26.901515 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c256f-6faf-48d5-b42d-8e4cbd2e42ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:26.902266 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c256f-6faf-48d5-b42d-8e4cbd2e42ad service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:26.902604 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c256f-6faf-48d5-b42d-8e4cbd2e42ad service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:26.902886 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c256f-6faf-48d5-b42d-8e4cbd2e42ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:26.904987 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c47c256f-6faf-48d5-b42d-8e4cbd2e42ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:26.960419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1128/2255] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:26 2022] PUT /identity/v3/projects/dcbeefbcd4704e288b1a04bcf783e2c8/users/30b3175cdac244f6a479e4c764c9dfe2/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:26.961777 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d60f4-a981-4493-b251-ba8ea69ab754 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:26.962436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d60f4-a981-4493-b251-ba8ea69ab754 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:26.962607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d60f4-a981-4493-b251-ba8ea69ab754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:27.002851 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d71d60f4-a981-4493-b251-ba8ea69ab754 None None] MFA Rules not processed for user `30b3175cdac244f6a479e4c764c9dfe2`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:27.004503 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d71d60f4-a981-4493-b251-ba8ea69ab754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:27.006121 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c256f-6faf-48d5-b42d-8e4cbd2e42ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:27.007705 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c256f-6faf-48d5-b42d-8e4cbd2e42ad service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:27.020430 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1128/2256] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:27.112069 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1129/2257] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:27.126003 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c256f-6faf-48d5-b42d-8e4cbd2e42ad service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:27.128110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c47c256f-6faf-48d5-b42d-8e4cbd2e42ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:27.244373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c256f-6faf-48d5-b42d-8e4cbd2e42ad service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:27.309490 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2150e5-0489-429c-b713-c9ce05680565 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d261ec6e42f4be08c4d584fd3d00850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:27.310307 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2150e5-0489-429c-b713-c9ce05680565 service glance] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:27.310595 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2150e5-0489-429c-b713-c9ce05680565 service glance] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:27.310869 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2150e5-0489-429c-b713-c9ce05680565 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:27.320246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2150e5-0489-429c-b713-c9ce05680565 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:27.321877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2150e5-0489-429c-b713-c9ce05680565 service glance] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:27.331216 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1129/2258] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:58:31.561571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d60f4-a981-4493-b251-ba8ea69ab754 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:31.685275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d60f4-a981-4493-b251-ba8ea69ab754 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:31.694869 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde586cc-25ea-482f-a53a-b68ba3cc0273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:31.696842 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde586cc-25ea-482f-a53a-b68ba3cc0273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:31.697538 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde586cc-25ea-482f-a53a-b68ba3cc0273 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:31.698095 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde586cc-25ea-482f-a53a-b68ba3cc0273 admin admin] PATH_INFO: `/v3/users/3f133e3d56dc4aa08dc8ec23368b78e1` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:31.714562 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde586cc-25ea-482f-a53a-b68ba3cc0273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f133e3d56dc4aa08dc8ec23368b78e1)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:31.721981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde586cc-25ea-482f-a53a-b68ba3cc0273 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:32.148712 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-cde586cc-25ea-482f-a53a-b68ba3cc0273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f133e3d56dc4aa08dc8ec23368b78e1'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:32.149930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-cde586cc-25ea-482f-a53a-b68ba3cc0273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f133e3d56dc4aa08dc8ec23368b78e1'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:32.171553 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-cde586cc-25ea-482f-a53a-b68ba3cc0273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f133e3d56dc4aa08dc8ec23368b78e1'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:32.181825 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-cde586cc-25ea-482f-a53a-b68ba3cc0273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f133e3d56dc4aa08dc8ec23368b78e1'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:32.183132 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-cde586cc-25ea-482f-a53a-b68ba3cc0273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f133e3d56dc4aa08dc8ec23368b78e1'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:32.274325 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1130/2259] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:31 2022] DELETE /identity/v3/users/3f133e3d56dc4aa08dc8ec23368b78e1 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:58:32.280189 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4259b7-3c90-4362-8ad1-4d3294763e60 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:32.280879 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4259b7-3c90-4362-8ad1-4d3294763e60 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:32.281266 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4259b7-3c90-4362-8ad1-4d3294763e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:32.317335 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-0d4259b7-3c90-4362-8ad1-4d3294763e60 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:32.319618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-0d4259b7-3c90-4362-8ad1-4d3294763e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:32.442331 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1130/2260] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:32.458414 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde586cc-25ea-482f-a53a-b68ba3cc0273 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:32.465234 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-cde586cc-25ea-482f-a53a-b68ba3cc0273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:32.564158 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde586cc-25ea-482f-a53a-b68ba3cc0273 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:32.569284 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16d5ed-f5a8-4daa-94c9-e56237ef7d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:32.570049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16d5ed-f5a8-4daa-94c9-e56237ef7d20 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:32.570698 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16d5ed-f5a8-4daa-94c9-e56237ef7d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:32.571171 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16d5ed-f5a8-4daa-94c9-e56237ef7d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:32.588562 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16d5ed-f5a8-4daa-94c9-e56237ef7d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:32.590606 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16d5ed-f5a8-4daa-94c9-e56237ef7d20 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:32.604158 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1131/2261] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:33.214218 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4259b7-3c90-4362-8ad1-4d3294763e60 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:33.216292 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-0d4259b7-3c90-4362-8ad1-4d3294763e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:33.233139 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4259b7-3c90-4362-8ad1-4d3294763e60 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:33.239426 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004f38f-d0be-4bd4-ada2-447c46c8b658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:33.240328 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004f38f-d0be-4bd4-ada2-447c46c8b658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:33.240651 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004f38f-d0be-4bd4-ada2-447c46c8b658 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:33.241025 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004f38f-d0be-4bd4-ada2-447c46c8b658 admin admin] PATH_INFO: `/v3/projects/8cc0220c12d74490ae0b912e998d2334` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:33.246302 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004f38f-d0be-4bd4-ada2-447c46c8b658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cc0220c12d74490ae0b912e998d2334)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:33.248356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004f38f-d0be-4bd4-ada2-447c46c8b658 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:33.439245 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-1004f38f-d0be-4bd4-ada2-447c46c8b658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc0220c12d74490ae0b912e998d2334', 'request_id': 'req-1004f38f-d0be-4bd4-ada2-447c46c8b658'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:33.695296 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-1004f38f-d0be-4bd4-ada2-447c46c8b658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc0220c12d74490ae0b912e998d2334', 'request_id': 'req-1004f38f-d0be-4bd4-ada2-447c46c8b658'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:33.703877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-1004f38f-d0be-4bd4-ada2-447c46c8b658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc0220c12d74490ae0b912e998d2334', 'request_id': 'req-1004f38f-d0be-4bd4-ada2-447c46c8b658'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:33.716937 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-1004f38f-d0be-4bd4-ada2-447c46c8b658 admin admin] The token cache is being invalidate because project 8cc0220c12d74490ae0b912e998d2334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:33.717233 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-1004f38f-d0be-4bd4-ada2-447c46c8b658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:33.717995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-1004f38f-d0be-4bd4-ada2-447c46c8b658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:33.719904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1131/2262] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:33 2022] DELETE /identity/v3/projects/8cc0220c12d74490ae0b912e998d2334 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:33.723955 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16d5ed-f5a8-4daa-94c9-e56237ef7d20 service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:33.735422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16d5ed-f5a8-4daa-94c9-e56237ef7d20 service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:33.812070 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0cb34-6165-4a6c-8111-b423f7666536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:33.813011 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0cb34-6165-4a6c-8111-b423f7666536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:33.813293 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0cb34-6165-4a6c-8111-b423f7666536 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:33.813646 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0cb34-6165-4a6c-8111-b423f7666536 admin admin] PATH_INFO: `/v3/users/550338dda1ab4a1a92311e9ad608135f` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:33.815109 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0cb34-6165-4a6c-8111-b423f7666536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=550338dda1ab4a1a92311e9ad608135f)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:33.817931 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0cb34-6165-4a6c-8111-b423f7666536 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:34.220969 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-06f0cb34-6165-4a6c-8111-b423f7666536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '550338dda1ab4a1a92311e9ad608135f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:34.222532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-06f0cb34-6165-4a6c-8111-b423f7666536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '550338dda1ab4a1a92311e9ad608135f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:34.236201 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-06f0cb34-6165-4a6c-8111-b423f7666536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '550338dda1ab4a1a92311e9ad608135f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:34.253805 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-06f0cb34-6165-4a6c-8111-b423f7666536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '550338dda1ab4a1a92311e9ad608135f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:34.253805 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-06f0cb34-6165-4a6c-8111-b423f7666536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '550338dda1ab4a1a92311e9ad608135f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:34.492233 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1132/2263] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:58:33 2022] DELETE /identity/v3/users/550338dda1ab4a1a92311e9ad608135f => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:35.077083 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004f38f-d0be-4bd4-ada2-447c46c8b658 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:35.077083 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-1004f38f-d0be-4bd4-ada2-447c46c8b658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:35.100473 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004f38f-d0be-4bd4-ada2-447c46c8b658 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:35.165526 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4309e-1b51-4972-b666-51c36f97c4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:35.166363 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4309e-1b51-4972-b666-51c36f97c4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:35.166639 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4309e-1b51-4972-b666-51c36f97c4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:35.166917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4309e-1b51-4972-b666-51c36f97c4aa admin admin] PATH_INFO: `/v3/projects/3700879a97804b06bcbd3026128c3169` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:35.168240 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4309e-1b51-4972-b666-51c36f97c4aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3700879a97804b06bcbd3026128c3169)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:35.170514 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4309e-1b51-4972-b666-51c36f97c4aa admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:35.340069 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f6b4309e-1b51-4972-b666-51c36f97c4aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3700879a97804b06bcbd3026128c3169', 'request_id': 'req-f6b4309e-1b51-4972-b666-51c36f97c4aa'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:35.457901 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f6b4309e-1b51-4972-b666-51c36f97c4aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3700879a97804b06bcbd3026128c3169', 'request_id': 'req-f6b4309e-1b51-4972-b666-51c36f97c4aa'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:35.473983 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f6b4309e-1b51-4972-b666-51c36f97c4aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3700879a97804b06bcbd3026128c3169', 'request_id': 'req-f6b4309e-1b51-4972-b666-51c36f97c4aa'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:35.487227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f6b4309e-1b51-4972-b666-51c36f97c4aa admin admin] The token cache is being invalidate because project 3700879a97804b06bcbd3026128c3169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:58:35.487629 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f6b4309e-1b51-4972-b666-51c36f97c4aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:35.493083 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f6b4309e-1b51-4972-b666-51c36f97c4aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:58:35.498947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1132/2264] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:58:35 2022] DELETE /identity/v3/projects/3700879a97804b06bcbd3026128c3169 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:35.506051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca9f4f-c027-48c8-8cd5-3c7d5594cf6b None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:35.507507 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca9f4f-c027-48c8-8cd5-3c7d5594cf6b None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:35.508268 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca9f4f-c027-48c8-8cd5-3c7d5594cf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:35.561555 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-2bca9f4f-c027-48c8-8cd5-3c7d5594cf6b None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:35.563025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-2bca9f4f-c027-48c8-8cd5-3c7d5594cf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:35.648276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1133/2265] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:35.656250 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefae4db-d245-4fb1-9bc2-b984ed5cd1c5 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:35.656649 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefae4db-d245-4fb1-9bc2-b984ed5cd1c5 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:35.656997 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefae4db-d245-4fb1-9bc2-b984ed5cd1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:35.679159 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-fefae4db-d245-4fb1-9bc2-b984ed5cd1c5 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:35.680402 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-fefae4db-d245-4fb1-9bc2-b984ed5cd1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:35.689062 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1133/2266] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:35.694265 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca9f4f-c027-48c8-8cd5-3c7d5594cf6b None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:35.704807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca9f4f-c027-48c8-8cd5-3c7d5594cf6b None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:35.713779 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc18fb-72af-4547-91db-f9a9bf2f7d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:35.713779 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc18fb-72af-4547-91db-f9a9bf2f7d0f admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:35.713779 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc18fb-72af-4547-91db-f9a9bf2f7d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:35.713779 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc18fb-72af-4547-91db-f9a9bf2f7d0f admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:35.714338 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc18fb-72af-4547-91db-f9a9bf2f7d0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:58:35.714338 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc18fb-72af-4547-91db-f9a9bf2f7d0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:35.715424 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc18fb-72af-4547-91db-f9a9bf2f7d0f admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:35.733020 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1134/2267] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 21:58:35.736166 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefae4db-d245-4fb1-9bc2-b984ed5cd1c5 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:35.744249 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefae4db-d245-4fb1-9bc2-b984ed5cd1c5 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:35.751435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9438881-427a-4d09-994e-428b0f96bb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:35.752112 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9438881-427a-4d09-994e-428b0f96bb59 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:35.752401 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9438881-427a-4d09-994e-428b0f96bb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:35.752708 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9438881-427a-4d09-994e-428b0f96bb59 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:35.754120 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9438881-427a-4d09-994e-428b0f96bb59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:35.756090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9438881-427a-4d09-994e-428b0f96bb59 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:35.883060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1134/2268] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:58:35 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:35.891781 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc18fb-72af-4547-91db-f9a9bf2f7d0f admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:35.900895 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc18fb-72af-4547-91db-f9a9bf2f7d0f admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:36.014797 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0705c91-3064-4c38-abb7-d5e15118b965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:36.015065 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0705c91-3064-4c38-abb7-d5e15118b965 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:36.015483 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0705c91-3064-4c38-abb7-d5e15118b965 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:36.015761 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0705c91-3064-4c38-abb7-d5e15118b965 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:36.016717 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0705c91-3064-4c38-abb7-d5e15118b965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:36.019225 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0705c91-3064-4c38-abb7-d5e15118b965 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:36.172589 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1135/2269] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:58:35 2022] POST /identity/v3/users => generated 292 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:58:36.174596 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9438881-427a-4d09-994e-428b0f96bb59 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:36.189516 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9438881-427a-4d09-994e-428b0f96bb59 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:36.196491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2caa4d3-013b-4b84-898a-7c46f11ff8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:36.196491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2caa4d3-013b-4b84-898a-7c46f11ff8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:36.196880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2caa4d3-013b-4b84-898a-7c46f11ff8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:36.197510 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2caa4d3-013b-4b84-898a-7c46f11ff8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:36.197815 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2caa4d3-013b-4b84-898a-7c46f11ff8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:36.199450 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2caa4d3-013b-4b84-898a-7c46f11ff8a1 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:36.219111 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0705c91-3064-4c38-abb7-d5e15118b965 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:36.225673 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1135/2270] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:58:36.231791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0705c91-3064-4c38-abb7-d5e15118b965 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:36.237909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eecfab-47a1-4ead-9014-97bf06a18ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:36.239074 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eecfab-47a1-4ead-9014-97bf06a18ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:36.239420 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eecfab-47a1-4ead-9014-97bf06a18ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:36.240104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eecfab-47a1-4ead-9014-97bf06a18ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:36.248380 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eecfab-47a1-4ead-9014-97bf06a18ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:36.248380 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eecfab-47a1-4ead-9014-97bf06a18ac0 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:36.262242 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1136/2271] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:36.263441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2caa4d3-013b-4b84-898a-7c46f11ff8a1 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:36.288806 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2caa4d3-013b-4b84-898a-7c46f11ff8a1 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:36.302962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4c4ae-0934-419d-9200-062a57a863b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:36.304282 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4c4ae-0934-419d-9200-062a57a863b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:36.304828 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4c4ae-0934-419d-9200-062a57a863b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:36.305333 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4c4ae-0934-419d-9200-062a57a863b7 admin admin] PATH_INFO: `/v3/projects/40c5ee7a5b0640ecbb513c322c45dcc8/users/e25a03e7055a43af8da10c5f041f3cb1/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:36.335856 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4c4ae-0934-419d-9200-062a57a863b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c5ee7a5b0640ecbb513c322c45dcc8, user_id=e25a03e7055a43af8da10c5f041f3cb1, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:36.339603 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4c4ae-0934-419d-9200-062a57a863b7 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:36.498947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1136/2272] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:36 2022] PUT /identity/v3/projects/40c5ee7a5b0640ecbb513c322c45dcc8/users/e25a03e7055a43af8da10c5f041f3cb1/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:58:36.509037 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c513a1-4497-46ac-874b-3545373e2fc1 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:36.509727 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c513a1-4497-46ac-874b-3545373e2fc1 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:36.509727 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c513a1-4497-46ac-874b-3545373e2fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:36.533169 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-42c513a1-4497-46ac-874b-3545373e2fc1 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:36.534513 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-42c513a1-4497-46ac-874b-3545373e2fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:36.659368 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1137/2273] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:36.681318 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4c4ae-0934-419d-9200-062a57a863b7 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:36.693160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-bfb4c4ae-0934-419d-9200-062a57a863b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:36.825574 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4c4ae-0934-419d-9200-062a57a863b7 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:36.837300 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82312179-5835-4309-82fb-ac341415fa71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:36.841774 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82312179-5835-4309-82fb-ac341415fa71 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:36.841774 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82312179-5835-4309-82fb-ac341415fa71 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:36.841774 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82312179-5835-4309-82fb-ac341415fa71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:36.857947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82312179-5835-4309-82fb-ac341415fa71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:36.859549 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82312179-5835-4309-82fb-ac341415fa71 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:36.874849 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1137/2274] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 21:58:40.293254 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e9b27-aac7-4c2b-9562-70967365120f None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:40.293822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e9b27-aac7-4c2b-9562-70967365120f None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:40.293822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e9b27-aac7-4c2b-9562-70967365120f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:40.324095 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-190e9b27-aac7-4c2b-9562-70967365120f None None] MFA Rules not processed for user `136152c5c06b4e44803b127e232ff865`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:40.326412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-190e9b27-aac7-4c2b-9562-70967365120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:40.405023 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1138/2275] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:47.458656 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4dc9c-8755-4734-be2a-88d58d4cb56b None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:47.459546 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4dc9c-8755-4734-be2a-88d58d4cb56b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:47.459820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4dc9c-8755-4734-be2a-88d58d4cb56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:47.501496 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-96e4dc9c-8755-4734-be2a-88d58d4cb56b None None] MFA Rules not processed for user `e25a03e7055a43af8da10c5f041f3cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:47.503480 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-96e4dc9c-8755-4734-be2a-88d58d4cb56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:47.585412 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1138/2276] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:58:47.590943 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e9b27-aac7-4c2b-9562-70967365120f None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:47.603929 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e9b27-aac7-4c2b-9562-70967365120f None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:47.609858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab68f2a-2c06-401d-b984-c2c8727e6c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:47.610748 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab68f2a-2c06-401d-b984-c2c8727e6c23 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:47.611204 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab68f2a-2c06-401d-b984-c2c8727e6c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:47.611856 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab68f2a-2c06-401d-b984-c2c8727e6c23 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:47.614025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab68f2a-2c06-401d-b984-c2c8727e6c23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:47.618353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab68f2a-2c06-401d-b984-c2c8727e6c23 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:47.732542 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1139/2277] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:58:47 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:58:47.735080 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4dc9c-8755-4734-be2a-88d58d4cb56b None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:47.748877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4dc9c-8755-4734-be2a-88d58d4cb56b None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:47.828559 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d1392-1a90-49dd-b67d-7b16d6ad3bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:47.829364 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d1392-1a90-49dd-b67d-7b16d6ad3bcc admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:47.829740 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d1392-1a90-49dd-b67d-7b16d6ad3bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:47.830092 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d1392-1a90-49dd-b67d-7b16d6ad3bcc admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:47.830965 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d1392-1a90-49dd-b67d-7b16d6ad3bcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:47.833611 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d1392-1a90-49dd-b67d-7b16d6ad3bcc admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:47.986052 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1139/2278] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:58:47 2022] POST /identity/v3/users => generated 298 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:58:47.987431 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab68f2a-2c06-401d-b984-c2c8727e6c23 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:48.009041 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab68f2a-2c06-401d-b984-c2c8727e6c23 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:48.017245 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f774d89-0cb9-42af-ada1-c32510a6bc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:48.018241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f774d89-0cb9-42af-ada1-c32510a6bc71 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:48.019467 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f774d89-0cb9-42af-ada1-c32510a6bc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:48.019902 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f774d89-0cb9-42af-ada1-c32510a6bc71 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:48.020805 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f774d89-0cb9-42af-ada1-c32510a6bc71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:48.022710 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f774d89-0cb9-42af-ada1-c32510a6bc71 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:48.036984 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1140/2279] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:58:48.041322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d1392-1a90-49dd-b67d-7b16d6ad3bcc admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:48.054617 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d1392-1a90-49dd-b67d-7b16d6ad3bcc admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:48.060103 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307a3be-cb76-40ec-95cf-6a53070af5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:48.061059 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307a3be-cb76-40ec-95cf-6a53070af5db admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:48.062431 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307a3be-cb76-40ec-95cf-6a53070af5db admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:48.062431 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307a3be-cb76-40ec-95cf-6a53070af5db admin admin] PATH_INFO: `/v3/projects/9094af9f015e43299e43c8ca8bc98eae/users/3b7bb1dd09224adfb32fefff5a0f4383/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:48.084806 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307a3be-cb76-40ec-95cf-6a53070af5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=9094af9f015e43299e43c8ca8bc98eae, user_id=3b7bb1dd09224adfb32fefff5a0f4383, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:48.087824 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307a3be-cb76-40ec-95cf-6a53070af5db admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:48.207836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1140/2280] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:48 2022] PUT /identity/v3/projects/9094af9f015e43299e43c8ca8bc98eae/users/3b7bb1dd09224adfb32fefff5a0f4383/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:58:48.212171 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f774d89-0cb9-42af-ada1-c32510a6bc71 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:48.227633 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f774d89-0cb9-42af-ada1-c32510a6bc71 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:48.329091 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c72e0-6a50-4ce8-ab90-37f1d308fb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:48.333131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c72e0-6a50-4ce8-ab90-37f1d308fb05 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:48.339209 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c72e0-6a50-4ce8-ab90-37f1d308fb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:48.339209 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c72e0-6a50-4ce8-ab90-37f1d308fb05 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:48.339209 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c72e0-6a50-4ce8-ab90-37f1d308fb05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:48.339209 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c72e0-6a50-4ce8-ab90-37f1d308fb05 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:48.355217 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1141/2281] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:58:48.359586 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307a3be-cb76-40ec-95cf-6a53070af5db admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:48.372494 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307a3be-cb76-40ec-95cf-6a53070af5db admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:48.383092 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd1129-ba43-4901-a338-f625e82ec1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:48.384986 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd1129-ba43-4901-a338-f625e82ec1e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:48.384986 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd1129-ba43-4901-a338-f625e82ec1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:48.385262 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd1129-ba43-4901-a338-f625e82ec1e9 admin admin] PATH_INFO: `/v3/projects/9094af9f015e43299e43c8ca8bc98eae/users/3b7bb1dd09224adfb32fefff5a0f4383/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:48.388841 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd1129-ba43-4901-a338-f625e82ec1e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9094af9f015e43299e43c8ca8bc98eae, user_id=3b7bb1dd09224adfb32fefff5a0f4383, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:48.392908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd1129-ba43-4901-a338-f625e82ec1e9 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:48.413321 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1141/2282] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:58:48 2022] PUT /identity/v3/projects/9094af9f015e43299e43c8ca8bc98eae/users/3b7bb1dd09224adfb32fefff5a0f4383/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:58:57.852709 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815706da-3cf2-4df3-829c-fac15a82df13 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:57.853258 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815706da-3cf2-4df3-829c-fac15a82df13 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:57.854155 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815706da-3cf2-4df3-829c-fac15a82df13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:57.944675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-815706da-3cf2-4df3-829c-fac15a82df13 None None] MFA Rules not processed for user `1144e9036d0b4bafb30995ff1a8449ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:57.946309 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-815706da-3cf2-4df3-829c-fac15a82df13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:58.056270 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1142/2283] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Apr 14 21:58:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:58.110133 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd1129-ba43-4901-a338-f625e82ec1e9 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:58.112266 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-cdbd1129-ba43-4901-a338-f625e82ec1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:58.264508 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd1129-ba43-4901-a338-f625e82ec1e9 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:58.275079 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca37a29-94df-4789-8c29-c1f88f966d5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bf55488d046c4be98a903d113c0fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:58.275079 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca37a29-94df-4789-8c29-c1f88f966d5f service swift] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:58.275079 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca37a29-94df-4789-8c29-c1f88f966d5f service swift] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:58.275079 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca37a29-94df-4789-8c29-c1f88f966d5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:58.292941 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca37a29-94df-4789-8c29-c1f88f966d5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:58.301166 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca37a29-94df-4789-8c29-c1f88f966d5f service swift] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:58.335244 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1142/2284] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Apr 14 21:58:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 14 21:58:58.956978 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe86292-2480-47cc-82b5-a39c2e46c57e None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:58.957524 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe86292-2480-47cc-82b5-a39c2e46c57e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:58.957941 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe86292-2480-47cc-82b5-a39c2e46c57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:59.002530 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-cbe86292-2480-47cc-82b5-a39c2e46c57e None None] MFA Rules not processed for user `3b7bb1dd09224adfb32fefff5a0f4383`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:59.003949 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-cbe86292-2480-47cc-82b5-a39c2e46c57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:59.094687 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1143/2285] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:58:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:59.126941 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca37a29-94df-4789-8c29-c1f88f966d5f service swift] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:59.130560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-cca37a29-94df-4789-8c29-c1f88f966d5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:59.271741 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca37a29-94df-4789-8c29-c1f88f966d5f service swift] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:59.275951 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fb4f4-9241-44bc-8e9d-efdc7937a773 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d261ec6e42f4be08c4d584fd3d00850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:59.276877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb4f4-9241-44bc-8e9d-efdc7937a773 service glance] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:59.277314 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb4f4-9241-44bc-8e9d-efdc7937a773 service glance] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:59.277773 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb4f4-9241-44bc-8e9d-efdc7937a773 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:59.352656 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fb4f4-9241-44bc-8e9d-efdc7937a773 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:59.354450 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fb4f4-9241-44bc-8e9d-efdc7937a773 service glance] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:59.372372 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1143/2286] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:58:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:58:59.671554 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac92fd-694e-4ade-a26a-be96d21ee4c4 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:59.671841 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac92fd-694e-4ade-a26a-be96d21ee4c4 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:59.672123 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac92fd-694e-4ade-a26a-be96d21ee4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:59.693847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-04ac92fd-694e-4ade-a26a-be96d21ee4c4 None None] MFA Rules not processed for user `1144e9036d0b4bafb30995ff1a8449ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:59.694901 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-04ac92fd-694e-4ade-a26a-be96d21ee4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:59.701798 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cae33d-4a04-40f5-8805-a00ba60b9524 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:59.702446 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cae33d-4a04-40f5-8805-a00ba60b9524 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:59.702993 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cae33d-4a04-40f5-8805-a00ba60b9524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:59.713292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1144/2287] 10.222.0.52 () {58 vars in 967 bytes} [Thu Apr 14 21:58:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:58:59.722108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac92fd-694e-4ade-a26a-be96d21ee4c4 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:59.732380 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-71cae33d-4a04-40f5-8805-a00ba60b9524 None None] MFA Rules not processed for user `1144e9036d0b4bafb30995ff1a8449ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:58:59.733737 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-71cae33d-4a04-40f5-8805-a00ba60b9524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:58:59.735542 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac92fd-694e-4ade-a26a-be96d21ee4c4 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:59.741566 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026be34-7a78-4576-a9a0-d1b1948f9680 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bf55488d046c4be98a903d113c0fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:59.742332 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026be34-7a78-4576-a9a0-d1b1948f9680 service swift] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:59.742756 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1144/2288] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Apr 14 21:58:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:58:59.742895 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026be34-7a78-4576-a9a0-d1b1948f9680 service swift] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:59.743062 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026be34-7a78-4576-a9a0-d1b1948f9680 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:59.754746 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026be34-7a78-4576-a9a0-d1b1948f9680 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:59.756633 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026be34-7a78-4576-a9a0-d1b1948f9680 service swift] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:59.766424 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1145/2289] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Apr 14 21:58:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 14 21:58:59.776385 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cae33d-4a04-40f5-8805-a00ba60b9524 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:58:59.799328 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cae33d-4a04-40f5-8805-a00ba60b9524 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:58:59.809201 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b151c-d799-41fe-a60b-7432c9fd7b49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bf55488d046c4be98a903d113c0fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:58:59.809864 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b151c-d799-41fe-a60b-7432c9fd7b49 service swift] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:58:59.810143 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b151c-d799-41fe-a60b-7432c9fd7b49 service swift] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:58:59.810416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b151c-d799-41fe-a60b-7432c9fd7b49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:58:59.820953 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b151c-d799-41fe-a60b-7432c9fd7b49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:58:59.827764 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b151c-d799-41fe-a60b-7432c9fd7b49 service swift] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:58:59.832176 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1145/2290] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Apr 14 21:58:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 14 21:59:01.005450 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb7390-0f13-4f26-a5dc-81f86234f919 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:01.006891 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb7390-0f13-4f26-a5dc-81f86234f919 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:01.007377 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb7390-0f13-4f26-a5dc-81f86234f919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:01.046489 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-f0fb7390-0f13-4f26-a5dc-81f86234f919 None None] MFA Rules not processed for user `1144e9036d0b4bafb30995ff1a8449ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:59:01.051720 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f0fb7390-0f13-4f26-a5dc-81f86234f919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:01.056129 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1146/2291] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Apr 14 21:59:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:59:01.077539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b151c-d799-41fe-a60b-7432c9fd7b49 service swift] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:01.111929 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b151c-d799-41fe-a60b-7432c9fd7b49 service swift] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:01.139135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35505352-b869-456a-ad4a-fc8bac61cae3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bf55488d046c4be98a903d113c0fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:01.140628 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35505352-b869-456a-ad4a-fc8bac61cae3 service swift] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:01.141379 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35505352-b869-456a-ad4a-fc8bac61cae3 service swift] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:01.142060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35505352-b869-456a-ad4a-fc8bac61cae3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:01.186524 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35505352-b869-456a-ad4a-fc8bac61cae3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:01.188430 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35505352-b869-456a-ad4a-fc8bac61cae3 service swift] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:01.211335 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1146/2292] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Apr 14 21:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 14 21:59:02.061129 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a6eef-2a23-431e-a184-3f8dd98cabbe None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:02.062999 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a6eef-2a23-431e-a184-3f8dd98cabbe None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:02.063270 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a6eef-2a23-431e-a184-3f8dd98cabbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:02.083925 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-ee1a6eef-2a23-431e-a184-3f8dd98cabbe None None] MFA Rules not processed for user `1144e9036d0b4bafb30995ff1a8449ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:59:02.085641 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ee1a6eef-2a23-431e-a184-3f8dd98cabbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:02.116110 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1147/2293] 10.222.0.52 () {58 vars in 967 bytes} [Thu Apr 14 21:59:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:59:02.119522 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35505352-b869-456a-ad4a-fc8bac61cae3 service swift] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:02.131104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35505352-b869-456a-ad4a-fc8bac61cae3 service swift] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:02.137861 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6afb8-447d-4637-9a32-3cbcfdab02d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bf55488d046c4be98a903d113c0fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:02.139047 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6afb8-447d-4637-9a32-3cbcfdab02d5 service swift] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:02.139500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6afb8-447d-4637-9a32-3cbcfdab02d5 service swift] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:02.149362 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6afb8-447d-4637-9a32-3cbcfdab02d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:02.160716 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6afb8-447d-4637-9a32-3cbcfdab02d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:02.162588 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6afb8-447d-4637-9a32-3cbcfdab02d5 service swift] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:02.172155 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1147/2294] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Apr 14 21:59:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 14 21:59:07.613469 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a6eef-2a23-431e-a184-3f8dd98cabbe None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:07.614962 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ee1a6eef-2a23-431e-a184-3f8dd98cabbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:07.682215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a6eef-2a23-431e-a184-3f8dd98cabbe None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:07.686983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8e3eb-de1f-4b3f-bf78-552ce007a29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:07.687852 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8e3eb-de1f-4b3f-bf78-552ce007a29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:07.688128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8e3eb-de1f-4b3f-bf78-552ce007a29d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:07.688404 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8e3eb-de1f-4b3f-bf78-552ce007a29d admin admin] PATH_INFO: `/v3/users/e36f70bd4f934b35b4eea53f7914865a` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:07.689621 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8e3eb-de1f-4b3f-bf78-552ce007a29d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e36f70bd4f934b35b4eea53f7914865a)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:07.696895 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8e3eb-de1f-4b3f-bf78-552ce007a29d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:08.635889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-faf8e3eb-de1f-4b3f-bf78-552ce007a29d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e36f70bd4f934b35b4eea53f7914865a'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:08.639457 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-faf8e3eb-de1f-4b3f-bf78-552ce007a29d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e36f70bd4f934b35b4eea53f7914865a'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:08.665538 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-faf8e3eb-de1f-4b3f-bf78-552ce007a29d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e36f70bd4f934b35b4eea53f7914865a'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:08.681961 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-faf8e3eb-de1f-4b3f-bf78-552ce007a29d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e36f70bd4f934b35b4eea53f7914865a'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:08.683656 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-faf8e3eb-de1f-4b3f-bf78-552ce007a29d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e36f70bd4f934b35b4eea53f7914865a'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:08.788512 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1148/2295] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:59:07 2022] DELETE /identity/v3/users/e36f70bd4f934b35b4eea53f7914865a => generated 0 bytes in 1176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:59:08.794048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d336a-32db-4ec3-aa70-579181f71aa0 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:08.795174 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d336a-32db-4ec3-aa70-579181f71aa0 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:08.795174 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d336a-32db-4ec3-aa70-579181f71aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:08.843391 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-e79d336a-32db-4ec3-aa70-579181f71aa0 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:59:08.845322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e79d336a-32db-4ec3-aa70-579181f71aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:08.955685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1148/2296] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:59:08.963997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8e3eb-de1f-4b3f-bf78-552ce007a29d admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:08.966097 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-faf8e3eb-de1f-4b3f-bf78-552ce007a29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:09.145500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8e3eb-de1f-4b3f-bf78-552ce007a29d admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:09.156720 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dc2e7-e348-46f4-a49e-6be9fef2ebd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:09.157565 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dc2e7-e348-46f4-a49e-6be9fef2ebd0 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:09.157906 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dc2e7-e348-46f4-a49e-6be9fef2ebd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:09.158238 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dc2e7-e348-46f4-a49e-6be9fef2ebd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:09.187584 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34dc2e7-e348-46f4-a49e-6be9fef2ebd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:09.190445 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34dc2e7-e348-46f4-a49e-6be9fef2ebd0 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:09.207716 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1149/2297] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:59:09.716063 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d336a-32db-4ec3-aa70-579181f71aa0 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:09.722454 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e79d336a-32db-4ec3-aa70-579181f71aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:09.745748 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d336a-32db-4ec3-aa70-579181f71aa0 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:09.757385 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98348cca-12df-47ea-9706-b877f14e71c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:09.757385 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98348cca-12df-47ea-9706-b877f14e71c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:09.757385 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98348cca-12df-47ea-9706-b877f14e71c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:09.757385 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98348cca-12df-47ea-9706-b877f14e71c1 admin admin] PATH_INFO: `/v3/projects/aff3ead5693f4968ba8b017a37de9515` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:09.758346 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98348cca-12df-47ea-9706-b877f14e71c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff3ead5693f4968ba8b017a37de9515)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:09.760778 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98348cca-12df-47ea-9706-b877f14e71c1 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:09.944090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-98348cca-12df-47ea-9706-b877f14e71c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff3ead5693f4968ba8b017a37de9515', 'request_id': 'req-98348cca-12df-47ea-9706-b877f14e71c1'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:10.070274 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-98348cca-12df-47ea-9706-b877f14e71c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff3ead5693f4968ba8b017a37de9515', 'request_id': 'req-98348cca-12df-47ea-9706-b877f14e71c1'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:10.083625 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-98348cca-12df-47ea-9706-b877f14e71c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff3ead5693f4968ba8b017a37de9515', 'request_id': 'req-98348cca-12df-47ea-9706-b877f14e71c1'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:10.103096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-98348cca-12df-47ea-9706-b877f14e71c1 admin admin] The token cache is being invalidate because project aff3ead5693f4968ba8b017a37de9515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:59:10.104291 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-98348cca-12df-47ea-9706-b877f14e71c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:10.106118 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-98348cca-12df-47ea-9706-b877f14e71c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:10.113118 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1149/2298] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:59:09 2022] DELETE /identity/v3/projects/aff3ead5693f4968ba8b017a37de9515 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:59:10.126100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e4ab6-9b1a-4fdc-a30b-953b606c39c1 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:10.126100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e4ab6-9b1a-4fdc-a30b-953b606c39c1 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:10.126100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e4ab6-9b1a-4fdc-a30b-953b606c39c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:10.155190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-0a1e4ab6-9b1a-4fdc-a30b-953b606c39c1 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:59:10.159753 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-0a1e4ab6-9b1a-4fdc-a30b-953b606c39c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:10.278704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1150/2299] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:59:10.292056 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c9f69-4651-4573-b146-c55a828a138c None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:10.292429 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c9f69-4651-4573-b146-c55a828a138c None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:10.293365 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c9f69-4651-4573-b146-c55a828a138c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:10.320014 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-b32c9f69-4651-4573-b146-c55a828a138c None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:59:10.327870 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b32c9f69-4651-4573-b146-c55a828a138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:10.344496 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e4ab6-9b1a-4fdc-a30b-953b606c39c1 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:10.345745 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1150/2300] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:59:10.364001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e4ab6-9b1a-4fdc-a30b-953b606c39c1 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:10.369272 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc654995-727d-44a9-8c96-4ac6ca76588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:10.369952 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc654995-727d-44a9-8c96-4ac6ca76588c admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:10.370237 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc654995-727d-44a9-8c96-4ac6ca76588c admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:10.370510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc654995-727d-44a9-8c96-4ac6ca76588c admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:10.371239 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc654995-727d-44a9-8c96-4ac6ca76588c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:59:10.371650 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc654995-727d-44a9-8c96-4ac6ca76588c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:10.373234 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc654995-727d-44a9-8c96-4ac6ca76588c admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:10.394463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1151/2301] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:59:10.394706 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c9f69-4651-4573-b146-c55a828a138c None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:10.405533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c9f69-4651-4573-b146-c55a828a138c None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:10.411975 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23765850-2cae-4914-9b2a-c6e3d85104f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:10.412682 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23765850-2cae-4914-9b2a-c6e3d85104f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:10.412980 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23765850-2cae-4914-9b2a-c6e3d85104f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:10.413235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23765850-2cae-4914-9b2a-c6e3d85104f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:10.414147 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23765850-2cae-4914-9b2a-c6e3d85104f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:10.416422 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23765850-2cae-4914-9b2a-c6e3d85104f8 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:10.570985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc654995-727d-44a9-8c96-4ac6ca76588c admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:10.571637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1151/2302] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:59:10 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:59:10.585543 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc654995-727d-44a9-8c96-4ac6ca76588c admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:10.691349 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b55f6-9141-46bc-99d3-3923392b3ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:10.692764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b55f6-9141-46bc-99d3-3923392b3ada admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:10.693171 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b55f6-9141-46bc-99d3-3923392b3ada admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:10.693684 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b55f6-9141-46bc-99d3-3923392b3ada admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:10.695262 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b55f6-9141-46bc-99d3-3923392b3ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:10.700633 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b55f6-9141-46bc-99d3-3923392b3ada admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:10.891664 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1152/2303] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:59:10 2022] POST /identity/v3/users => generated 287 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:59:10.921092 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23765850-2cae-4914-9b2a-c6e3d85104f8 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:10.934923 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23765850-2cae-4914-9b2a-c6e3d85104f8 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:10.942667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c79ce-9500-4ccd-b52d-e5ac8eb26aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:10.943348 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c79ce-9500-4ccd-b52d-e5ac8eb26aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:10.943628 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c79ce-9500-4ccd-b52d-e5ac8eb26aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:10.944301 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c79ce-9500-4ccd-b52d-e5ac8eb26aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:10.945078 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c79ce-9500-4ccd-b52d-e5ac8eb26aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:10.946677 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c79ce-9500-4ccd-b52d-e5ac8eb26aa7 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:10.961263 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1152/2304] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:59:10.964965 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b55f6-9141-46bc-99d3-3923392b3ada admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:10.982993 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b55f6-9141-46bc-99d3-3923392b3ada admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:10.992956 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8e448-48d7-4f52-b0d4-f69bc996d4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:10.993725 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8e448-48d7-4f52-b0d4-f69bc996d4ab admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:10.994157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8e448-48d7-4f52-b0d4-f69bc996d4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:10.994502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8e448-48d7-4f52-b0d4-f69bc996d4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:10.995303 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8e448-48d7-4f52-b0d4-f69bc996d4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:10.996999 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8e448-48d7-4f52-b0d4-f69bc996d4ab admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:11.016937 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1153/2305] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:59:11.022210 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c79ce-9500-4ccd-b52d-e5ac8eb26aa7 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:11.037913 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c79ce-9500-4ccd-b52d-e5ac8eb26aa7 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:11.048029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603c429-b05c-4124-b680-c9efad79883d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:11.048029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603c429-b05c-4124-b680-c9efad79883d admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:11.048029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603c429-b05c-4124-b680-c9efad79883d admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:11.048029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603c429-b05c-4124-b680-c9efad79883d admin admin] PATH_INFO: `/v3/projects/36c976f9546746d293b7a29600a0fad3/users/0e6cce45bcf44dc18fff389fd75e95db/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:11.070947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603c429-b05c-4124-b680-c9efad79883d admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c976f9546746d293b7a29600a0fad3, user_id=0e6cce45bcf44dc18fff389fd75e95db, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:11.076848 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603c429-b05c-4124-b680-c9efad79883d admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:11.263365 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1153/2306] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:59:11 2022] PUT /identity/v3/projects/36c976f9546746d293b7a29600a0fad3/users/0e6cce45bcf44dc18fff389fd75e95db/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:59:11.268932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf6de3-6b02-4ba0-be66-cff2d7ea5268 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:11.269874 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf6de3-6b02-4ba0-be66-cff2d7ea5268 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:11.270299 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf6de3-6b02-4ba0-be66-cff2d7ea5268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:11.329492 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-50bf6de3-6b02-4ba0-be66-cff2d7ea5268 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:59:11.331186 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-50bf6de3-6b02-4ba0-be66-cff2d7ea5268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:11.425651 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1154/2307] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:59:11.436837 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603c429-b05c-4124-b680-c9efad79883d admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:11.438864 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8603c429-b05c-4124-b680-c9efad79883d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:11.553771 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603c429-b05c-4124-b680-c9efad79883d admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:11.558036 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8ef6f-d14a-4a06-b5d0-4f88ab5a444e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:11.558996 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8ef6f-d14a-4a06-b5d0-4f88ab5a444e service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:11.559429 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8ef6f-d14a-4a06-b5d0-4f88ab5a444e service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:11.559872 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8ef6f-d14a-4a06-b5d0-4f88ab5a444e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:11.572218 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8ef6f-d14a-4a06-b5d0-4f88ab5a444e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:11.574030 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8ef6f-d14a-4a06-b5d0-4f88ab5a444e service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:11.588398 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1154/2308] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:59:14.878135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf6de3-6b02-4ba0-be66-cff2d7ea5268 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:14.881311 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-50bf6de3-6b02-4ba0-be66-cff2d7ea5268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:15.070948 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf6de3-6b02-4ba0-be66-cff2d7ea5268 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:15.077109 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715e67b-8ff8-47e1-9b43-d0202572e067 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e166c6b0e5542f7b912cbefa88bb5f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:15.077763 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715e67b-8ff8-47e1-9b43-d0202572e067 service placement] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:15.078040 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715e67b-8ff8-47e1-9b43-d0202572e067 service placement] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:15.078314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715e67b-8ff8-47e1-9b43-d0202572e067 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:15.080787 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a715e67b-8ff8-47e1-9b43-d0202572e067 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:15.109852 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715e67b-8ff8-47e1-9b43-d0202572e067 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:15.113160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715e67b-8ff8-47e1-9b43-d0202572e067 service placement] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:15.133998 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1155/2309] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:59:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:59:15.181889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee66259-ff59-47cc-aa0a-be1ec29809ab None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:15.183426 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee66259-ff59-47cc-aa0a-be1ec29809ab None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:15.183870 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee66259-ff59-47cc-aa0a-be1ec29809ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:15.224722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-2ee66259-ff59-47cc-aa0a-be1ec29809ab None None] MFA Rules not processed for user `e25a03e7055a43af8da10c5f041f3cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:59:15.227376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-2ee66259-ff59-47cc-aa0a-be1ec29809ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:15.347338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1155/2310] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:59:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:59:22.329315 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34068e-0e5e-4f7c-bd32-0138eea3d73c None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:22.330893 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34068e-0e5e-4f7c-bd32-0138eea3d73c None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:22.330893 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34068e-0e5e-4f7c-bd32-0138eea3d73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:22.371953 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-cc34068e-0e5e-4f7c-bd32-0138eea3d73c None None] MFA Rules not processed for user `0e6cce45bcf44dc18fff389fd75e95db`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:59:22.373326 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-cc34068e-0e5e-4f7c-bd32-0138eea3d73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:22.449018 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1156/2311] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:59:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:59:22.454325 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee66259-ff59-47cc-aa0a-be1ec29809ab None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:22.467772 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee66259-ff59-47cc-aa0a-be1ec29809ab None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:22.473659 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46247dfd-b3f7-4ccb-aa0b-210107aee879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:22.475422 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46247dfd-b3f7-4ccb-aa0b-210107aee879 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:22.475422 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46247dfd-b3f7-4ccb-aa0b-210107aee879 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:22.475422 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46247dfd-b3f7-4ccb-aa0b-210107aee879 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:22.475854 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46247dfd-b3f7-4ccb-aa0b-210107aee879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:22.477623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46247dfd-b3f7-4ccb-aa0b-210107aee879 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:22.561739 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb085496-66df-4ea2-99df-5c5018f0cf2e None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:22.562087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb085496-66df-4ea2-99df-5c5018f0cf2e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:22.562581 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb085496-66df-4ea2-99df-5c5018f0cf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:22.581578 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-eb085496-66df-4ea2-99df-5c5018f0cf2e None None] MFA Rules not processed for user `31578f57fff04d8c8fc66631ab07fcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:59:22.582811 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-eb085496-66df-4ea2-99df-5c5018f0cf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:22.612860 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1156/2312] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:59:22 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:59:22.616046 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46247dfd-b3f7-4ccb-aa0b-210107aee879 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:22.696248 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1157/2313] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:59:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:59:22.718134 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46247dfd-b3f7-4ccb-aa0b-210107aee879 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:22.724051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53314fd-870b-41c9-964c-640799df5794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:22.724769 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53314fd-870b-41c9-964c-640799df5794 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:22.725051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53314fd-870b-41c9-964c-640799df5794 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:22.727023 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53314fd-870b-41c9-964c-640799df5794 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:22.727023 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53314fd-870b-41c9-964c-640799df5794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:22.728202 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53314fd-870b-41c9-964c-640799df5794 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:22.871076 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1157/2314] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:59:22 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:59:22.872666 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb085496-66df-4ea2-99df-5c5018f0cf2e None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:22.889833 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb085496-66df-4ea2-99df-5c5018f0cf2e None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:22.904292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d723f-8bf0-44fe-a406-d078a247375e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:22.905832 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d723f-8bf0-44fe-a406-d078a247375e admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:22.905832 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d723f-8bf0-44fe-a406-d078a247375e admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:22.907821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d723f-8bf0-44fe-a406-d078a247375e admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:22.907821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d723f-8bf0-44fe-a406-d078a247375e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:22.908909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d723f-8bf0-44fe-a406-d078a247375e admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:22.929249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1158/2315] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:59:22.935206 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53314fd-870b-41c9-964c-640799df5794 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:22.954641 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53314fd-870b-41c9-964c-640799df5794 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:22.960999 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef38c0-8700-49b4-977c-04a94f0c2395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:22.962079 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef38c0-8700-49b4-977c-04a94f0c2395 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:22.976373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef38c0-8700-49b4-977c-04a94f0c2395 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:22.976373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef38c0-8700-49b4-977c-04a94f0c2395 admin admin] PATH_INFO: `/v3/projects/456b46582603477682a2f5c447cb58cd/users/3aef7113a1c04baeab0b5cab00b544cb/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:22.983455 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef38c0-8700-49b4-977c-04a94f0c2395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=456b46582603477682a2f5c447cb58cd, user_id=3aef7113a1c04baeab0b5cab00b544cb, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:22.989991 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef38c0-8700-49b4-977c-04a94f0c2395 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:23.109441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1158/2316] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:59:22 2022] PUT /identity/v3/projects/456b46582603477682a2f5c447cb58cd/users/3aef7113a1c04baeab0b5cab00b544cb/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:59:23.117571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d723f-8bf0-44fe-a406-d078a247375e admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:23.148787 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d723f-8bf0-44fe-a406-d078a247375e admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:23.334358 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268edbdc-8fb5-453b-970c-b39baaef6bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:23.335162 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268edbdc-8fb5-453b-970c-b39baaef6bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:23.335638 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268edbdc-8fb5-453b-970c-b39baaef6bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:23.336084 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268edbdc-8fb5-453b-970c-b39baaef6bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:23.337006 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268edbdc-8fb5-453b-970c-b39baaef6bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:23.338772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268edbdc-8fb5-453b-970c-b39baaef6bc9 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:23.351428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1159/2317] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:59:23.356904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef38c0-8700-49b4-977c-04a94f0c2395 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:23.387213 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef38c0-8700-49b4-977c-04a94f0c2395 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:23.406039 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ea6e7-f1f1-43c1-9f60-2467b67666bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:23.407728 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ea6e7-f1f1-43c1-9f60-2467b67666bc admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:23.409313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ea6e7-f1f1-43c1-9f60-2467b67666bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:23.409313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ea6e7-f1f1-43c1-9f60-2467b67666bc admin admin] PATH_INFO: `/v3/projects/456b46582603477682a2f5c447cb58cd/users/3aef7113a1c04baeab0b5cab00b544cb/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:23.417974 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ea6e7-f1f1-43c1-9f60-2467b67666bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=456b46582603477682a2f5c447cb58cd, user_id=3aef7113a1c04baeab0b5cab00b544cb, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:23.428001 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ea6e7-f1f1-43c1-9f60-2467b67666bc admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:23.454410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1159/2318] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:59:23 2022] PUT /identity/v3/projects/456b46582603477682a2f5c447cb58cd/users/3aef7113a1c04baeab0b5cab00b544cb/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:59:24.120507 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3585e-d66d-4c7c-9ffe-b788ec4d5fe3 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:24.121035 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3585e-d66d-4c7c-9ffe-b788ec4d5fe3 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:24.121496 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3585e-d66d-4c7c-9ffe-b788ec4d5fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:24.144465 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-42a3585e-d66d-4c7c-9ffe-b788ec4d5fe3 None None] MFA Rules not processed for user `1144e9036d0b4bafb30995ff1a8449ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:59:24.146265 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-42a3585e-d66d-4c7c-9ffe-b788ec4d5fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:24.211477 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1160/2319] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Apr 14 21:59:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:59:24.238412 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ea6e7-f1f1-43c1-9f60-2467b67666bc admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:24.243220 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-3c7ea6e7-f1f1-43c1-9f60-2467b67666bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:24.355553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ea6e7-f1f1-43c1-9f60-2467b67666bc admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:24.362988 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63ff71-cd87-41b9-ba4c-78a8182ffa44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bf55488d046c4be98a903d113c0fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:24.363892 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63ff71-cd87-41b9-ba4c-78a8182ffa44 service swift] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:24.364081 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63ff71-cd87-41b9-ba4c-78a8182ffa44 service swift] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:24.364453 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63ff71-cd87-41b9-ba4c-78a8182ffa44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:24.374844 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63ff71-cd87-41b9-ba4c-78a8182ffa44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:24.376511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63ff71-cd87-41b9-ba4c-78a8182ffa44 service swift] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:24.387088 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1160/2320] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Apr 14 21:59:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 14 21:59:27.964345 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3585e-d66d-4c7c-9ffe-b788ec4d5fe3 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:27.967941 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-42a3585e-d66d-4c7c-9ffe-b788ec4d5fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:28.143194 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3585e-d66d-4c7c-9ffe-b788ec4d5fe3 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:28.143194 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11e8cc-78c3-4d10-8a60-9ae0aef90014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:28.143194 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11e8cc-78c3-4d10-8a60-9ae0aef90014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:28.143194 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11e8cc-78c3-4d10-8a60-9ae0aef90014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:28.143723 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11e8cc-78c3-4d10-8a60-9ae0aef90014 admin admin] PATH_INFO: `/v3/users/30b3175cdac244f6a479e4c764c9dfe2` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:28.143723 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11e8cc-78c3-4d10-8a60-9ae0aef90014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b3175cdac244f6a479e4c764c9dfe2)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:28.143723 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11e8cc-78c3-4d10-8a60-9ae0aef90014 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:28.954738 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ac11e8cc-78c3-4d10-8a60-9ae0aef90014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b3175cdac244f6a479e4c764c9dfe2'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:28.959939 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ac11e8cc-78c3-4d10-8a60-9ae0aef90014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b3175cdac244f6a479e4c764c9dfe2'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:28.996068 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ac11e8cc-78c3-4d10-8a60-9ae0aef90014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b3175cdac244f6a479e4c764c9dfe2'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:29.009259 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ac11e8cc-78c3-4d10-8a60-9ae0aef90014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b3175cdac244f6a479e4c764c9dfe2'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:29.014822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ac11e8cc-78c3-4d10-8a60-9ae0aef90014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b3175cdac244f6a479e4c764c9dfe2'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:29.166007 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1161/2321] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:59:27 2022] DELETE /identity/v3/users/30b3175cdac244f6a479e4c764c9dfe2 => generated 0 bytes in 1203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 21:59:29.170975 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123ff91-fe8f-4de6-b5c4-383e25023bb2 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:29.171786 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123ff91-fe8f-4de6-b5c4-383e25023bb2 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:29.171786 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123ff91-fe8f-4de6-b5c4-383e25023bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:29.205688 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-f123ff91-fe8f-4de6-b5c4-383e25023bb2 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:59:29.208175 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f123ff91-fe8f-4de6-b5c4-383e25023bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:29.358334 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1161/2322] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:59:29.368998 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11e8cc-78c3-4d10-8a60-9ae0aef90014 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:29.371215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ac11e8cc-78c3-4d10-8a60-9ae0aef90014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:29.527922 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11e8cc-78c3-4d10-8a60-9ae0aef90014 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:29.533617 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc80451-5186-4e3e-be26-fc1038e3fa5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:29.540904 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc80451-5186-4e3e-be26-fc1038e3fa5f service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:29.540904 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc80451-5186-4e3e-be26-fc1038e3fa5f service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:29.540904 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc80451-5186-4e3e-be26-fc1038e3fa5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:29.565318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc80451-5186-4e3e-be26-fc1038e3fa5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:29.567330 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc80451-5186-4e3e-be26-fc1038e3fa5f service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:29.585852 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1162/2323] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:59:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:59:30.403640 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123ff91-fe8f-4de6-b5c4-383e25023bb2 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:30.406491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f123ff91-fe8f-4de6-b5c4-383e25023bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:30.442059 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123ff91-fe8f-4de6-b5c4-383e25023bb2 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:30.468430 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a43b6-dfd5-454e-bf20-0a69bc12fe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:30.469942 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a43b6-dfd5-454e-bf20-0a69bc12fe14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:30.470967 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a43b6-dfd5-454e-bf20-0a69bc12fe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:30.471444 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a43b6-dfd5-454e-bf20-0a69bc12fe14 admin admin] PATH_INFO: `/v3/projects/dcbeefbcd4704e288b1a04bcf783e2c8` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:30.474157 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a43b6-dfd5-454e-bf20-0a69bc12fe14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcbeefbcd4704e288b1a04bcf783e2c8)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:30.478906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a43b6-dfd5-454e-bf20-0a69bc12fe14 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:30.712290 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-778a43b6-dfd5-454e-bf20-0a69bc12fe14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcbeefbcd4704e288b1a04bcf783e2c8', 'request_id': 'req-778a43b6-dfd5-454e-bf20-0a69bc12fe14'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:30.833706 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-778a43b6-dfd5-454e-bf20-0a69bc12fe14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcbeefbcd4704e288b1a04bcf783e2c8', 'request_id': 'req-778a43b6-dfd5-454e-bf20-0a69bc12fe14'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:30.851003 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-778a43b6-dfd5-454e-bf20-0a69bc12fe14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcbeefbcd4704e288b1a04bcf783e2c8', 'request_id': 'req-778a43b6-dfd5-454e-bf20-0a69bc12fe14'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:30.898709 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-778a43b6-dfd5-454e-bf20-0a69bc12fe14 admin admin] The token cache is being invalidate because project dcbeefbcd4704e288b1a04bcf783e2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:59:30.901110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-778a43b6-dfd5-454e-bf20-0a69bc12fe14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:30.913996 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-778a43b6-dfd5-454e-bf20-0a69bc12fe14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:30.917635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1162/2324] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:59:30 2022] DELETE /identity/v3/projects/dcbeefbcd4704e288b1a04bcf783e2c8 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:59:30.923234 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af167d-3f1f-4f75-b69a-d523788bc152 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:30.924512 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af167d-3f1f-4f75-b69a-d523788bc152 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:30.925370 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af167d-3f1f-4f75-b69a-d523788bc152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:30.975587 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-62af167d-3f1f-4f75-b69a-d523788bc152 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:59:30.981704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-62af167d-3f1f-4f75-b69a-d523788bc152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:31.197613 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1163/2325] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:59:31.207960 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a83e3-c33d-4d11-8bf5-fdeaa4bccb54 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:31.208249 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a83e3-c33d-4d11-8bf5-fdeaa4bccb54 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:31.208527 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a83e3-c33d-4d11-8bf5-fdeaa4bccb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:31.242827 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-832a83e3-c33d-4d11-8bf5-fdeaa4bccb54 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:59:31.245195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-832a83e3-c33d-4d11-8bf5-fdeaa4bccb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:31.281499 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af167d-3f1f-4f75-b69a-d523788bc152 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:31.293777 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1163/2326] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 21:59:31.303268 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af167d-3f1f-4f75-b69a-d523788bc152 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:31.309887 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169a63e-a4d2-4b10-a2ad-996be4d144e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:31.311065 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169a63e-a4d2-4b10-a2ad-996be4d144e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:31.312484 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169a63e-a4d2-4b10-a2ad-996be4d144e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:31.313016 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169a63e-a4d2-4b10-a2ad-996be4d144e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:31.313850 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169a63e-a4d2-4b10-a2ad-996be4d144e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 21:59:31.314951 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169a63e-a4d2-4b10-a2ad-996be4d144e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:31.316772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169a63e-a4d2-4b10-a2ad-996be4d144e4 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:31.364994 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1164/2327] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 21:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 21:59:31.369824 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a83e3-c33d-4d11-8bf5-fdeaa4bccb54 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:31.388749 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a83e3-c33d-4d11-8bf5-fdeaa4bccb54 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:31.399158 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1737b-5ea4-4697-bc22-ee13de890b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:31.400208 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1737b-5ea4-4697-bc22-ee13de890b7b admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:31.400919 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1737b-5ea4-4697-bc22-ee13de890b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:31.401416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1737b-5ea4-4697-bc22-ee13de890b7b admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:31.402813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1737b-5ea4-4697-bc22-ee13de890b7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:31.407718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1737b-5ea4-4697-bc22-ee13de890b7b admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:31.531323 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1164/2328] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 21:59:31 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 21:59:31.538255 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169a63e-a4d2-4b10-a2ad-996be4d144e4 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:31.573741 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169a63e-a4d2-4b10-a2ad-996be4d144e4 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:31.748046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f1eea-0eae-4e65-982b-47d6cf8187ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:31.749239 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f1eea-0eae-4e65-982b-47d6cf8187ca admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:31.749528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f1eea-0eae-4e65-982b-47d6cf8187ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:31.749803 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f1eea-0eae-4e65-982b-47d6cf8187ca admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:31.750804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f1eea-0eae-4e65-982b-47d6cf8187ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:31.757787 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f1eea-0eae-4e65-982b-47d6cf8187ca admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:32.048669 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1165/2329] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 21:59:31 2022] POST /identity/v3/users => generated 288 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 21:59:32.051298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1737b-5ea4-4697-bc22-ee13de890b7b admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:32.068623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1737b-5ea4-4697-bc22-ee13de890b7b admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:32.077531 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa2c03-eb47-410d-9458-773a4e7023d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:32.078241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa2c03-eb47-410d-9458-773a4e7023d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:32.078522 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa2c03-eb47-410d-9458-773a4e7023d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:32.078794 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa2c03-eb47-410d-9458-773a4e7023d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:32.091371 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa2c03-eb47-410d-9458-773a4e7023d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:32.094154 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa2c03-eb47-410d-9458-773a4e7023d0 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:32.116073 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1165/2330] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 21:59:32.121273 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f1eea-0eae-4e65-982b-47d6cf8187ca admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:32.136011 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f1eea-0eae-4e65-982b-47d6cf8187ca admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:32.153134 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f58fd-fc0c-47fd-b9c2-c6d10245b271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:32.157981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f58fd-fc0c-47fd-b9c2-c6d10245b271 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:32.157981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f58fd-fc0c-47fd-b9c2-c6d10245b271 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:32.157981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f58fd-fc0c-47fd-b9c2-c6d10245b271 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:32.157981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f58fd-fc0c-47fd-b9c2-c6d10245b271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:32.158932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f58fd-fc0c-47fd-b9c2-c6d10245b271 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:32.199729 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1166/2331] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 21:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 21:59:32.200129 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa2c03-eb47-410d-9458-773a4e7023d0 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:32.218601 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa2c03-eb47-410d-9458-773a4e7023d0 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:32.227612 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753d3b3-2b70-4ab5-85d0-8d955fd35a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:32.229616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753d3b3-2b70-4ab5-85d0-8d955fd35a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:32.230243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753d3b3-2b70-4ab5-85d0-8d955fd35a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:32.230814 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753d3b3-2b70-4ab5-85d0-8d955fd35a68 admin admin] PATH_INFO: `/v3/projects/3595660e0edc41ba9caade5cd17a8423/users/62db796d0667487d948284444ac17dfa/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:32.266873 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753d3b3-2b70-4ab5-85d0-8d955fd35a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3595660e0edc41ba9caade5cd17a8423, user_id=62db796d0667487d948284444ac17dfa, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:32.272551 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753d3b3-2b70-4ab5-85d0-8d955fd35a68 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:32.422881 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1166/2332] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 21:59:32 2022] PUT /identity/v3/projects/3595660e0edc41ba9caade5cd17a8423/users/62db796d0667487d948284444ac17dfa/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:59:32.445486 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d2457-a98d-4cdb-9c93-99f5db55d551 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:32.445680 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d2457-a98d-4cdb-9c93-99f5db55d551 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:32.445951 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d2457-a98d-4cdb-9c93-99f5db55d551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:32.533648 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-a84d2457-a98d-4cdb-9c93-99f5db55d551 None None] MFA Rules not processed for user `62db796d0667487d948284444ac17dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:59:32.535728 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a84d2457-a98d-4cdb-9c93-99f5db55d551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:32.691637 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1167/2333] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:59:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:59:32.705119 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753d3b3-2b70-4ab5-85d0-8d955fd35a68 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:32.706422 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f753d3b3-2b70-4ab5-85d0-8d955fd35a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:32.896196 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753d3b3-2b70-4ab5-85d0-8d955fd35a68 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:32.900613 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fdbde-775b-4c6a-bd26-7f0e8cd51037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:32.901466 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fdbde-775b-4c6a-bd26-7f0e8cd51037 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:32.901760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fdbde-775b-4c6a-bd26-7f0e8cd51037 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:32.902622 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fdbde-775b-4c6a-bd26-7f0e8cd51037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:32.931684 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fdbde-775b-4c6a-bd26-7f0e8cd51037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:32.940652 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fdbde-775b-4c6a-bd26-7f0e8cd51037 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:32.989258 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1167/2334] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:59:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:59:35.444003 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f34622-e683-4de4-bc47-35a7b1ae90ed None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:35.445495 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f34622-e683-4de4-bc47-35a7b1ae90ed None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:35.446206 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f34622-e683-4de4-bc47-35a7b1ae90ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:35.505723 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d8f34622-e683-4de4-bc47-35a7b1ae90ed None None] MFA Rules not processed for user `3aef7113a1c04baeab0b5cab00b544cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:59:35.507894 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d8f34622-e683-4de4-bc47-35a7b1ae90ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:35.670244 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1168/2335] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:59:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:59:35.699846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fdbde-775b-4c6a-bd26-7f0e8cd51037 service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:35.701384 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c68fdbde-775b-4c6a-bd26-7f0e8cd51037 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:35.889880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fdbde-775b-4c6a-bd26-7f0e8cd51037 service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:35.905123 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baad589-8833-43d8-816f-4beaf57940ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:35.905823 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baad589-8833-43d8-816f-4beaf57940ac service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:35.906275 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baad589-8833-43d8-816f-4beaf57940ac service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:35.906737 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baad589-8833-43d8-816f-4beaf57940ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:35.912461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-6baad589-8833-43d8-816f-4beaf57940ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:36.010440 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baad589-8833-43d8-816f-4beaf57940ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:36.012132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baad589-8833-43d8-816f-4beaf57940ac service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:36.026637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1168/2336] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:59:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:59:41.756127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982a120-3b28-44a5-abff-a24d64dd029c None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:41.756127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982a120-3b28-44a5-abff-a24d64dd029c None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:41.756127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982a120-3b28-44a5-abff-a24d64dd029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:41.791034 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-b982a120-3b28-44a5-abff-a24d64dd029c None None] MFA Rules not processed for user `0e6cce45bcf44dc18fff389fd75e95db`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:59:41.792903 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b982a120-3b28-44a5-abff-a24d64dd029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:41.806103 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1169/2337] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:59:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:59:52.727922 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baad589-8833-43d8-816f-4beaf57940ac service nova] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:52.802809 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baad589-8833-43d8-816f-4beaf57940ac service nova] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:52.808394 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624198b-5267-4fd8-92ec-1e406b945def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:52.809326 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624198b-5267-4fd8-92ec-1e406b945def admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:52.809605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624198b-5267-4fd8-92ec-1e406b945def admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:52.809875 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624198b-5267-4fd8-92ec-1e406b945def admin admin] PATH_INFO: `/v3/users/62db796d0667487d948284444ac17dfa` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:52.811136 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624198b-5267-4fd8-92ec-1e406b945def admin admin] RBAC: Authorizing `identity:delete_user(user_id=62db796d0667487d948284444ac17dfa)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:52.813221 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624198b-5267-4fd8-92ec-1e406b945def admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:53.062727 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c624198b-5267-4fd8-92ec-1e406b945def admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62db796d0667487d948284444ac17dfa'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:53.063662 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c624198b-5267-4fd8-92ec-1e406b945def admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62db796d0667487d948284444ac17dfa'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:53.079421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c624198b-5267-4fd8-92ec-1e406b945def admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62db796d0667487d948284444ac17dfa'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:53.093073 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c624198b-5267-4fd8-92ec-1e406b945def admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62db796d0667487d948284444ac17dfa'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:53.093782 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c624198b-5267-4fd8-92ec-1e406b945def admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62db796d0667487d948284444ac17dfa'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:53.205044 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1169/2338] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 21:59:52 2022] DELETE /identity/v3/users/62db796d0667487d948284444ac17dfa => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 21:59:53.207250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09725c0c-907d-4b23-8cd4-7213f7532189 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:53.207795 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09725c0c-907d-4b23-8cd4-7213f7532189 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:53.207795 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09725c0c-907d-4b23-8cd4-7213f7532189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:53.228243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-09725c0c-907d-4b23-8cd4-7213f7532189 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 21:59:53.229788 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-09725c0c-907d-4b23-8cd4-7213f7532189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:53.314817 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1170/2339] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 21:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 21:59:53.328837 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624198b-5267-4fd8-92ec-1e406b945def admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:53.331447 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c624198b-5267-4fd8-92ec-1e406b945def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:53.429728 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624198b-5267-4fd8-92ec-1e406b945def admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:53.434165 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a4ee6-c729-4b1b-8bd5-1a86104aa220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:53.435483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a4ee6-c729-4b1b-8bd5-1a86104aa220 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:53.435863 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a4ee6-c729-4b1b-8bd5-1a86104aa220 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:53.436181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a4ee6-c729-4b1b-8bd5-1a86104aa220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:53.449241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a4ee6-c729-4b1b-8bd5-1a86104aa220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:53.450716 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a4ee6-c729-4b1b-8bd5-1a86104aa220 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:53.467036 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1170/2340] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 21:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 21:59:54.083000 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09725c0c-907d-4b23-8cd4-7213f7532189 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 21:59:54.086023 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-09725c0c-907d-4b23-8cd4-7213f7532189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 21:59:54.106192 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09725c0c-907d-4b23-8cd4-7213f7532189 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 21:59:54.111492 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc3ebd-b232-4517-8f31-a71edc0add5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 21:59:54.112819 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc3ebd-b232-4517-8f31-a71edc0add5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 21:59:54.114159 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc3ebd-b232-4517-8f31-a71edc0add5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 21:59:54.114159 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc3ebd-b232-4517-8f31-a71edc0add5a admin admin] PATH_INFO: `/v3/projects/3595660e0edc41ba9caade5cd17a8423` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 21:59:54.114764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc3ebd-b232-4517-8f31-a71edc0add5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3595660e0edc41ba9caade5cd17a8423)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 21:59:54.117039 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc3ebd-b232-4517-8f31-a71edc0add5a admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 21:59:54.401774 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-decc3ebd-b232-4517-8f31-a71edc0add5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3595660e0edc41ba9caade5cd17a8423', 'request_id': 'req-decc3ebd-b232-4517-8f31-a71edc0add5a'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:54.598594 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-decc3ebd-b232-4517-8f31-a71edc0add5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3595660e0edc41ba9caade5cd17a8423', 'request_id': 'req-decc3ebd-b232-4517-8f31-a71edc0add5a'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:54.616614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-decc3ebd-b232-4517-8f31-a71edc0add5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3595660e0edc41ba9caade5cd17a8423', 'request_id': 'req-decc3ebd-b232-4517-8f31-a71edc0add5a'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:54.625294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-decc3ebd-b232-4517-8f31-a71edc0add5a admin admin] The token cache is being invalidate because project 3595660e0edc41ba9caade5cd17a8423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 21:59:54.625586 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-decc3ebd-b232-4517-8f31-a71edc0add5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:54.626844 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-decc3ebd-b232-4517-8f31-a71edc0add5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 21:59:54.628635 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1171/2341] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 21:59:54 2022] DELETE /identity/v3/projects/3595660e0edc41ba9caade5cd17a8423 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:00:16.892819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61117825-7b0f-4573-9e2f-f89831123966 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:16.893772 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61117825-7b0f-4573-9e2f-f89831123966 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:16.894172 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61117825-7b0f-4573-9e2f-f89831123966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:16.915877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-61117825-7b0f-4573-9e2f-f89831123966 None None] MFA Rules not processed for user `1144e9036d0b4bafb30995ff1a8449ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:00:16.917152 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-61117825-7b0f-4573-9e2f-f89831123966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:00:17.006785 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1171/2342] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Apr 14 22:00:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:00:17.040638 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc3ebd-b232-4517-8f31-a71edc0add5a admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:00:17.047632 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-decc3ebd-b232-4517-8f31-a71edc0add5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:00:17.139496 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc3ebd-b232-4517-8f31-a71edc0add5a admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:00:17.154443 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51779e-d7ff-48a2-a8b4-f585dcddaba9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bf55488d046c4be98a903d113c0fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:00:17.155589 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51779e-d7ff-48a2-a8b4-f585dcddaba9 service swift] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:17.155958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51779e-d7ff-48a2-a8b4-f585dcddaba9 service swift] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:17.156137 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51779e-d7ff-48a2-a8b4-f585dcddaba9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:17.173234 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51779e-d7ff-48a2-a8b4-f585dcddaba9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:00:17.174889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51779e-d7ff-48a2-a8b4-f585dcddaba9 service swift] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:00:17.186707 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1172/2343] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Apr 14 22:00:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 14 22:00:22.466336 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61117825-7b0f-4573-9e2f-f89831123966 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:00:22.479307 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-61117825-7b0f-4573-9e2f-f89831123966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:00:22.589721 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61117825-7b0f-4573-9e2f-f89831123966 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:00:22.595622 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdd594-5110-4c57-8b93-05ae7177f316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:00:22.596389 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdd594-5110-4c57-8b93-05ae7177f316 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:22.597639 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdd594-5110-4c57-8b93-05ae7177f316 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:22.598013 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdd594-5110-4c57-8b93-05ae7177f316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:22.600513 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e5cdd594-5110-4c57-8b93-05ae7177f316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:00:22.714011 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdd594-5110-4c57-8b93-05ae7177f316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:00:22.721444 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdd594-5110-4c57-8b93-05ae7177f316 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:00:22.738248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1172/2344] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:00:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:00:30.685264 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6b8fb-c01e-43a4-aa5b-92bf27310a15 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:30.686403 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6b8fb-c01e-43a4-aa5b-92bf27310a15 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:30.686853 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6b8fb-c01e-43a4-aa5b-92bf27310a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:30.713329 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-3fa6b8fb-c01e-43a4-aa5b-92bf27310a15 None None] MFA Rules not processed for user `1144e9036d0b4bafb30995ff1a8449ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:00:30.720052 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-3fa6b8fb-c01e-43a4-aa5b-92bf27310a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:00:30.730017 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1173/2345] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Apr 14 22:00:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:00:30.746266 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdd594-5110-4c57-8b93-05ae7177f316 service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:00:30.762928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdd594-5110-4c57-8b93-05ae7177f316 service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:00:30.770223 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3b9f9-29d1-4d43-b919-35575bcc8858 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bf55488d046c4be98a903d113c0fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:00:30.775057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b9f9-29d1-4d43-b919-35575bcc8858 service swift] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:30.775057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b9f9-29d1-4d43-b919-35575bcc8858 service swift] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:30.775057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b9f9-29d1-4d43-b919-35575bcc8858 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:30.796068 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3b9f9-29d1-4d43-b919-35575bcc8858 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:00:30.797834 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3b9f9-29d1-4d43-b919-35575bcc8858 service swift] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:00:30.809572 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1173/2346] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Apr 14 22:00:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 14 22:00:44.040378 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b02c4-0ae1-47ee-9455-dd6fa606a001 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:44.041041 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b02c4-0ae1-47ee-9455-dd6fa606a001 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:44.041149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b02c4-0ae1-47ee-9455-dd6fa606a001 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:44.043158 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1174/2347] 10.222.0.52 () {54 vars in 921 bytes} [Thu Apr 14 22:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 22:00:44.062891 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d965c-ede8-4491-b33a-a826e33613ba None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:44.064224 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d965c-ede8-4491-b33a-a826e33613ba None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:44.064918 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d965c-ede8-4491-b33a-a826e33613ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:44.156031 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-3c8d965c-ede8-4491-b33a-a826e33613ba None None] MFA Rules not processed for user `e7f3ea629181433eb8c6d5dbc354c141`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:00:44.159501 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-3c8d965c-ede8-4491-b33a-a826e33613ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:00:44.310395 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1174/2348] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Apr 14 22:00:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:00:44.326876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b02c4-0ae1-47ee-9455-dd6fa606a001 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:00:44.328822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a25b02c4-0ae1-47ee-9455-dd6fa606a001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:00:44.485932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b02c4-0ae1-47ee-9455-dd6fa606a001 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:00:44.495255 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361da92-7da6-4040-8f3e-99385dccdde4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d261ec6e42f4be08c4d584fd3d00850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:00:44.508261 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361da92-7da6-4040-8f3e-99385dccdde4 service glance] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:44.508261 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361da92-7da6-4040-8f3e-99385dccdde4 service glance] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:44.508261 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361da92-7da6-4040-8f3e-99385dccdde4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:44.525182 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361da92-7da6-4040-8f3e-99385dccdde4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:00:44.529195 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361da92-7da6-4040-8f3e-99385dccdde4 service glance] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:00:44.549111 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1175/2349] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:00:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:00:44.835948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6019ed-eb99-4e0d-91cd-25e24466e0aa None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:44.836671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6019ed-eb99-4e0d-91cd-25e24466e0aa None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:44.837350 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6019ed-eb99-4e0d-91cd-25e24466e0aa None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:44.839584 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1175/2350] 10.222.0.52 () {54 vars in 921 bytes} [Thu Apr 14 22:00:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 22:00:44.849263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52489690-1123-4c2e-829e-3d19c16960d3 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:44.849712 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52489690-1123-4c2e-829e-3d19c16960d3 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:44.850147 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52489690-1123-4c2e-829e-3d19c16960d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:44.884542 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-52489690-1123-4c2e-829e-3d19c16960d3 None None] MFA Rules not processed for user `1bfbd6a387e44037a58e521230783347`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:00:44.887966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-52489690-1123-4c2e-829e-3d19c16960d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:00:44.896924 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1176/2351] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Apr 14 22:00:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:00:44.910955 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6019ed-eb99-4e0d-91cd-25e24466e0aa None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:00:44.927114 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6019ed-eb99-4e0d-91cd-25e24466e0aa None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:00:44.933068 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87b0f0-9fee-4811-985d-106ee093a07e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:00:44.934707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87b0f0-9fee-4811-985d-106ee093a07e service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:44.935278 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87b0f0-9fee-4811-985d-106ee093a07e service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:44.935880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87b0f0-9fee-4811-985d-106ee093a07e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:44.950985 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87b0f0-9fee-4811-985d-106ee093a07e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:00:44.953852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87b0f0-9fee-4811-985d-106ee093a07e service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:00:44.970982 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1176/2352] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:00:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:00:45.156274 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde022b4-080e-41d3-a153-4e5dbda70b01 None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:45.157505 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde022b4-080e-41d3-a153-4e5dbda70b01 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:45.157951 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde022b4-080e-41d3-a153-4e5dbda70b01 None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:45.159832 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1177/2353] 10.222.0.52 () {54 vars in 921 bytes} [Thu Apr 14 22:00:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 22:00:45.175017 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2f476-ffa0-4a95-98b2-4a7e269dd15b None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:45.175567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2f476-ffa0-4a95-98b2-4a7e269dd15b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:45.175567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2f476-ffa0-4a95-98b2-4a7e269dd15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:45.199077 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-88d2f476-ffa0-4a95-98b2-4a7e269dd15b None None] MFA Rules not processed for user `e7f3ea629181433eb8c6d5dbc354c141`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:00:45.200859 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-88d2f476-ffa0-4a95-98b2-4a7e269dd15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:00:45.219108 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1177/2354] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Apr 14 22:00:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:00:45.237083 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde022b4-080e-41d3-a153-4e5dbda70b01 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:00:45.256506 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde022b4-080e-41d3-a153-4e5dbda70b01 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:00:45.261982 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a04709-4457-49a4-bedc-d7e503d569e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:00:45.263018 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a04709-4457-49a4-bedc-d7e503d569e5 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:45.263572 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a04709-4457-49a4-bedc-d7e503d569e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:45.263927 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a04709-4457-49a4-bedc-d7e503d569e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:45.279421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a04709-4457-49a4-bedc-d7e503d569e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:00:45.282070 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a04709-4457-49a4-bedc-d7e503d569e5 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:00:45.313125 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1178/2355] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:00:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:00:49.535978 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2f476-ffa0-4a95-98b2-4a7e269dd15b None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:00:49.550083 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2f476-ffa0-4a95-98b2-4a7e269dd15b None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:00:49.555333 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95671c9-bbe3-4d33-ad0c-2cca15188160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:00:49.556397 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95671c9-bbe3-4d33-ad0c-2cca15188160 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:49.556998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95671c9-bbe3-4d33-ad0c-2cca15188160 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:49.557430 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95671c9-bbe3-4d33-ad0c-2cca15188160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:49.560250 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f95671c9-bbe3-4d33-ad0c-2cca15188160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:00:49.691278 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95671c9-bbe3-4d33-ad0c-2cca15188160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:00:49.694098 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95671c9-bbe3-4d33-ad0c-2cca15188160 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:00:49.724945 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1178/2356] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:00:49 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:00:52.356907 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05ca2f-246b-4ba2-b5a8-91704396968a None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:52.357536 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05ca2f-246b-4ba2-b5a8-91704396968a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:52.357935 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05ca2f-246b-4ba2-b5a8-91704396968a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:52.385755 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-1a05ca2f-246b-4ba2-b5a8-91704396968a None None] MFA Rules not processed for user `1144e9036d0b4bafb30995ff1a8449ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:00:52.387005 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1a05ca2f-246b-4ba2-b5a8-91704396968a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:00:52.396344 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1179/2357] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Apr 14 22:00:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:00:52.412329 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95671c9-bbe3-4d33-ad0c-2cca15188160 service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:00:52.425522 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95671c9-bbe3-4d33-ad0c-2cca15188160 service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:00:52.431187 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010bc42-228a-400e-8ac7-176412037bb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bf55488d046c4be98a903d113c0fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:00:52.431875 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010bc42-228a-400e-8ac7-176412037bb5 service swift] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:52.432146 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010bc42-228a-400e-8ac7-176412037bb5 service swift] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:52.432419 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010bc42-228a-400e-8ac7-176412037bb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:52.442061 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010bc42-228a-400e-8ac7-176412037bb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:00:52.443680 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010bc42-228a-400e-8ac7-176412037bb5 service swift] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:00:52.459882 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1179/2358] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Apr 14 22:00:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 14 22:00:53.489040 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49d2f4-b8d2-4315-96a4-3eec320b948e None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:53.489689 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49d2f4-b8d2-4315-96a4-3eec320b948e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:53.489689 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49d2f4-b8d2-4315-96a4-3eec320b948e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:53.520111 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-8a49d2f4-b8d2-4315-96a4-3eec320b948e None None] MFA Rules not processed for user `1144e9036d0b4bafb30995ff1a8449ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:00:53.527019 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-8a49d2f4-b8d2-4315-96a4-3eec320b948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:00:53.556032 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1180/2359] 10.222.0.52 () {58 vars in 967 bytes} [Thu Apr 14 22:00:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:00:53.576768 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010bc42-228a-400e-8ac7-176412037bb5 service swift] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:00:53.593892 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010bc42-228a-400e-8ac7-176412037bb5 service swift] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:00:53.603215 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e1699-f5a9-4fcb-a5b2-6925b4138d4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bf55488d046c4be98a903d113c0fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:00:53.604256 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e1699-f5a9-4fcb-a5b2-6925b4138d4f service swift] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:53.604880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e1699-f5a9-4fcb-a5b2-6925b4138d4f service swift] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:53.605312 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e1699-f5a9-4fcb-a5b2-6925b4138d4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:53.619196 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e1699-f5a9-4fcb-a5b2-6925b4138d4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:00:53.622509 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e1699-f5a9-4fcb-a5b2-6925b4138d4f service swift] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:00:53.638016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1180/2360] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Apr 14 22:00:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 14 22:00:59.200748 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49d2f4-b8d2-4315-96a4-3eec320b948e None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:00:59.202160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-8a49d2f4-b8d2-4315-96a4-3eec320b948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:00:59.295645 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49d2f4-b8d2-4315-96a4-3eec320b948e None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:00:59.301132 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03142554-4edf-4ca6-9b99-698cb5c12dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:00:59.302020 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03142554-4edf-4ca6-9b99-698cb5c12dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:00:59.302305 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03142554-4edf-4ca6-9b99-698cb5c12dca admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:00:59.302581 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03142554-4edf-4ca6-9b99-698cb5c12dca admin admin] PATH_INFO: `/v3/users/31578f57fff04d8c8fc66631ab07fcc0` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:00:59.318584 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03142554-4edf-4ca6-9b99-698cb5c12dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=31578f57fff04d8c8fc66631ab07fcc0)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:00:59.320952 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03142554-4edf-4ca6-9b99-698cb5c12dca admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:00:59.601279 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-03142554-4edf-4ca6-9b99-698cb5c12dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31578f57fff04d8c8fc66631ab07fcc0'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:00:59.602798 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-03142554-4edf-4ca6-9b99-698cb5c12dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31578f57fff04d8c8fc66631ab07fcc0'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:00:59.620590 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-03142554-4edf-4ca6-9b99-698cb5c12dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31578f57fff04d8c8fc66631ab07fcc0'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:00:59.629127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-03142554-4edf-4ca6-9b99-698cb5c12dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31578f57fff04d8c8fc66631ab07fcc0'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:00:59.629982 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-03142554-4edf-4ca6-9b99-698cb5c12dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31578f57fff04d8c8fc66631ab07fcc0'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:00:59.988289 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1181/2361] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:00:59 2022] DELETE /identity/v3/users/31578f57fff04d8c8fc66631ab07fcc0 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:01:00.362388 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e1699-f5a9-4fcb-a5b2-6925b4138d4f service swift] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:00.378256 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e1699-f5a9-4fcb-a5b2-6925b4138d4f service swift] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:00.463341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25189b-5c65-45ad-9999-229fd9ba54dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:00.464254 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25189b-5c65-45ad-9999-229fd9ba54dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:00.464854 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25189b-5c65-45ad-9999-229fd9ba54dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:00.465129 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25189b-5c65-45ad-9999-229fd9ba54dc admin admin] PATH_INFO: `/v3/projects/f46eb89de2af4cf397780d5edbca27ad` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:00.466410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25189b-5c65-45ad-9999-229fd9ba54dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f46eb89de2af4cf397780d5edbca27ad)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:00.468691 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25189b-5c65-45ad-9999-229fd9ba54dc admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:00.648939 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ad25189b-5c65-45ad-9999-229fd9ba54dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f46eb89de2af4cf397780d5edbca27ad', 'request_id': 'req-ad25189b-5c65-45ad-9999-229fd9ba54dc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:01:00.742820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ad25189b-5c65-45ad-9999-229fd9ba54dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f46eb89de2af4cf397780d5edbca27ad', 'request_id': 'req-ad25189b-5c65-45ad-9999-229fd9ba54dc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:01:00.757666 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ad25189b-5c65-45ad-9999-229fd9ba54dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f46eb89de2af4cf397780d5edbca27ad', 'request_id': 'req-ad25189b-5c65-45ad-9999-229fd9ba54dc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:01:00.771681 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ad25189b-5c65-45ad-9999-229fd9ba54dc admin admin] The token cache is being invalidate because project f46eb89de2af4cf397780d5edbca27ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:01:00.771993 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ad25189b-5c65-45ad-9999-229fd9ba54dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:01:00.772701 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ad25189b-5c65-45ad-9999-229fd9ba54dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:01:00.774403 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1181/2362] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:01:00 2022] DELETE /identity/v3/projects/f46eb89de2af4cf397780d5edbca27ad => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:01:00.781308 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58064e57-0087-4b92-bbba-884b60a7f290 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:00.781950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58064e57-0087-4b92-bbba-884b60a7f290 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:00.781950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58064e57-0087-4b92-bbba-884b60a7f290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:00.802578 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-58064e57-0087-4b92-bbba-884b60a7f290 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:01:00.804115 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-58064e57-0087-4b92-bbba-884b60a7f290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:00.887653 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1182/2363] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:01:00.899678 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414f194-690c-4ed1-be2f-0ae6354b380a None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:00.900008 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414f194-690c-4ed1-be2f-0ae6354b380a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:00.900544 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414f194-690c-4ed1-be2f-0ae6354b380a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:00.926207 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-e414f194-690c-4ed1-be2f-0ae6354b380a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:01:00.927880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e414f194-690c-4ed1-be2f-0ae6354b380a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:00.937579 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1182/2364] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:01:00.942477 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58064e57-0087-4b92-bbba-884b60a7f290 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:00.954442 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58064e57-0087-4b92-bbba-884b60a7f290 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:00.960309 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb7f66-0955-4076-b212-49278f710e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:00.961160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb7f66-0955-4076-b212-49278f710e30 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:00.961543 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb7f66-0955-4076-b212-49278f710e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:00.961920 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb7f66-0955-4076-b212-49278f710e30 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:00.962780 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb7f66-0955-4076-b212-49278f710e30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:01:00.963105 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb7f66-0955-4076-b212-49278f710e30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:00.964829 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb7f66-0955-4076-b212-49278f710e30 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:00.979015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1183/2365] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:01:00.986427 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414f194-690c-4ed1-be2f-0ae6354b380a None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:01.004851 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414f194-690c-4ed1-be2f-0ae6354b380a None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:01.012466 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed035f-ab9a-4bba-8986-eb1470e60e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:01.013331 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed035f-ab9a-4bba-8986-eb1470e60e8e admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:01.013660 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed035f-ab9a-4bba-8986-eb1470e60e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:01.013970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed035f-ab9a-4bba-8986-eb1470e60e8e admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:01.014771 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed035f-ab9a-4bba-8986-eb1470e60e8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:01.017489 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed035f-ab9a-4bba-8986-eb1470e60e8e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:01.213244 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1183/2366] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:01:00 2022] POST /identity/v3/projects => generated 369 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:01:01.218636 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb7f66-0955-4076-b212-49278f710e30 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:01.229378 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb7f66-0955-4076-b212-49278f710e30 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:01.320186 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7ee99-d654-4e83-a79b-a56b7d4ede7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:01.320957 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7ee99-d654-4e83-a79b-a56b7d4ede7a admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:01.321244 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7ee99-d654-4e83-a79b-a56b7d4ede7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:01.321514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7ee99-d654-4e83-a79b-a56b7d4ede7a admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:01.322402 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7ee99-d654-4e83-a79b-a56b7d4ede7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:01.324937 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7ee99-d654-4e83-a79b-a56b7d4ede7a admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:01.514298 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1184/2367] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:01:01 2022] POST /identity/v3/users => generated 285 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:01:01.518815 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed035f-ab9a-4bba-8986-eb1470e60e8e admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:01.529429 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed035f-ab9a-4bba-8986-eb1470e60e8e admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:01.534877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e16143-7ba5-4043-8eaf-0d54e2501b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:01.535546 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e16143-7ba5-4043-8eaf-0d54e2501b03 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:01.535831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e16143-7ba5-4043-8eaf-0d54e2501b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:01.536109 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e16143-7ba5-4043-8eaf-0d54e2501b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:01.536942 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e16143-7ba5-4043-8eaf-0d54e2501b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:01.538667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e16143-7ba5-4043-8eaf-0d54e2501b03 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:01.550803 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1184/2368] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:01:01.554685 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7ee99-d654-4e83-a79b-a56b7d4ede7a admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:01.566117 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7ee99-d654-4e83-a79b-a56b7d4ede7a admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:01.571985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6eaf1b-4d50-4e1e-90a8-678965ef8b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:01.572879 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6eaf1b-4d50-4e1e-90a8-678965ef8b8a admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:01.573241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6eaf1b-4d50-4e1e-90a8-678965ef8b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:01.573572 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6eaf1b-4d50-4e1e-90a8-678965ef8b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:01.574410 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6eaf1b-4d50-4e1e-90a8-678965ef8b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:01.576261 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6eaf1b-4d50-4e1e-90a8-678965ef8b8a admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:01.588292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1185/2369] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:01:01.594248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e16143-7ba5-4043-8eaf-0d54e2501b03 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:01.604655 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e16143-7ba5-4043-8eaf-0d54e2501b03 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:01.610733 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313c9e9-b35b-493c-a483-e7b4ac20c5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:01.612054 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313c9e9-b35b-493c-a483-e7b4ac20c5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:01.612328 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313c9e9-b35b-493c-a483-e7b4ac20c5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:01.613104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313c9e9-b35b-493c-a483-e7b4ac20c5ac admin admin] PATH_INFO: `/v3/projects/b680598250b64317b260f60f04a11437/users/a8c88ef051c04725b52e79aabe5320c9/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:01.632878 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313c9e9-b35b-493c-a483-e7b4ac20c5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b680598250b64317b260f60f04a11437, user_id=a8c88ef051c04725b52e79aabe5320c9, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:01.635592 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313c9e9-b35b-493c-a483-e7b4ac20c5ac admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:02.135147 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1185/2370] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:01:01 2022] PUT /identity/v3/projects/b680598250b64317b260f60f04a11437/users/a8c88ef051c04725b52e79aabe5320c9/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:01:02.146360 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd716911-23a5-476a-ad79-c1c46e6586a2 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:02.147243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd716911-23a5-476a-ad79-c1c46e6586a2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:02.147243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd716911-23a5-476a-ad79-c1c46e6586a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:02.180171 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-dd716911-23a5-476a-ad79-c1c46e6586a2 None None] MFA Rules not processed for user `a8c88ef051c04725b52e79aabe5320c9`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:01:02.181435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-dd716911-23a5-476a-ad79-c1c46e6586a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:02.266928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1186/2371] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:01:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:01:02.281161 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313c9e9-b35b-493c-a483-e7b4ac20c5ac admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:02.283367 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-a313c9e9-b35b-493c-a483-e7b4ac20c5ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:02.351560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313c9e9-b35b-493c-a483-e7b4ac20c5ac admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:02.358206 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dd2c1-47f4-4c7e-9397-28892010c847 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d261ec6e42f4be08c4d584fd3d00850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:02.359014 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dd2c1-47f4-4c7e-9397-28892010c847 service glance] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:02.359389 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dd2c1-47f4-4c7e-9397-28892010c847 service glance] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:02.359884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dd2c1-47f4-4c7e-9397-28892010c847 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:02.371133 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339dd2c1-47f4-4c7e-9397-28892010c847 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:02.373019 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339dd2c1-47f4-4c7e-9397-28892010c847 service glance] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:02.388463 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1186/2372] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:01:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:01:10.293774 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd716911-23a5-476a-ad79-c1c46e6586a2 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:10.296314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-dd716911-23a5-476a-ad79-c1c46e6586a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:10.401550 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd716911-23a5-476a-ad79-c1c46e6586a2 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:10.405728 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451099b5-a09c-4991-bfbc-832c875fa008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:10.406426 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451099b5-a09c-4991-bfbc-832c875fa008 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:10.406744 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451099b5-a09c-4991-bfbc-832c875fa008 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:10.407016 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451099b5-a09c-4991-bfbc-832c875fa008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:10.409139 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-451099b5-a09c-4991-bfbc-832c875fa008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:10.531031 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451099b5-a09c-4991-bfbc-832c875fa008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:10.532421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451099b5-a09c-4991-bfbc-832c875fa008 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:10.552052 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1187/2373] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:01:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:01:11.785975 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dd2c1-47f4-4c7e-9397-28892010c847 service glance] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:11.787906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-339dd2c1-47f4-4c7e-9397-28892010c847 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:11.803524 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dd2c1-47f4-4c7e-9397-28892010c847 service glance] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:11.807337 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ba9bd-8e8b-4cad-a8c1-dc9d96bcf973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:11.807962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ba9bd-8e8b-4cad-a8c1-dc9d96bcf973 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:11.808267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ba9bd-8e8b-4cad-a8c1-dc9d96bcf973 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:11.808539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ba9bd-8e8b-4cad-a8c1-dc9d96bcf973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:11.810418 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-db9ba9bd-8e8b-4cad-a8c1-dc9d96bcf973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:11.826000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ba9bd-8e8b-4cad-a8c1-dc9d96bcf973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:11.828430 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ba9bd-8e8b-4cad-a8c1-dc9d96bcf973 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:11.840304 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1187/2374] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:01:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:01:20.245652 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451099b5-a09c-4991-bfbc-832c875fa008 service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:20.247126 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-451099b5-a09c-4991-bfbc-832c875fa008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:20.261929 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451099b5-a09c-4991-bfbc-832c875fa008 service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:20.270103 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d29bcd-409d-426e-8115-b26b14a55ec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:20.270792 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d29bcd-409d-426e-8115-b26b14a55ec5 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:20.271103 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d29bcd-409d-426e-8115-b26b14a55ec5 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:20.271353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d29bcd-409d-426e-8115-b26b14a55ec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:20.273489 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-64d29bcd-409d-426e-8115-b26b14a55ec5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:20.346815 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d29bcd-409d-426e-8115-b26b14a55ec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:20.348473 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d29bcd-409d-426e-8115-b26b14a55ec5 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:20.363578 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1188/2375] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:01:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:01:24.013566 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2984627-0936-4596-aec6-8a0f9d495f64 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:24.014637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2984627-0936-4596-aec6-8a0f9d495f64 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:24.014637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2984627-0936-4596-aec6-8a0f9d495f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:24.036866 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-d2984627-0936-4596-aec6-8a0f9d495f64 None None] MFA Rules not processed for user `1144e9036d0b4bafb30995ff1a8449ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:01:24.038371 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d2984627-0936-4596-aec6-8a0f9d495f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:24.099361 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1188/2376] 10.222.0.52 () {58 vars in 967 bytes} [Thu Apr 14 22:01:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:01:24.125599 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d29bcd-409d-426e-8115-b26b14a55ec5 service nova] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:24.127044 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-64d29bcd-409d-426e-8115-b26b14a55ec5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:24.196929 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d29bcd-409d-426e-8115-b26b14a55ec5 service nova] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:24.202617 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fd6a6-d0d3-47eb-b74d-145bbcb65ca6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bf55488d046c4be98a903d113c0fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:24.203255 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fd6a6-d0d3-47eb-b74d-145bbcb65ca6 service swift] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:24.203528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fd6a6-d0d3-47eb-b74d-145bbcb65ca6 service swift] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:24.203796 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fd6a6-d0d3-47eb-b74d-145bbcb65ca6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:24.211915 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fd6a6-d0d3-47eb-b74d-145bbcb65ca6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:24.213658 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fd6a6-d0d3-47eb-b74d-145bbcb65ca6 service swift] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:24.222471 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1189/2377] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Apr 14 22:01:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 14 22:01:47.595592 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2984627-0936-4596-aec6-8a0f9d495f64 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:47.659539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2984627-0936-4596-aec6-8a0f9d495f64 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:47.664874 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c1a76-5aa3-4dba-9f20-97619fe4e4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:47.665683 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c1a76-5aa3-4dba-9f20-97619fe4e4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:47.665975 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c1a76-5aa3-4dba-9f20-97619fe4e4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:47.666230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c1a76-5aa3-4dba-9f20-97619fe4e4d0 admin admin] PATH_INFO: `/v3/users/a8c88ef051c04725b52e79aabe5320c9` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:47.667475 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c1a76-5aa3-4dba-9f20-97619fe4e4d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8c88ef051c04725b52e79aabe5320c9)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:47.669596 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c1a76-5aa3-4dba-9f20-97619fe4e4d0 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:47.931299 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ab2c1a76-5aa3-4dba-9f20-97619fe4e4d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8c88ef051c04725b52e79aabe5320c9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:01:47.931905 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ab2c1a76-5aa3-4dba-9f20-97619fe4e4d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8c88ef051c04725b52e79aabe5320c9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:01:47.944353 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ab2c1a76-5aa3-4dba-9f20-97619fe4e4d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8c88ef051c04725b52e79aabe5320c9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:01:47.951174 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ab2c1a76-5aa3-4dba-9f20-97619fe4e4d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8c88ef051c04725b52e79aabe5320c9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:01:47.951962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ab2c1a76-5aa3-4dba-9f20-97619fe4e4d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8c88ef051c04725b52e79aabe5320c9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:01:48.030928 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1189/2378] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:01:47 2022] DELETE /identity/v3/users/a8c88ef051c04725b52e79aabe5320c9 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:01:48.035576 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31fdab-7901-4359-a950-705907191923 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:48.036264 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31fdab-7901-4359-a950-705907191923 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:48.036264 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31fdab-7901-4359-a950-705907191923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:48.054249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-8f31fdab-7901-4359-a950-705907191923 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:01:48.055728 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-8f31fdab-7901-4359-a950-705907191923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:48.115159 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1190/2379] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:01:48.125820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c1a76-5aa3-4dba-9f20-97619fe4e4d0 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:48.127332 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ab2c1a76-5aa3-4dba-9f20-97619fe4e4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:48.201309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c1a76-5aa3-4dba-9f20-97619fe4e4d0 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:48.205427 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b34784-6d2e-4ce8-ad7d-6834b6d0ff81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:48.206110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b34784-6d2e-4ce8-ad7d-6834b6d0ff81 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:48.206433 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b34784-6d2e-4ce8-ad7d-6834b6d0ff81 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:48.206807 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b34784-6d2e-4ce8-ad7d-6834b6d0ff81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:48.217576 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b34784-6d2e-4ce8-ad7d-6834b6d0ff81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:48.219505 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b34784-6d2e-4ce8-ad7d-6834b6d0ff81 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:48.230162 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1190/2380] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:01:48.787683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31fdab-7901-4359-a950-705907191923 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:48.789570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-8f31fdab-7901-4359-a950-705907191923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:48.802874 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31fdab-7901-4359-a950-705907191923 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:48.808712 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edee4ff-9a5e-4617-84a1-e755de76c25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:48.809594 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edee4ff-9a5e-4617-84a1-e755de76c25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:48.809866 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edee4ff-9a5e-4617-84a1-e755de76c25c admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:48.810197 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edee4ff-9a5e-4617-84a1-e755de76c25c admin admin] PATH_INFO: `/v3/projects/b680598250b64317b260f60f04a11437` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:48.811602 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edee4ff-9a5e-4617-84a1-e755de76c25c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b680598250b64317b260f60f04a11437)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:48.814705 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edee4ff-9a5e-4617-84a1-e755de76c25c admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:48.958583 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7edee4ff-9a5e-4617-84a1-e755de76c25c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b680598250b64317b260f60f04a11437', 'request_id': 'req-7edee4ff-9a5e-4617-84a1-e755de76c25c'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:01:49.071125 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7edee4ff-9a5e-4617-84a1-e755de76c25c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b680598250b64317b260f60f04a11437', 'request_id': 'req-7edee4ff-9a5e-4617-84a1-e755de76c25c'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:01:49.078635 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7edee4ff-9a5e-4617-84a1-e755de76c25c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b680598250b64317b260f60f04a11437', 'request_id': 'req-7edee4ff-9a5e-4617-84a1-e755de76c25c'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:01:49.089549 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7edee4ff-9a5e-4617-84a1-e755de76c25c admin admin] The token cache is being invalidate because project b680598250b64317b260f60f04a11437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:01:49.089837 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7edee4ff-9a5e-4617-84a1-e755de76c25c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:01:49.090502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7edee4ff-9a5e-4617-84a1-e755de76c25c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:01:49.092232 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1191/2381] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:01:48 2022] DELETE /identity/v3/projects/b680598250b64317b260f60f04a11437 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:01:49.098725 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde4b8a-cf7e-4fe5-85d9-81985cb636ec None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:49.099227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde4b8a-cf7e-4fe5-85d9-81985cb636ec None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:49.099369 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde4b8a-cf7e-4fe5-85d9-81985cb636ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:49.118042 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-edde4b8a-cf7e-4fe5-85d9-81985cb636ec None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:01:49.119262 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-edde4b8a-cf7e-4fe5-85d9-81985cb636ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:49.182863 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1191/2382] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:01:49.192845 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4baa2-6012-49df-a328-6cbb3c2f7451 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:49.193286 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4baa2-6012-49df-a328-6cbb3c2f7451 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:49.193569 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4baa2-6012-49df-a328-6cbb3c2f7451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:49.213519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d2d4baa2-6012-49df-a328-6cbb3c2f7451 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:01:49.214733 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d2d4baa2-6012-49df-a328-6cbb3c2f7451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:49.223854 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1192/2383] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:01:49.228491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde4b8a-cf7e-4fe5-85d9-81985cb636ec None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:49.239098 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde4b8a-cf7e-4fe5-85d9-81985cb636ec None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:49.243683 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1934bbf-fffc-4c21-8484-50c6592a2cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:49.244333 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1934bbf-fffc-4c21-8484-50c6592a2cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:49.244670 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1934bbf-fffc-4c21-8484-50c6592a2cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:49.244951 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1934bbf-fffc-4c21-8484-50c6592a2cc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:49.245667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1934bbf-fffc-4c21-8484-50c6592a2cc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:01:49.245971 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1934bbf-fffc-4c21-8484-50c6592a2cc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:49.248686 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1934bbf-fffc-4c21-8484-50c6592a2cc2 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:49.260839 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1192/2384] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:01:49.265988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4baa2-6012-49df-a328-6cbb3c2f7451 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:49.275443 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4baa2-6012-49df-a328-6cbb3c2f7451 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:49.280432 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde40c7e-adf8-4934-922e-2088291df81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:49.281175 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde40c7e-adf8-4934-922e-2088291df81c admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:49.281460 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde40c7e-adf8-4934-922e-2088291df81c admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:49.281752 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde40c7e-adf8-4934-922e-2088291df81c admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:49.282446 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde40c7e-adf8-4934-922e-2088291df81c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:49.284341 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde40c7e-adf8-4934-922e-2088291df81c admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:49.439161 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1193/2385] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:01:49 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:01:49.445045 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1934bbf-fffc-4c21-8484-50c6592a2cc2 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:49.456277 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1934bbf-fffc-4c21-8484-50c6592a2cc2 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:49.521175 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024c7fd-7d55-4b1b-ae0b-04acec0ef42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:49.521852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024c7fd-7d55-4b1b-ae0b-04acec0ef42b admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:49.522132 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024c7fd-7d55-4b1b-ae0b-04acec0ef42b admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:49.522401 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024c7fd-7d55-4b1b-ae0b-04acec0ef42b admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:49.523129 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024c7fd-7d55-4b1b-ae0b-04acec0ef42b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:49.525177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024c7fd-7d55-4b1b-ae0b-04acec0ef42b admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:49.652852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1193/2386] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:01:49 2022] POST /identity/v3/users => generated 283 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:01:49.654146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde40c7e-adf8-4934-922e-2088291df81c admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:49.664416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde40c7e-adf8-4934-922e-2088291df81c admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:49.669814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c69ca-5d7b-4b55-9b8f-01520dbdb2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:49.670443 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c69ca-5d7b-4b55-9b8f-01520dbdb2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:49.670720 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c69ca-5d7b-4b55-9b8f-01520dbdb2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:49.670993 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c69ca-5d7b-4b55-9b8f-01520dbdb2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:49.671726 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c69ca-5d7b-4b55-9b8f-01520dbdb2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:49.673436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c69ca-5d7b-4b55-9b8f-01520dbdb2a4 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:49.684805 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1194/2387] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:01:49.690538 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024c7fd-7d55-4b1b-ae0b-04acec0ef42b admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:49.700847 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024c7fd-7d55-4b1b-ae0b-04acec0ef42b admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:49.707360 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50171155-4b01-4341-adb0-eb617157b8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:49.708051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50171155-4b01-4341-adb0-eb617157b8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:49.708400 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50171155-4b01-4341-adb0-eb617157b8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:49.708768 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50171155-4b01-4341-adb0-eb617157b8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:49.709648 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50171155-4b01-4341-adb0-eb617157b8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:49.711414 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50171155-4b01-4341-adb0-eb617157b8c8 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:49.723289 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1194/2388] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 22:01:49.727734 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c69ca-5d7b-4b55-9b8f-01520dbdb2a4 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:49.739705 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c69ca-5d7b-4b55-9b8f-01520dbdb2a4 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:49.745066 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a1fe4-27b2-49b7-86ec-64286ccafb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:49.746109 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a1fe4-27b2-49b7-86ec-64286ccafb33 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:49.746426 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a1fe4-27b2-49b7-86ec-64286ccafb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:49.746747 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a1fe4-27b2-49b7-86ec-64286ccafb33 admin admin] PATH_INFO: `/v3/projects/7a592cafb5d7403b8a123454ac281c68/users/2886bfb9931044a2ba3c859e347aebee/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:49.766062 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a1fe4-27b2-49b7-86ec-64286ccafb33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a592cafb5d7403b8a123454ac281c68, user_id=2886bfb9931044a2ba3c859e347aebee, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:49.768904 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a1fe4-27b2-49b7-86ec-64286ccafb33 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:49.883582 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1195/2389] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:01:49 2022] PUT /identity/v3/projects/7a592cafb5d7403b8a123454ac281c68/users/2886bfb9931044a2ba3c859e347aebee/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:01:49.897461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7be195-19a7-4620-9dc7-9071fb46d5f4 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:49.897916 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7be195-19a7-4620-9dc7-9071fb46d5f4 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:49.898385 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7be195-19a7-4620-9dc7-9071fb46d5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:49.931532 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-ee7be195-19a7-4620-9dc7-9071fb46d5f4 None None] MFA Rules not processed for user `2886bfb9931044a2ba3c859e347aebee`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:01:49.932768 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ee7be195-19a7-4620-9dc7-9071fb46d5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:50.005015 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1195/2390] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:01:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:01:50.017535 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a1fe4-27b2-49b7-86ec-64286ccafb33 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:50.019297 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-749a1fe4-27b2-49b7-86ec-64286ccafb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:50.082653 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a1fe4-27b2-49b7-86ec-64286ccafb33 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:50.086533 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d743ade-7607-4054-b429-f66e4f536e9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:50.087176 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d743ade-7607-4054-b429-f66e4f536e9b service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:50.087455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d743ade-7607-4054-b429-f66e4f536e9b service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:50.087720 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d743ade-7607-4054-b429-f66e4f536e9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:50.098160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d743ade-7607-4054-b429-f66e4f536e9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:50.099612 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d743ade-7607-4054-b429-f66e4f536e9b service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:50.109870 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1196/2391] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:01:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:01:50.353933 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7be195-19a7-4620-9dc7-9071fb46d5f4 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:01:50.356004 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ee7be195-19a7-4620-9dc7-9071fb46d5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:50.438490 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7be195-19a7-4620-9dc7-9071fb46d5f4 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:01:50.444566 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22221c1e-50c9-48cb-bc59-0251d7282339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:01:50.445251 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22221c1e-50c9-48cb-bc59-0251d7282339 service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:01:50.445529 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22221c1e-50c9-48cb-bc59-0251d7282339 service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:01:50.445802 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22221c1e-50c9-48cb-bc59-0251d7282339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:01:50.447646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-22221c1e-50c9-48cb-bc59-0251d7282339 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:01:50.521110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22221c1e-50c9-48cb-bc59-0251d7282339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:01:50.523389 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22221c1e-50c9-48cb-bc59-0251d7282339 service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:01:50.534190 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1196/2392] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:01:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:02:09.369325 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d743ade-7607-4054-b429-f66e4f536e9b service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:02:09.370872 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9d743ade-7607-4054-b429-f66e4f536e9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:02:09.445129 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d743ade-7607-4054-b429-f66e4f536e9b service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:02:09.451566 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fa2a7-e878-401a-b707-63077473713a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:02:09.452728 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fa2a7-e878-401a-b707-63077473713a service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:02:09.453206 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fa2a7-e878-401a-b707-63077473713a service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:02:09.453666 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fa2a7-e878-401a-b707-63077473713a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:02:09.456675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-608fa2a7-e878-401a-b707-63077473713a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:02:09.473792 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fa2a7-e878-401a-b707-63077473713a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:02:09.476267 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fa2a7-e878-401a-b707-63077473713a service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:02:09.490942 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1197/2393] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:02:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:02:20.132658 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b580ddc-871f-4bc8-a0ce-29cefdbf47e8 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:02:20.134792 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b580ddc-871f-4bc8-a0ce-29cefdbf47e8 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:02:20.135129 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b580ddc-871f-4bc8-a0ce-29cefdbf47e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:02:20.173114 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-9b580ddc-871f-4bc8-a0ce-29cefdbf47e8 None None] MFA Rules not processed for user `f7fe7ea486834f6e9e8a7685d9c36bac`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:02:20.174559 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-9b580ddc-871f-4bc8-a0ce-29cefdbf47e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:02:20.252826 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1197/2394] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:02:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:02:20.665488 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fa2a7-e878-401a-b707-63077473713a service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:02:20.681990 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fa2a7-e878-401a-b707-63077473713a service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:02:20.688220 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8457c-bf8a-4399-93c6-19e37cc759b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:02:20.689396 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8457c-bf8a-4399-93c6-19e37cc759b3 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:02:20.689900 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8457c-bf8a-4399-93c6-19e37cc759b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:02:20.690385 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8457c-bf8a-4399-93c6-19e37cc759b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:02:20.693427 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-2cf8457c-bf8a-4399-93c6-19e37cc759b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:02:20.709649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8457c-bf8a-4399-93c6-19e37cc759b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:02:20.711115 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8457c-bf8a-4399-93c6-19e37cc759b3 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:02:20.720804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1198/2395] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:02:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:02:21.212263 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b580ddc-871f-4bc8-a0ce-29cefdbf47e8 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:02:21.214546 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-9b580ddc-871f-4bc8-a0ce-29cefdbf47e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:02:21.318066 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b580ddc-871f-4bc8-a0ce-29cefdbf47e8 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:02:21.323561 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd6828-1740-4e45-9c8b-81bba5ae53fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e166c6b0e5542f7b912cbefa88bb5f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:02:21.324100 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd6828-1740-4e45-9c8b-81bba5ae53fb service placement] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:02:21.324991 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd6828-1740-4e45-9c8b-81bba5ae53fb service placement] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:02:21.325273 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd6828-1740-4e45-9c8b-81bba5ae53fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:02:21.327289 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-0afd6828-1740-4e45-9c8b-81bba5ae53fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:02:21.339371 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd6828-1740-4e45-9c8b-81bba5ae53fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:02:21.341764 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd6828-1740-4e45-9c8b-81bba5ae53fb service placement] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:02:21.352703 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1198/2396] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:02:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:02:26.306786 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8457c-bf8a-4399-93c6-19e37cc759b3 service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:02:26.326520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8457c-bf8a-4399-93c6-19e37cc759b3 service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:02:26.339022 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de1e9a-0157-4e8c-9cf7-f038d5a88e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:02:26.339926 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de1e9a-0157-4e8c-9cf7-f038d5a88e36 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:02:26.340282 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de1e9a-0157-4e8c-9cf7-f038d5a88e36 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:02:26.340690 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de1e9a-0157-4e8c-9cf7-f038d5a88e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:02:26.342984 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c3de1e9a-0157-4e8c-9cf7-f038d5a88e36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:02:26.357489 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de1e9a-0157-4e8c-9cf7-f038d5a88e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:02:26.359356 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de1e9a-0157-4e8c-9cf7-f038d5a88e36 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:02:26.385432 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1199/2397] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:02:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:02:31.410153 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d1a6b-7b87-4daa-b969-284b2c078967 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:02:31.410701 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d1a6b-7b87-4daa-b969-284b2c078967 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:02:31.410701 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d1a6b-7b87-4daa-b969-284b2c078967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:02:31.429576 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-919d1a6b-7b87-4daa-b969-284b2c078967 None None] MFA Rules not processed for user `136152c5c06b4e44803b127e232ff865`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:02:31.430766 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-919d1a6b-7b87-4daa-b969-284b2c078967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:02:31.438057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1199/2398] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:02:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:02:37.884930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de1e9a-0157-4e8c-9cf7-f038d5a88e36 service nova] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:02:37.886837 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c3de1e9a-0157-4e8c-9cf7-f038d5a88e36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:02:37.905795 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de1e9a-0157-4e8c-9cf7-f038d5a88e36 service nova] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:02:37.912799 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998db488-9a77-429a-9dbd-73d17f24ba88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:02:37.913457 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998db488-9a77-429a-9dbd-73d17f24ba88 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:02:37.913773 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998db488-9a77-429a-9dbd-73d17f24ba88 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:02:37.914050 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998db488-9a77-429a-9dbd-73d17f24ba88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:02:37.915933 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-998db488-9a77-429a-9dbd-73d17f24ba88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:02:37.935649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998db488-9a77-429a-9dbd-73d17f24ba88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:02:37.937599 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998db488-9a77-429a-9dbd-73d17f24ba88 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:02:37.955527 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1200/2399] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:02:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:02:51.653052 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d1a6b-7b87-4daa-b969-284b2c078967 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:02:51.722021 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d1a6b-7b87-4daa-b969-284b2c078967 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:02:51.727733 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367717-5f23-4e30-96d6-a69138bbaf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:02:51.728704 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367717-5f23-4e30-96d6-a69138bbaf5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:02:51.728984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367717-5f23-4e30-96d6-a69138bbaf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:02:51.729257 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367717-5f23-4e30-96d6-a69138bbaf5f admin admin] PATH_INFO: `/v3/users/2886bfb9931044a2ba3c859e347aebee` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:02:51.730654 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a367717-5f23-4e30-96d6-a69138bbaf5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2886bfb9931044a2ba3c859e347aebee)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:02:51.732660 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a367717-5f23-4e30-96d6-a69138bbaf5f admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:02:52.004664 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-6a367717-5f23-4e30-96d6-a69138bbaf5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2886bfb9931044a2ba3c859e347aebee'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:02:52.005351 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-6a367717-5f23-4e30-96d6-a69138bbaf5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2886bfb9931044a2ba3c859e347aebee'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:02:52.019404 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-6a367717-5f23-4e30-96d6-a69138bbaf5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2886bfb9931044a2ba3c859e347aebee'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:02:52.028009 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-6a367717-5f23-4e30-96d6-a69138bbaf5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2886bfb9931044a2ba3c859e347aebee'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:02:52.028863 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-6a367717-5f23-4e30-96d6-a69138bbaf5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2886bfb9931044a2ba3c859e347aebee'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:02:52.122266 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1200/2400] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:02:51 2022] DELETE /identity/v3/users/2886bfb9931044a2ba3c859e347aebee => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:02:52.126925 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee289bc-e1c6-4f0c-900d-d9339a9d0cd3 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:02:52.127570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee289bc-e1c6-4f0c-900d-d9339a9d0cd3 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:02:52.127570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee289bc-e1c6-4f0c-900d-d9339a9d0cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:02:52.150337 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-5ee289bc-e1c6-4f0c-900d-d9339a9d0cd3 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:02:52.151655 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5ee289bc-e1c6-4f0c-900d-d9339a9d0cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:02:52.223532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1201/2401] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:02:52.239338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367717-5f23-4e30-96d6-a69138bbaf5f admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:02:52.240755 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-6a367717-5f23-4e30-96d6-a69138bbaf5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:02:52.314147 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367717-5f23-4e30-96d6-a69138bbaf5f admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:02:52.318211 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59514b93-6416-4ac4-b024-a460e04caefc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:02:52.318952 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59514b93-6416-4ac4-b024-a460e04caefc service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:02:52.319267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59514b93-6416-4ac4-b024-a460e04caefc service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:02:52.319622 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59514b93-6416-4ac4-b024-a460e04caefc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:02:52.330188 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59514b93-6416-4ac4-b024-a460e04caefc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:02:52.331618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59514b93-6416-4ac4-b024-a460e04caefc service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:02:52.342930 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1201/2402] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:02:52.829502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee289bc-e1c6-4f0c-900d-d9339a9d0cd3 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:02:52.831848 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5ee289bc-e1c6-4f0c-900d-d9339a9d0cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:02:52.853738 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee289bc-e1c6-4f0c-900d-d9339a9d0cd3 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:02:52.862665 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50c200-0913-483e-904f-c74682c5f8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:02:52.863886 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50c200-0913-483e-904f-c74682c5f8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:02:52.864219 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50c200-0913-483e-904f-c74682c5f8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:02:52.864651 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50c200-0913-483e-904f-c74682c5f8fc admin admin] PATH_INFO: `/v3/projects/7a592cafb5d7403b8a123454ac281c68` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:02:52.866173 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50c200-0913-483e-904f-c74682c5f8fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a592cafb5d7403b8a123454ac281c68)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:02:52.870034 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50c200-0913-483e-904f-c74682c5f8fc admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:02:53.033404 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fb50c200-0913-483e-904f-c74682c5f8fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a592cafb5d7403b8a123454ac281c68', 'request_id': 'req-fb50c200-0913-483e-904f-c74682c5f8fc'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:02:53.190239 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fb50c200-0913-483e-904f-c74682c5f8fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a592cafb5d7403b8a123454ac281c68', 'request_id': 'req-fb50c200-0913-483e-904f-c74682c5f8fc'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:02:53.197800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fb50c200-0913-483e-904f-c74682c5f8fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a592cafb5d7403b8a123454ac281c68', 'request_id': 'req-fb50c200-0913-483e-904f-c74682c5f8fc'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:02:53.208463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fb50c200-0913-483e-904f-c74682c5f8fc admin admin] The token cache is being invalidate because project 7a592cafb5d7403b8a123454ac281c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:02:53.208784 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fb50c200-0913-483e-904f-c74682c5f8fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:02:53.209439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fb50c200-0913-483e-904f-c74682c5f8fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:02:53.211050 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1202/2403] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:02:52 2022] DELETE /identity/v3/projects/7a592cafb5d7403b8a123454ac281c68 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:03:14.800114 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c894be-bf0a-4b80-b0b0-d7732bba711e None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:03:14.800885 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c894be-bf0a-4b80-b0b0-d7732bba711e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:03:14.800885 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c894be-bf0a-4b80-b0b0-d7732bba711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:03:14.819185 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-74c894be-bf0a-4b80-b0b0-d7732bba711e None None] MFA Rules not processed for user `5fe1c344dfc940479b4ed781461bd89b`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:03:14.820383 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-74c894be-bf0a-4b80-b0b0-d7732bba711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:03:14.881204 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1202/2404] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:03:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:03:20.501174 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50c200-0913-483e-904f-c74682c5f8fc admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:03:20.504694 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-fb50c200-0913-483e-904f-c74682c5f8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:03:20.605435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50c200-0913-483e-904f-c74682c5f8fc admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:03:20.611502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840755a-e730-4b07-b0d0-af3ca6e71656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:03:20.612341 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840755a-e730-4b07-b0d0-af3ca6e71656 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:03:20.612654 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840755a-e730-4b07-b0d0-af3ca6e71656 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:03:20.612923 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840755a-e730-4b07-b0d0-af3ca6e71656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:03:20.614905 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f840755a-e730-4b07-b0d0-af3ca6e71656 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:03:20.629417 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840755a-e730-4b07-b0d0-af3ca6e71656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:03:20.631503 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840755a-e730-4b07-b0d0-af3ca6e71656 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:03:20.649369 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1203/2405] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:03:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:04:11.533391 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c894be-bf0a-4b80-b0b0-d7732bba711e None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:11.547319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c894be-bf0a-4b80-b0b0-d7732bba711e None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:11.568305 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd714d-bfcd-4487-8df7-158d682ca36d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:11.568305 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd714d-bfcd-4487-8df7-158d682ca36d service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:11.568305 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd714d-bfcd-4487-8df7-158d682ca36d service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:11.568305 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd714d-bfcd-4487-8df7-158d682ca36d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:11.568805 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-95dd714d-bfcd-4487-8df7-158d682ca36d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:11.624983 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd714d-bfcd-4487-8df7-158d682ca36d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:11.628245 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd714d-bfcd-4487-8df7-158d682ca36d service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:11.644791 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1203/2406] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:04:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:04:15.732669 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840755a-e730-4b07-b0d0-af3ca6e71656 service nova] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:15.735152 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f840755a-e730-4b07-b0d0-af3ca6e71656 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:15.825305 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840755a-e730-4b07-b0d0-af3ca6e71656 service nova] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:15.830525 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac288e-1753-4691-a2ee-fecf8f7a636f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e166c6b0e5542f7b912cbefa88bb5f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:15.831185 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac288e-1753-4691-a2ee-fecf8f7a636f service placement] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:15.831465 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac288e-1753-4691-a2ee-fecf8f7a636f service placement] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:15.831737 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac288e-1753-4691-a2ee-fecf8f7a636f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:15.833652 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e9ac288e-1753-4691-a2ee-fecf8f7a636f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:15.846628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac288e-1753-4691-a2ee-fecf8f7a636f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:15.848213 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac288e-1753-4691-a2ee-fecf8f7a636f service placement] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:15.858935 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1204/2407] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:04:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:04:23.977976 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f2b8c-2820-4106-9736-503a8fb9a480 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:23.978553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f2b8c-2820-4106-9736-503a8fb9a480 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:23.978553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f2b8c-2820-4106-9736-503a8fb9a480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:23.999567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-cb5f2b8c-2820-4106-9736-503a8fb9a480 None None] MFA Rules not processed for user `1144e9036d0b4bafb30995ff1a8449ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:04:24.001167 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-cb5f2b8c-2820-4106-9736-503a8fb9a480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:24.070929 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1204/2408] 10.222.0.52 () {58 vars in 967 bytes} [Thu Apr 14 22:04:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:04:24.308209 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac288e-1753-4691-a2ee-fecf8f7a636f service placement] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:24.310647 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e9ac288e-1753-4691-a2ee-fecf8f7a636f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:24.395224 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac288e-1753-4691-a2ee-fecf8f7a636f service placement] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:24.401399 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e86af8-c2b1-41c3-bfde-f0613b7f2053 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bf55488d046c4be98a903d113c0fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:24.407119 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e86af8-c2b1-41c3-bfde-f0613b7f2053 service swift] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:24.407119 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e86af8-c2b1-41c3-bfde-f0613b7f2053 service swift] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:24.407119 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e86af8-c2b1-41c3-bfde-f0613b7f2053 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:24.417683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e86af8-c2b1-41c3-bfde-f0613b7f2053 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:24.420343 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e86af8-c2b1-41c3-bfde-f0613b7f2053 service swift] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:24.433502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1205/2409] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Apr 14 22:04:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 14 22:04:25.748274 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f2b8c-2820-4106-9736-503a8fb9a480 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:25.749785 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-cb5f2b8c-2820-4106-9736-503a8fb9a480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:25.812322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f2b8c-2820-4106-9736-503a8fb9a480 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:25.816126 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5300c8e-0ebd-4acb-87ce-25534bfb7593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:25.816816 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5300c8e-0ebd-4acb-87ce-25534bfb7593 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:25.817097 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5300c8e-0ebd-4acb-87ce-25534bfb7593 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:25.817360 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5300c8e-0ebd-4acb-87ce-25534bfb7593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:25.819329 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-a5300c8e-0ebd-4acb-87ce-25534bfb7593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:25.892376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5300c8e-0ebd-4acb-87ce-25534bfb7593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:25.894527 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5300c8e-0ebd-4acb-87ce-25534bfb7593 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:25.907562 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1205/2410] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:04:27.255542 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e86af8-c2b1-41c3-bfde-f0613b7f2053 service swift] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:27.257173 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-13e86af8-c2b1-41c3-bfde-f0613b7f2053 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:27.271309 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e86af8-c2b1-41c3-bfde-f0613b7f2053 service swift] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:27.275999 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ac17e-3b93-416f-b1d4-e51a0f883d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:27.276946 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ac17e-3b93-416f-b1d4-e51a0f883d6a service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:27.277429 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ac17e-3b93-416f-b1d4-e51a0f883d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:27.277785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ac17e-3b93-416f-b1d4-e51a0f883d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:27.279740 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-398ac17e-3b93-416f-b1d4-e51a0f883d6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:27.297630 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ac17e-3b93-416f-b1d4-e51a0f883d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:27.299384 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ac17e-3b93-416f-b1d4-e51a0f883d6a service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:27.313819 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1206/2411] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:04:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:04:30.460381 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5300c8e-0ebd-4acb-87ce-25534bfb7593 service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:30.484187 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5300c8e-0ebd-4acb-87ce-25534bfb7593 service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:30.491271 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1f480-aac8-42a4-8cbb-41aee61aa1dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:30.493039 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1f480-aac8-42a4-8cbb-41aee61aa1dc service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:30.497049 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1f480-aac8-42a4-8cbb-41aee61aa1dc service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:30.497333 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1f480-aac8-42a4-8cbb-41aee61aa1dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:30.500407 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-34a1f480-aac8-42a4-8cbb-41aee61aa1dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:30.602195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1f480-aac8-42a4-8cbb-41aee61aa1dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:30.612378 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1f480-aac8-42a4-8cbb-41aee61aa1dc service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:30.629992 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1206/2412] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:04:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:04:32.572862 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ac17e-3b93-416f-b1d4-e51a0f883d6a service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:32.575709 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-398ac17e-3b93-416f-b1d4-e51a0f883d6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:32.590353 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ac17e-3b93-416f-b1d4-e51a0f883d6a service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:32.596793 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5949573-9b1f-4377-b9d7-2c7e788f22d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:32.597694 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5949573-9b1f-4377-b9d7-2c7e788f22d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:32.597976 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5949573-9b1f-4377-b9d7-2c7e788f22d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:32.598249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5949573-9b1f-4377-b9d7-2c7e788f22d8 admin admin] PATH_INFO: `/v3/users/136152c5c06b4e44803b127e232ff865` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:32.600412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5949573-9b1f-4377-b9d7-2c7e788f22d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=136152c5c06b4e44803b127e232ff865)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:32.603227 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5949573-9b1f-4377-b9d7-2c7e788f22d8 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:32.817677 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d5949573-9b1f-4377-b9d7-2c7e788f22d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136152c5c06b4e44803b127e232ff865'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:32.818847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d5949573-9b1f-4377-b9d7-2c7e788f22d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136152c5c06b4e44803b127e232ff865'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:32.837996 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d5949573-9b1f-4377-b9d7-2c7e788f22d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136152c5c06b4e44803b127e232ff865'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:32.846433 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d5949573-9b1f-4377-b9d7-2c7e788f22d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136152c5c06b4e44803b127e232ff865'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:32.847438 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d5949573-9b1f-4377-b9d7-2c7e788f22d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136152c5c06b4e44803b127e232ff865'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:32.946887 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1207/2413] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:04:32 2022] DELETE /identity/v3/users/136152c5c06b4e44803b127e232ff865 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:04:33.236825 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1f480-aac8-42a4-8cbb-41aee61aa1dc service nova] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:33.256738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1f480-aac8-42a4-8cbb-41aee61aa1dc service nova] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:33.327973 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9e2c7-9032-4c2c-b24e-1e636fbda3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:33.328868 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9e2c7-9032-4c2c-b24e-1e636fbda3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:33.329155 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9e2c7-9032-4c2c-b24e-1e636fbda3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:33.329414 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9e2c7-9032-4c2c-b24e-1e636fbda3fd admin admin] PATH_INFO: `/v3/projects/07795b5930f74368a7508f0536b9f800` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:33.330872 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9e2c7-9032-4c2c-b24e-1e636fbda3fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=07795b5930f74368a7508f0536b9f800)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:33.332906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9e2c7-9032-4c2c-b24e-1e636fbda3fd admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:33.450590 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-6fb9e2c7-9032-4c2c-b24e-1e636fbda3fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07795b5930f74368a7508f0536b9f800', 'request_id': 'req-6fb9e2c7-9032-4c2c-b24e-1e636fbda3fd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:33.537765 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-6fb9e2c7-9032-4c2c-b24e-1e636fbda3fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07795b5930f74368a7508f0536b9f800', 'request_id': 'req-6fb9e2c7-9032-4c2c-b24e-1e636fbda3fd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:33.548164 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-6fb9e2c7-9032-4c2c-b24e-1e636fbda3fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07795b5930f74368a7508f0536b9f800', 'request_id': 'req-6fb9e2c7-9032-4c2c-b24e-1e636fbda3fd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:33.559748 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-6fb9e2c7-9032-4c2c-b24e-1e636fbda3fd admin admin] The token cache is being invalidate because project 07795b5930f74368a7508f0536b9f800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:04:33.560052 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-6fb9e2c7-9032-4c2c-b24e-1e636fbda3fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:33.560738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-6fb9e2c7-9032-4c2c-b24e-1e636fbda3fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:33.565982 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1207/2414] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:04:33 2022] DELETE /identity/v3/projects/07795b5930f74368a7508f0536b9f800 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:04:33.567609 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499cb43-42d0-43e6-9561-2bd6c5fe24a0 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:33.567898 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499cb43-42d0-43e6-9561-2bd6c5fe24a0 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:33.568295 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499cb43-42d0-43e6-9561-2bd6c5fe24a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:33.591997 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-9499cb43-42d0-43e6-9561-2bd6c5fe24a0 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:04:33.597366 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9499cb43-42d0-43e6-9561-2bd6c5fe24a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:33.678836 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1208/2415] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:04:33.690427 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ad2f4-03d8-4dc8-bc88-7e410b5a2ff6 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:33.690746 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ad2f4-03d8-4dc8-bc88-7e410b5a2ff6 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:33.690975 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ad2f4-03d8-4dc8-bc88-7e410b5a2ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:33.724149 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-ef2ad2f4-03d8-4dc8-bc88-7e410b5a2ff6 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:04:33.725417 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ef2ad2f4-03d8-4dc8-bc88-7e410b5a2ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:33.738878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499cb43-42d0-43e6-9561-2bd6c5fe24a0 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:33.744208 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1208/2416] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:04:33.749416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499cb43-42d0-43e6-9561-2bd6c5fe24a0 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:33.755704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1159793-f9e1-496e-bb06-b48601cb1ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:33.756676 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1159793-f9e1-496e-bb06-b48601cb1ecd admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:33.758328 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1159793-f9e1-496e-bb06-b48601cb1ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:33.758772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1159793-f9e1-496e-bb06-b48601cb1ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:33.759693 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1159793-f9e1-496e-bb06-b48601cb1ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:04:33.760157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1159793-f9e1-496e-bb06-b48601cb1ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:33.762252 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1159793-f9e1-496e-bb06-b48601cb1ecd admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:33.780890 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ad2f4-03d8-4dc8-bc88-7e410b5a2ff6 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:33.791520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1209/2417] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:04:33.791885 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ad2f4-03d8-4dc8-bc88-7e410b5a2ff6 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:33.797482 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815e553-df81-41d5-ad5e-3cc978e013f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:33.798416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815e553-df81-41d5-ad5e-3cc978e013f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:33.798861 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815e553-df81-41d5-ad5e-3cc978e013f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:33.799297 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815e553-df81-41d5-ad5e-3cc978e013f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:33.800159 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815e553-df81-41d5-ad5e-3cc978e013f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:33.803183 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815e553-df81-41d5-ad5e-3cc978e013f9 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:33.909777 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1209/2418] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:04:33 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:04:33.911184 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1159793-f9e1-496e-bb06-b48601cb1ecd admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:33.927222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1159793-f9e1-496e-bb06-b48601cb1ecd admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:34.021097 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d71970-cf8c-4687-8deb-949345b430d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:34.021897 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d71970-cf8c-4687-8deb-949345b430d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:34.022206 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d71970-cf8c-4687-8deb-949345b430d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:34.022604 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d71970-cf8c-4687-8deb-949345b430d1 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:34.024065 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d71970-cf8c-4687-8deb-949345b430d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:34.026149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d71970-cf8c-4687-8deb-949345b430d1 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:34.137328 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1210/2419] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:04:33 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:04:34.138642 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815e553-df81-41d5-ad5e-3cc978e013f9 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:34.158196 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815e553-df81-41d5-ad5e-3cc978e013f9 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:34.165876 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6aac2-aa0f-4ba5-b9b9-06f226af524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:34.167284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6aac2-aa0f-4ba5-b9b9-06f226af524b admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:34.167729 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6aac2-aa0f-4ba5-b9b9-06f226af524b admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:34.169301 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6aac2-aa0f-4ba5-b9b9-06f226af524b admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:34.171373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6aac2-aa0f-4ba5-b9b9-06f226af524b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:34.174000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6aac2-aa0f-4ba5-b9b9-06f226af524b admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:34.195548 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1210/2420] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 22:04:34.199514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d71970-cf8c-4687-8deb-949345b430d1 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:34.214823 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d71970-cf8c-4687-8deb-949345b430d1 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:34.222378 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e0b52-7f86-4e38-aefd-7e396e1f87c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:34.223091 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e0b52-7f86-4e38-aefd-7e396e1f87c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:34.223329 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e0b52-7f86-4e38-aefd-7e396e1f87c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:34.223644 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e0b52-7f86-4e38-aefd-7e396e1f87c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:34.224898 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e0b52-7f86-4e38-aefd-7e396e1f87c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:34.227133 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e0b52-7f86-4e38-aefd-7e396e1f87c6 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:34.249909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1211/2421] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:04:34.258915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6aac2-aa0f-4ba5-b9b9-06f226af524b admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:34.271604 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6aac2-aa0f-4ba5-b9b9-06f226af524b admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:34.277818 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c3cb3-3146-4f41-94d8-83a994a22051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:34.278369 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c3cb3-3146-4f41-94d8-83a994a22051 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:34.278677 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c3cb3-3146-4f41-94d8-83a994a22051 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:34.278954 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c3cb3-3146-4f41-94d8-83a994a22051 admin admin] PATH_INFO: `/v3/projects/b3fb94b2f5ea4be18bfbb3968b306a53/users/1ae58a1764394f17a5599d5fed30ce44/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:34.298094 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c3cb3-3146-4f41-94d8-83a994a22051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3fb94b2f5ea4be18bfbb3968b306a53, user_id=1ae58a1764394f17a5599d5fed30ce44, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:34.300999 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c3cb3-3146-4f41-94d8-83a994a22051 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:34.494439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1211/2422] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:04:34 2022] PUT /identity/v3/projects/b3fb94b2f5ea4be18bfbb3968b306a53/users/1ae58a1764394f17a5599d5fed30ce44/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:04:34.500294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71be7e8-76ce-447d-95fa-9a54dabcfe39 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:34.500294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71be7e8-76ce-447d-95fa-9a54dabcfe39 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:34.500294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71be7e8-76ce-447d-95fa-9a54dabcfe39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:34.513673 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c3cb3-3146-4f41-94d8-83a994a22051 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:34.515869 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e10c3cb3-3146-4f41-94d8-83a994a22051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:34.526587 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-d71be7e8-76ce-447d-95fa-9a54dabcfe39 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:04:34.529940 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d71be7e8-76ce-447d-95fa-9a54dabcfe39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:34.637283 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c3cb3-3146-4f41-94d8-83a994a22051 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:34.644400 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28d40b-3153-4b97-b390-0c9d0ab3b2fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:34.645208 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28d40b-3153-4b97-b390-0c9d0ab3b2fd service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:34.645491 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28d40b-3153-4b97-b390-0c9d0ab3b2fd service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:34.645902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28d40b-3153-4b97-b390-0c9d0ab3b2fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:34.649592 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-cf28d40b-3153-4b97-b390-0c9d0ab3b2fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:34.751863 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28d40b-3153-4b97-b390-0c9d0ab3b2fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:34.753705 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28d40b-3153-4b97-b390-0c9d0ab3b2fd service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:34.769025 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1212/2423] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:04:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:04:34.789863 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1212/2424] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:04:34.802522 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28d40b-3153-4b97-b390-0c9d0ab3b2fd service nova] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:34.805905 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-cf28d40b-3153-4b97-b390-0c9d0ab3b2fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:34.935086 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28d40b-3153-4b97-b390-0c9d0ab3b2fd service nova] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:34.946178 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3efb3-44e3-4c20-be25-d980dfc53bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:34.946695 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3efb3-44e3-4c20-be25-d980dfc53bbc service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:34.946981 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3efb3-44e3-4c20-be25-d980dfc53bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:34.947388 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3efb3-44e3-4c20-be25-d980dfc53bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:34.978518 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3efb3-44e3-4c20-be25-d980dfc53bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:34.980024 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3efb3-44e3-4c20-be25-d980dfc53bbc service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:35.028021 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1213/2425] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:04:37.050406 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71be7e8-76ce-447d-95fa-9a54dabcfe39 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:37.056999 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d71be7e8-76ce-447d-95fa-9a54dabcfe39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:37.076763 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71be7e8-76ce-447d-95fa-9a54dabcfe39 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:37.082379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170778d-ecc1-4ac1-ae3f-34bf59bbd72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:37.083313 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170778d-ecc1-4ac1-ae3f-34bf59bbd72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:37.083586 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170778d-ecc1-4ac1-ae3f-34bf59bbd72d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:37.083852 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170778d-ecc1-4ac1-ae3f-34bf59bbd72d admin admin] PATH_INFO: `/v3/users/e25a03e7055a43af8da10c5f041f3cb1` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:37.085292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170778d-ecc1-4ac1-ae3f-34bf59bbd72d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e25a03e7055a43af8da10c5f041f3cb1)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:37.087519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170778d-ecc1-4ac1-ae3f-34bf59bbd72d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:37.567639 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-5170778d-ecc1-4ac1-ae3f-34bf59bbd72d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e25a03e7055a43af8da10c5f041f3cb1'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:37.570577 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-5170778d-ecc1-4ac1-ae3f-34bf59bbd72d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e25a03e7055a43af8da10c5f041f3cb1'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:37.580841 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-5170778d-ecc1-4ac1-ae3f-34bf59bbd72d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e25a03e7055a43af8da10c5f041f3cb1'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:37.588427 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-5170778d-ecc1-4ac1-ae3f-34bf59bbd72d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e25a03e7055a43af8da10c5f041f3cb1'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:37.589391 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-5170778d-ecc1-4ac1-ae3f-34bf59bbd72d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e25a03e7055a43af8da10c5f041f3cb1'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:37.821302 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1213/2426] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:04:37 2022] DELETE /identity/v3/users/e25a03e7055a43af8da10c5f041f3cb1 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:04:38.118243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3efb3-44e3-4c20-be25-d980dfc53bbc service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:38.130152 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3efb3-44e3-4c20-be25-d980dfc53bbc service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:38.223502 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210d2f3-310a-446a-9788-a9c9593e5f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:38.224415 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210d2f3-310a-446a-9788-a9c9593e5f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:38.224721 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210d2f3-310a-446a-9788-a9c9593e5f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:38.225206 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210d2f3-310a-446a-9788-a9c9593e5f2e admin admin] PATH_INFO: `/v3/projects/40c5ee7a5b0640ecbb513c322c45dcc8` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:38.228270 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210d2f3-310a-446a-9788-a9c9593e5f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c5ee7a5b0640ecbb513c322c45dcc8)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:38.230554 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210d2f3-310a-446a-9788-a9c9593e5f2e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:38.346427 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-8210d2f3-310a-446a-9788-a9c9593e5f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c5ee7a5b0640ecbb513c322c45dcc8', 'request_id': 'req-8210d2f3-310a-446a-9788-a9c9593e5f2e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:38.443131 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-8210d2f3-310a-446a-9788-a9c9593e5f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c5ee7a5b0640ecbb513c322c45dcc8', 'request_id': 'req-8210d2f3-310a-446a-9788-a9c9593e5f2e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:38.452240 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-8210d2f3-310a-446a-9788-a9c9593e5f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c5ee7a5b0640ecbb513c322c45dcc8', 'request_id': 'req-8210d2f3-310a-446a-9788-a9c9593e5f2e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:38.465678 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-8210d2f3-310a-446a-9788-a9c9593e5f2e admin admin] The token cache is being invalidate because project 40c5ee7a5b0640ecbb513c322c45dcc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:04:38.466065 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-8210d2f3-310a-446a-9788-a9c9593e5f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:38.466794 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-8210d2f3-310a-446a-9788-a9c9593e5f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:38.468752 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1214/2427] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:04:38 2022] DELETE /identity/v3/projects/40c5ee7a5b0640ecbb513c322c45dcc8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:04:38.473246 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170778d-ecc1-4ac1-ae3f-34bf59bbd72d admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:38.474769 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5170778d-ecc1-4ac1-ae3f-34bf59bbd72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:38.495531 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170778d-ecc1-4ac1-ae3f-34bf59bbd72d admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:38.614551 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21769df4-f4cb-437c-8c8d-8f13ca5909ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:38.615748 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21769df4-f4cb-437c-8c8d-8f13ca5909ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:38.616548 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21769df4-f4cb-437c-8c8d-8f13ca5909ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:38.616881 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21769df4-f4cb-437c-8c8d-8f13ca5909ff admin admin] PATH_INFO: `/v3/users/3b7bb1dd09224adfb32fefff5a0f4383` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:38.618153 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21769df4-f4cb-437c-8c8d-8f13ca5909ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7bb1dd09224adfb32fefff5a0f4383)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:38.621000 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21769df4-f4cb-437c-8c8d-8f13ca5909ff admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:38.901101 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-21769df4-f4cb-437c-8c8d-8f13ca5909ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7bb1dd09224adfb32fefff5a0f4383'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:38.901890 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-21769df4-f4cb-437c-8c8d-8f13ca5909ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7bb1dd09224adfb32fefff5a0f4383'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:38.919315 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-21769df4-f4cb-437c-8c8d-8f13ca5909ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7bb1dd09224adfb32fefff5a0f4383'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:38.930959 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-21769df4-f4cb-437c-8c8d-8f13ca5909ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7bb1dd09224adfb32fefff5a0f4383'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:38.932006 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-21769df4-f4cb-437c-8c8d-8f13ca5909ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7bb1dd09224adfb32fefff5a0f4383'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:39.032780 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1214/2428] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:04:38 2022] DELETE /identity/v3/users/3b7bb1dd09224adfb32fefff5a0f4383 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:04:39.411820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be66d4-2c46-4ca4-b8a0-687458286b1b None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:39.412291 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be66d4-2c46-4ca4-b8a0-687458286b1b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:39.412375 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be66d4-2c46-4ca4-b8a0-687458286b1b None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:39.414258 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1215/2429] 10.222.0.52 () {54 vars in 921 bytes} [Thu Apr 14 22:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 22:04:39.423786 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb934d9-21e9-4370-a97f-42d00ce18933 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:39.424331 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb934d9-21e9-4370-a97f-42d00ce18933 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:39.424878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb934d9-21e9-4370-a97f-42d00ce18933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:39.448472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be66d4-2c46-4ca4-b8a0-687458286b1b None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:39.451355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f3be66d4-2c46-4ca4-b8a0-687458286b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:39.479249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-4cb934d9-21e9-4370-a97f-42d00ce18933 None None] MFA Rules not processed for user `1bfbd6a387e44037a58e521230783347`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:04:39.483109 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-4cb934d9-21e9-4370-a97f-42d00ce18933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:39.599387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1215/2430] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Apr 14 22:04:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:04:39.612657 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb934d9-21e9-4370-a97f-42d00ce18933 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:39.615826 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-4cb934d9-21e9-4370-a97f-42d00ce18933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:39.625206 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be66d4-2c46-4ca4-b8a0-687458286b1b None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:39.632147 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5365c7-2721-4e77-ac66-169ffc2e30b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:39.633601 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5365c7-2721-4e77-ac66-169ffc2e30b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:39.634122 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5365c7-2721-4e77-ac66-169ffc2e30b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:39.634626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5365c7-2721-4e77-ac66-169ffc2e30b9 admin admin] PATH_INFO: `/v3/projects/9094af9f015e43299e43c8ca8bc98eae` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:39.636201 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5365c7-2721-4e77-ac66-169ffc2e30b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9094af9f015e43299e43c8ca8bc98eae)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:39.638459 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5365c7-2721-4e77-ac66-169ffc2e30b9 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:39.641218 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb934d9-21e9-4370-a97f-42d00ce18933 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:39.646395 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19a965-2ea7-42b6-85da-4fead9230d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:39.647311 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19a965-2ea7-42b6-85da-4fead9230d12 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:39.648672 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19a965-2ea7-42b6-85da-4fead9230d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:39.649102 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19a965-2ea7-42b6-85da-4fead9230d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:39.659401 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19a965-2ea7-42b6-85da-4fead9230d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:39.661696 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19a965-2ea7-42b6-85da-4fead9230d12 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:39.678165 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1216/2431] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:04:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:04:39.788057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ac5365c7-2721-4e77-ac66-169ffc2e30b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9094af9f015e43299e43c8ca8bc98eae', 'request_id': 'req-ac5365c7-2721-4e77-ac66-169ffc2e30b9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:39.804341 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82a42c-6b63-49be-b939-b21e5e4590ed None None] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:39.804724 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82a42c-6b63-49be-b939-b21e5e4590ed None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:39.805086 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82a42c-6b63-49be-b939-b21e5e4590ed None None] PATH_INFO: `/` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:39.806601 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1217/2432] 10.222.0.52 () {54 vars in 921 bytes} [Thu Apr 14 22:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 22:04:39.813438 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bbccb-2c75-434c-b8a6-3a493bb9718a None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:39.813797 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bbccb-2c75-434c-b8a6-3a493bb9718a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:39.814141 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bbccb-2c75-434c-b8a6-3a493bb9718a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:39.837765 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-a27bbccb-2c75-434c-b8a6-3a493bb9718a None None] MFA Rules not processed for user `e7f3ea629181433eb8c6d5dbc354c141`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:04:39.839026 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a27bbccb-2c75-434c-b8a6-3a493bb9718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:39.863213 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ac5365c7-2721-4e77-ac66-169ffc2e30b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9094af9f015e43299e43c8ca8bc98eae', 'request_id': 'req-ac5365c7-2721-4e77-ac66-169ffc2e30b9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:39.871731 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ac5365c7-2721-4e77-ac66-169ffc2e30b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9094af9f015e43299e43c8ca8bc98eae', 'request_id': 'req-ac5365c7-2721-4e77-ac66-169ffc2e30b9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:39.883582 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ac5365c7-2721-4e77-ac66-169ffc2e30b9 admin admin] The token cache is being invalidate because project 9094af9f015e43299e43c8ca8bc98eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:04:39.883866 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ac5365c7-2721-4e77-ac66-169ffc2e30b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:39.886033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ac5365c7-2721-4e77-ac66-169ffc2e30b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:04:39.888508 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1216/2433] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:04:39 2022] DELETE /identity/v3/projects/9094af9f015e43299e43c8ca8bc98eae => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:04:39.894440 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a82d75-d9cf-49b3-979e-9f69dd8374ca None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:39.895051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a82d75-d9cf-49b3-979e-9f69dd8374ca None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:39.895481 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a82d75-d9cf-49b3-979e-9f69dd8374ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:39.921274 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-22a82d75-d9cf-49b3-979e-9f69dd8374ca None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:04:39.923080 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-22a82d75-d9cf-49b3-979e-9f69dd8374ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:39.929001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1218/2434] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Apr 14 22:04:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:04:39.945879 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bbccb-2c75-434c-b8a6-3a493bb9718a None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:39.947527 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a27bbccb-2c75-434c-b8a6-3a493bb9718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:40.005730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1217/2435] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:04:40.018807 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87587d03-273b-4de8-bc7c-0b48509cd1c8 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:40.018807 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87587d03-273b-4de8-bc7c-0b48509cd1c8 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:40.018807 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87587d03-273b-4de8-bc7c-0b48509cd1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:40.038585 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-87587d03-273b-4de8-bc7c-0b48509cd1c8 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:04:40.047998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-87587d03-273b-4de8-bc7c-0b48509cd1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:40.050709 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1218/2436] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:04:40.056542 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87587d03-273b-4de8-bc7c-0b48509cd1c8 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:40.057481 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bbccb-2c75-434c-b8a6-3a493bb9718a None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:40.062259 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe34ff2-35eb-48c3-b929-f34412f7a96b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:40.063077 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe34ff2-35eb-48c3-b929-f34412f7a96b service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:40.063454 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe34ff2-35eb-48c3-b929-f34412f7a96b service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:40.063824 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe34ff2-35eb-48c3-b929-f34412f7a96b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:40.074266 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87587d03-273b-4de8-bc7c-0b48509cd1c8 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:40.077137 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe34ff2-35eb-48c3-b929-f34412f7a96b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:40.078673 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe34ff2-35eb-48c3-b929-f34412f7a96b service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:40.087801 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdf836-5e80-4d3c-b139-49cbd8354614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:40.088306 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdf836-5e80-4d3c-b139-49cbd8354614 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:40.088621 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdf836-5e80-4d3c-b139-49cbd8354614 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:40.088904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdf836-5e80-4d3c-b139-49cbd8354614 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:40.089688 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdf836-5e80-4d3c-b139-49cbd8354614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:04:40.090154 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdf836-5e80-4d3c-b139-49cbd8354614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:40.092755 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdf836-5e80-4d3c-b139-49cbd8354614 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:40.097356 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1219/2437] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:04:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:04:40.114003 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1219/2438] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:04:40.117204 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe34ff2-35eb-48c3-b929-f34412f7a96b service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:40.148752 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe34ff2-35eb-48c3-b929-f34412f7a96b service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:40.165919 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c8a20-120c-4058-a7b1-012043f03151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:40.166621 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c8a20-120c-4058-a7b1-012043f03151 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:40.167201 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c8a20-120c-4058-a7b1-012043f03151 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:40.167666 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c8a20-120c-4058-a7b1-012043f03151 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:40.168393 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c8a20-120c-4058-a7b1-012043f03151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:40.170474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c8a20-120c-4058-a7b1-012043f03151 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:40.338636 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1220/2439] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:04:40 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:04:40.343309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdf836-5e80-4d3c-b139-49cbd8354614 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:40.359837 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdf836-5e80-4d3c-b139-49cbd8354614 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:40.443309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6f813-1a68-4713-a4df-9a8349ae1abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:40.443309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6f813-1a68-4713-a4df-9a8349ae1abb admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:40.443309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6f813-1a68-4713-a4df-9a8349ae1abb admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:40.443309 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6f813-1a68-4713-a4df-9a8349ae1abb admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:40.445981 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6f813-1a68-4713-a4df-9a8349ae1abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:40.445981 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6f813-1a68-4713-a4df-9a8349ae1abb admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:40.562990 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1220/2440] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:04:40 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:04:40.564368 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c8a20-120c-4058-a7b1-012043f03151 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:40.579840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c8a20-120c-4058-a7b1-012043f03151 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:40.584929 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6be61-f8b7-46ee-bf6f-f08b50c253f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:40.586117 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6be61-f8b7-46ee-bf6f-f08b50c253f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:40.586402 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6be61-f8b7-46ee-bf6f-f08b50c253f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:40.586676 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6be61-f8b7-46ee-bf6f-f08b50c253f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:40.587413 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6be61-f8b7-46ee-bf6f-f08b50c253f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:40.589232 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6be61-f8b7-46ee-bf6f-f08b50c253f8 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:40.607553 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1221/2441] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:04:40.612794 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6f813-1a68-4713-a4df-9a8349ae1abb admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:40.635007 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6f813-1a68-4713-a4df-9a8349ae1abb admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:40.644908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bac9c-639a-4707-98ae-f78ded79f300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:40.645882 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bac9c-639a-4707-98ae-f78ded79f300 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:40.646327 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bac9c-639a-4707-98ae-f78ded79f300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:40.646763 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bac9c-639a-4707-98ae-f78ded79f300 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:40.649201 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56bac9c-639a-4707-98ae-f78ded79f300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:40.651501 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56bac9c-639a-4707-98ae-f78ded79f300 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:40.670119 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1221/2442] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:04:40.671532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6be61-f8b7-46ee-bf6f-f08b50c253f8 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:40.687076 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6be61-f8b7-46ee-bf6f-f08b50c253f8 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:40.712289 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9e672-3fc3-4940-a019-172369aec82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:40.712289 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9e672-3fc3-4940-a019-172369aec82d admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:40.712289 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9e672-3fc3-4940-a019-172369aec82d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:40.712289 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9e672-3fc3-4940-a019-172369aec82d admin admin] PATH_INFO: `/v3/projects/40579fb10b2242a9a17aef3f68c7248d/users/8066cbf7602941abbe345006dac52359/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:40.725258 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9e672-3fc3-4940-a019-172369aec82d admin admin] RBAC: Authorizing `identity:create_grant(project_id=40579fb10b2242a9a17aef3f68c7248d, user_id=8066cbf7602941abbe345006dac52359, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:40.729112 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9e672-3fc3-4940-a019-172369aec82d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:40.836686 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1222/2443] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:04:40 2022] PUT /identity/v3/projects/40579fb10b2242a9a17aef3f68c7248d/users/8066cbf7602941abbe345006dac52359/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:04:40.842505 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d4f3a-f0df-4462-af62-f7fe37899d4b None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:40.848836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d4f3a-f0df-4462-af62-f7fe37899d4b None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:40.848836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d4f3a-f0df-4462-af62-f7fe37899d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:40.863310 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-395d4f3a-f0df-4462-af62-f7fe37899d4b None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:04:40.864777 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-395d4f3a-f0df-4462-af62-f7fe37899d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:40.969070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1222/2444] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:04:40.973376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9e672-3fc3-4940-a019-172369aec82d admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:41.055309 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9e672-3fc3-4940-a019-172369aec82d admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:41.073976 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd22609-a7a0-497b-a818-da143db21125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:41.075215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd22609-a7a0-497b-a818-da143db21125 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:41.076461 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd22609-a7a0-497b-a818-da143db21125 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:41.076785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd22609-a7a0-497b-a818-da143db21125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:41.089685 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd22609-a7a0-497b-a818-da143db21125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:41.091245 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd22609-a7a0-497b-a818-da143db21125 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:41.114262 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1223/2445] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:04:42.548786 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c59da-8c20-4ef7-b8b2-3e6c0b6d5d4e None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:42.549269 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c59da-8c20-4ef7-b8b2-3e6c0b6d5d4e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:42.549369 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c59da-8c20-4ef7-b8b2-3e6c0b6d5d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:42.583856 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-271c59da-8c20-4ef7-b8b2-3e6c0b6d5d4e None None] MFA Rules not processed for user `1ae58a1764394f17a5599d5fed30ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:04:42.585728 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-271c59da-8c20-4ef7-b8b2-3e6c0b6d5d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:42.676751 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1223/2446] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:04:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:04:42.688014 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd22609-a7a0-497b-a818-da143db21125 service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:42.690355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9cd22609-a7a0-497b-a818-da143db21125 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:42.802547 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd22609-a7a0-497b-a818-da143db21125 service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:42.808722 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c93f1e-9541-4206-b992-705b73713b26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:42.809599 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c93f1e-9541-4206-b992-705b73713b26 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:42.810100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c93f1e-9541-4206-b992-705b73713b26 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:42.810901 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c93f1e-9541-4206-b992-705b73713b26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:42.821849 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c93f1e-9541-4206-b992-705b73713b26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:42.823635 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c93f1e-9541-4206-b992-705b73713b26 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:42.846259 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1224/2447] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:04:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:04:47.446882 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f772ada-2daf-4179-bc6f-e25633771ec6 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:47.447409 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f772ada-2daf-4179-bc6f-e25633771ec6 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:47.447409 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f772ada-2daf-4179-bc6f-e25633771ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:47.496113 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-7f772ada-2daf-4179-bc6f-e25633771ec6 None None] MFA Rules not processed for user `1ae58a1764394f17a5599d5fed30ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:04:47.504469 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-7f772ada-2daf-4179-bc6f-e25633771ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:47.520340 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1224/2448] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:04:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:04:48.040564 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c93f1e-9541-4206-b992-705b73713b26 service nova] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:48.052511 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c93f1e-9541-4206-b992-705b73713b26 service nova] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:48.061441 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba32da6-fb2f-477f-afd1-e5c7f5a41860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:48.062553 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba32da6-fb2f-477f-afd1-e5c7f5a41860 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:48.063010 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba32da6-fb2f-477f-afd1-e5c7f5a41860 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:48.063444 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba32da6-fb2f-477f-afd1-e5c7f5a41860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:48.065940 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5ba32da6-fb2f-477f-afd1-e5c7f5a41860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:48.078965 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba32da6-fb2f-477f-afd1-e5c7f5a41860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:48.080871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba32da6-fb2f-477f-afd1-e5c7f5a41860 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:48.103588 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1225/2449] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:04:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:04:49.376724 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dd3d4-6ee7-4384-845a-cc0fa6374e28 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:49.377338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dd3d4-6ee7-4384-845a-cc0fa6374e28 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:49.377338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dd3d4-6ee7-4384-845a-cc0fa6374e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:49.405879 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-0e5dd3d4-6ee7-4384-845a-cc0fa6374e28 None None] MFA Rules not processed for user `8066cbf7602941abbe345006dac52359`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:04:49.407232 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-0e5dd3d4-6ee7-4384-845a-cc0fa6374e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:49.486010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1225/2450] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:04:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:04:49.490379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba32da6-fb2f-477f-afd1-e5c7f5a41860 service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:49.504501 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba32da6-fb2f-477f-afd1-e5c7f5a41860 service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:49.511224 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a8e7a-3971-45b2-862a-8406923df8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:49.512057 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a8e7a-3971-45b2-862a-8406923df8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:49.512292 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a8e7a-3971-45b2-862a-8406923df8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:49.512565 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a8e7a-3971-45b2-862a-8406923df8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:49.513366 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a8e7a-3971-45b2-862a-8406923df8d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:49.515267 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a8e7a-3971-45b2-862a-8406923df8d1 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:49.726122 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1226/2451] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:04:49 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:04:49.730263 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5dd3d4-6ee7-4384-845a-cc0fa6374e28 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:49.742488 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5dd3d4-6ee7-4384-845a-cc0fa6374e28 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:49.813537 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e6c8f-91ad-4ccc-961b-c41452938a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:49.814411 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e6c8f-91ad-4ccc-961b-c41452938a58 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:49.814698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e6c8f-91ad-4ccc-961b-c41452938a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:49.814979 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e6c8f-91ad-4ccc-961b-c41452938a58 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:49.815854 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e6c8f-91ad-4ccc-961b-c41452938a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:49.817866 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e6c8f-91ad-4ccc-961b-c41452938a58 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:50.012462 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1226/2452] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:04:49 2022] POST /identity/v3/users => generated 296 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:04:50.016775 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a8e7a-3971-45b2-862a-8406923df8d1 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:50.028197 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a8e7a-3971-45b2-862a-8406923df8d1 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:50.032881 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025b82c-df5b-4a11-a051-e3afd8bc7985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:50.033911 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025b82c-df5b-4a11-a051-e3afd8bc7985 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:50.034369 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025b82c-df5b-4a11-a051-e3afd8bc7985 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:50.047118 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025b82c-df5b-4a11-a051-e3afd8bc7985 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:50.047118 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025b82c-df5b-4a11-a051-e3afd8bc7985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:50.047118 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025b82c-df5b-4a11-a051-e3afd8bc7985 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:50.056526 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1227/2453] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:04:50.061059 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e6c8f-91ad-4ccc-961b-c41452938a58 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:50.094904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e6c8f-91ad-4ccc-961b-c41452938a58 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:50.096331 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3777c-07b0-416a-b9c8-cddf4d691280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:50.097296 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3777c-07b0-416a-b9c8-cddf4d691280 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:50.097577 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3777c-07b0-416a-b9c8-cddf4d691280 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:50.098126 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3777c-07b0-416a-b9c8-cddf4d691280 admin admin] PATH_INFO: `/v3/projects/1642a7a3568f42bb8ce42be2630feb05/users/fcce48cd367e480a9ee146ea0a1488d5/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:50.119620 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3777c-07b0-416a-b9c8-cddf4d691280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1642a7a3568f42bb8ce42be2630feb05, user_id=fcce48cd367e480a9ee146ea0a1488d5, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:50.122644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3777c-07b0-416a-b9c8-cddf4d691280 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:50.299666 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1227/2454] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:04:50 2022] PUT /identity/v3/projects/1642a7a3568f42bb8ce42be2630feb05/users/fcce48cd367e480a9ee146ea0a1488d5/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:04:50.304734 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025b82c-df5b-4a11-a051-e3afd8bc7985 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:50.316233 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025b82c-df5b-4a11-a051-e3afd8bc7985 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:50.387384 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a28b7-f645-4a02-85ea-773592187276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:50.388335 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a28b7-f645-4a02-85ea-773592187276 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:50.388847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a28b7-f645-4a02-85ea-773592187276 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:50.389196 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a28b7-f645-4a02-85ea-773592187276 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:50.390072 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a28b7-f645-4a02-85ea-773592187276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:50.391999 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a28b7-f645-4a02-85ea-773592187276 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:50.406275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1228/2455] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:04:50.409867 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3777c-07b0-416a-b9c8-cddf4d691280 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:50.429619 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3777c-07b0-416a-b9c8-cddf4d691280 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:50.434958 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2c942-2a99-42ca-9ded-880f9defcd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:50.436449 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2c942-2a99-42ca-9ded-880f9defcd7f admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:50.436761 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2c942-2a99-42ca-9ded-880f9defcd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:50.437239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2c942-2a99-42ca-9ded-880f9defcd7f admin admin] PATH_INFO: `/v3/projects/1642a7a3568f42bb8ce42be2630feb05/users/fcce48cd367e480a9ee146ea0a1488d5/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:50.439297 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2c942-2a99-42ca-9ded-880f9defcd7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1642a7a3568f42bb8ce42be2630feb05, user_id=fcce48cd367e480a9ee146ea0a1488d5, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:50.446614 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2c942-2a99-42ca-9ded-880f9defcd7f admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:50.458501 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1228/2456] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:04:50 2022] PUT /identity/v3/projects/1642a7a3568f42bb8ce42be2630feb05/users/fcce48cd367e480a9ee146ea0a1488d5/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:04:55.541701 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa526892-875b-4b5f-bfd5-23bb14595ac0 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:55.543569 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa526892-875b-4b5f-bfd5-23bb14595ac0 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:55.543569 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa526892-875b-4b5f-bfd5-23bb14595ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:55.592949 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-fa526892-875b-4b5f-bfd5-23bb14595ac0 None None] MFA Rules not processed for user `f7fe7ea486834f6e9e8a7685d9c36bac`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:04:55.598735 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-fa526892-875b-4b5f-bfd5-23bb14595ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:55.719055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1229/2457] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:04:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:04:59.323931 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d7cb1-3f7e-4c7d-bc97-15cdc0f4fc02 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:59.324444 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d7cb1-3f7e-4c7d-bc97-15cdc0f4fc02 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:59.325052 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d7cb1-3f7e-4c7d-bc97-15cdc0f4fc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:59.361966 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-de8d7cb1-3f7e-4c7d-bc97-15cdc0f4fc02 None None] MFA Rules not processed for user `fcce48cd367e480a9ee146ea0a1488d5`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:04:59.363216 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-de8d7cb1-3f7e-4c7d-bc97-15cdc0f4fc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:04:59.444754 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1229/2458] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:04:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:04:59.456755 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa526892-875b-4b5f-bfd5-23bb14595ac0 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:04:59.540005 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa526892-875b-4b5f-bfd5-23bb14595ac0 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:04:59.549756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e92bd-66e5-42d7-8015-2fe9380e929e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:04:59.550435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e92bd-66e5-42d7-8015-2fe9380e929e service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:04:59.551150 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e92bd-66e5-42d7-8015-2fe9380e929e service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:04:59.551430 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e92bd-66e5-42d7-8015-2fe9380e929e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:04:59.660862 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e92bd-66e5-42d7-8015-2fe9380e929e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:04:59.664552 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e92bd-66e5-42d7-8015-2fe9380e929e service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:04:59.692664 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1230/2459] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:04:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:05:30.559671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481b1ab-e4ef-4bdb-a07e-75cbf8b72717 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:05:30.563385 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481b1ab-e4ef-4bdb-a07e-75cbf8b72717 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:05:30.563385 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481b1ab-e4ef-4bdb-a07e-75cbf8b72717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:05:30.579569 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-b481b1ab-e4ef-4bdb-a07e-75cbf8b72717 None None] MFA Rules not processed for user `8066cbf7602941abbe345006dac52359`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:05:30.581174 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b481b1ab-e4ef-4bdb-a07e-75cbf8b72717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:05:30.588998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1230/2460] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:05:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:05:46.977254 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664a37f-9748-46ee-a05e-f0e0e6f0adef None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:05:46.977957 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664a37f-9748-46ee-a05e-f0e0e6f0adef None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:05:46.977957 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664a37f-9748-46ee-a05e-f0e0e6f0adef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:05:46.996316 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-1664a37f-9748-46ee-a05e-f0e0e6f0adef None None] MFA Rules not processed for user `1144e9036d0b4bafb30995ff1a8449ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:05:46.997685 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1664a37f-9748-46ee-a05e-f0e0e6f0adef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:05:47.062539 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1231/2461] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Apr 14 22:05:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:05:47.261088 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481b1ab-e4ef-4bdb-a07e-75cbf8b72717 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:05:47.262595 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b481b1ab-e4ef-4bdb-a07e-75cbf8b72717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:05:47.341118 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481b1ab-e4ef-4bdb-a07e-75cbf8b72717 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:05:47.346671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df107ec-97c4-42a4-b4a1-093bfe6f08fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bf55488d046c4be98a903d113c0fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:05:47.347354 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df107ec-97c4-42a4-b4a1-093bfe6f08fe service swift] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:05:47.347692 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df107ec-97c4-42a4-b4a1-093bfe6f08fe service swift] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:05:47.347999 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df107ec-97c4-42a4-b4a1-093bfe6f08fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:05:47.357207 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df107ec-97c4-42a4-b4a1-093bfe6f08fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:05:47.359054 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df107ec-97c4-42a4-b4a1-093bfe6f08fe service swift] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:05:47.368333 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1231/2462] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Apr 14 22:05:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 14 22:05:53.715828 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664a37f-9748-46ee-a05e-f0e0e6f0adef None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:05:53.813846 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664a37f-9748-46ee-a05e-f0e0e6f0adef None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:05:53.819105 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd8a2f-1729-45a5-aa47-878d0700cc78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:05:53.820210 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8a2f-1729-45a5-aa47-878d0700cc78 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:05:53.820210 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8a2f-1729-45a5-aa47-878d0700cc78 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:05:53.820422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8a2f-1729-45a5-aa47-878d0700cc78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:05:53.831860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd8a2f-1729-45a5-aa47-878d0700cc78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:05:53.835141 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd8a2f-1729-45a5-aa47-878d0700cc78 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:05:53.849536 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1232/2463] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:05:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:06:08.297043 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d7148-db56-48df-82cb-27fdd440a20f None None] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:06:08.297685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d7148-db56-48df-82cb-27fdd440a20f None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:06:08.297685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d7148-db56-48df-82cb-27fdd440a20f None None] PATH_INFO: `/` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:06:08.299014 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1232/2464] 10.222.0.52 () {54 vars in 921 bytes} [Thu Apr 14 22:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 14 22:06:08.305059 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6db16-d1f7-4c83-a62b-03ddaf70a1ef None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:06:08.305991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6db16-d1f7-4c83-a62b-03ddaf70a1ef None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:06:08.306157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6db16-d1f7-4c83-a62b-03ddaf70a1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:06:08.327437 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-efb6db16-d1f7-4c83-a62b-03ddaf70a1ef None None] MFA Rules not processed for user `e7f3ea629181433eb8c6d5dbc354c141`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:06:08.328649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-efb6db16-d1f7-4c83-a62b-03ddaf70a1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:06:08.340047 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1233/2465] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Apr 14 22:06:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:06:08.353741 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d7148-db56-48df-82cb-27fdd440a20f None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:06:08.356507 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-721d7148-db56-48df-82cb-27fdd440a20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:06:08.420871 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d7148-db56-48df-82cb-27fdd440a20f None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:06:08.424481 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a58656-d709-4302-b08f-317fcf4d7deb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d261ec6e42f4be08c4d584fd3d00850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:06:08.427406 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a58656-d709-4302-b08f-317fcf4d7deb service glance] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:06:08.427406 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a58656-d709-4302-b08f-317fcf4d7deb service glance] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:06:08.427406 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a58656-d709-4302-b08f-317fcf4d7deb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:06:08.436724 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a58656-d709-4302-b08f-317fcf4d7deb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:06:08.438220 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a58656-d709-4302-b08f-317fcf4d7deb service glance] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:06:08.450368 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1233/2466] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:06:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:06:11.708952 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84babcf-a651-488e-9aa6-53376e6693c4 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:06:11.709524 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84babcf-a651-488e-9aa6-53376e6693c4 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:06:11.709524 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84babcf-a651-488e-9aa6-53376e6693c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:06:11.733663 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-e84babcf-a651-488e-9aa6-53376e6693c4 None None] MFA Rules not processed for user `1144e9036d0b4bafb30995ff1a8449ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:06:11.735002 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e84babcf-a651-488e-9aa6-53376e6693c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:06:11.742654 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1234/2467] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Apr 14 22:06:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:06:11.757257 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a58656-d709-4302-b08f-317fcf4d7deb service glance] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:06:11.769743 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a58656-d709-4302-b08f-317fcf4d7deb service glance] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:06:11.774639 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca22c9-b466-4df1-bb79-8681c84f6a8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bf55488d046c4be98a903d113c0fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:06:11.775271 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca22c9-b466-4df1-bb79-8681c84f6a8d service swift] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:06:11.775552 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca22c9-b466-4df1-bb79-8681c84f6a8d service swift] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:06:11.775824 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca22c9-b466-4df1-bb79-8681c84f6a8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:06:11.786585 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca22c9-b466-4df1-bb79-8681c84f6a8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:06:11.788085 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca22c9-b466-4df1-bb79-8681c84f6a8d service swift] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:06:11.797149 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1234/2468] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Apr 14 22:06:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 14 22:06:11.840566 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84babcf-a651-488e-9aa6-53376e6693c4 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:06:11.852383 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84babcf-a651-488e-9aa6-53376e6693c4 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:06:11.856188 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae439221-db88-4bd7-8200-9aaf25206cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:06:11.856873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae439221-db88-4bd7-8200-9aaf25206cba service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:06:11.857157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae439221-db88-4bd7-8200-9aaf25206cba service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:06:11.857429 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae439221-db88-4bd7-8200-9aaf25206cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:06:11.859258 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ae439221-db88-4bd7-8200-9aaf25206cba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:06:11.874016 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae439221-db88-4bd7-8200-9aaf25206cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:06:11.875444 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae439221-db88-4bd7-8200-9aaf25206cba service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:06:11.888516 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1235/2469] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:06:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:06:13.100626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca22c9-b466-4df1-bb79-8681c84f6a8d service swift] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:06:13.102097 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c4ca22c9-b466-4df1-bb79-8681c84f6a8d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:06:13.114950 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca22c9-b466-4df1-bb79-8681c84f6a8d service swift] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:06:13.118869 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bdd73-0200-4ba1-8a73-3fdf9d71a17b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:06:13.119562 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bdd73-0200-4ba1-8a73-3fdf9d71a17b service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:06:13.119843 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bdd73-0200-4ba1-8a73-3fdf9d71a17b service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:06:13.120155 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bdd73-0200-4ba1-8a73-3fdf9d71a17b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:06:13.122070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-a82bdd73-0200-4ba1-8a73-3fdf9d71a17b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:06:13.137113 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bdd73-0200-4ba1-8a73-3fdf9d71a17b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:06:13.138633 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bdd73-0200-4ba1-8a73-3fdf9d71a17b service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:06:13.151999 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1235/2470] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:06:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:06:20.348134 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae439221-db88-4bd7-8200-9aaf25206cba service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:06:20.348134 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae439221-db88-4bd7-8200-9aaf25206cba service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:06:20.348134 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484d02a-4fdd-4407-8c90-d8cf11aedf90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:06:20.348134 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484d02a-4fdd-4407-8c90-d8cf11aedf90 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:06:20.349123 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484d02a-4fdd-4407-8c90-d8cf11aedf90 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:06:20.349123 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484d02a-4fdd-4407-8c90-d8cf11aedf90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:06:20.349123 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-3484d02a-4fdd-4407-8c90-d8cf11aedf90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:06:20.430833 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484d02a-4fdd-4407-8c90-d8cf11aedf90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:06:20.432720 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484d02a-4fdd-4407-8c90-d8cf11aedf90 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:06:20.455276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1236/2471] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:06:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:06:35.702280 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc0ef-f928-48a7-941e-4784b20d5cfb None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:06:35.702856 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc0ef-f928-48a7-941e-4784b20d5cfb None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:06:35.702856 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc0ef-f928-48a7-941e-4784b20d5cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:06:35.722411 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-9eacc0ef-f928-48a7-941e-4784b20d5cfb None None] MFA Rules not processed for user `1144e9036d0b4bafb30995ff1a8449ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:06:35.723601 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-9eacc0ef-f928-48a7-941e-4784b20d5cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:06:35.734571 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1236/2472] 10.222.0.52 () {58 vars in 967 bytes} [Thu Apr 14 22:06:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:06:35.746924 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484d02a-4fdd-4407-8c90-d8cf11aedf90 service nova] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:06:35.758475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484d02a-4fdd-4407-8c90-d8cf11aedf90 service nova] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:06:35.763707 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27b277-5c26-49c4-a58f-2d0343cd2a28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360bf55488d046c4be98a903d113c0fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:06:35.764378 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27b277-5c26-49c4-a58f-2d0343cd2a28 service swift] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:06:35.764698 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27b277-5c26-49c4-a58f-2d0343cd2a28 service swift] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:06:35.764996 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27b277-5c26-49c4-a58f-2d0343cd2a28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:06:35.774467 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27b277-5c26-49c4-a58f-2d0343cd2a28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:06:35.776103 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27b277-5c26-49c4-a58f-2d0343cd2a28 service swift] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:06:35.785522 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1237/2473] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Apr 14 22:06:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 14 22:07:14.597196 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacc0ef-f928-48a7-941e-4784b20d5cfb None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:07:14.606653 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacc0ef-f928-48a7-941e-4784b20d5cfb None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:07:14.611766 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b656e73-0587-4407-9dd0-ff559edfa9de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:07:14.612417 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b656e73-0587-4407-9dd0-ff559edfa9de service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:07:14.612723 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b656e73-0587-4407-9dd0-ff559edfa9de service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:07:14.612995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b656e73-0587-4407-9dd0-ff559edfa9de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:07:14.614825 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-2b656e73-0587-4407-9dd0-ff559edfa9de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:07:14.680890 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b656e73-0587-4407-9dd0-ff559edfa9de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:07:14.682347 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b656e73-0587-4407-9dd0-ff559edfa9de service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:07:14.693184 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1237/2474] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:07:22.131410 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27b277-5c26-49c4-a58f-2d0343cd2a28 service swift] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:07:22.142185 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27b277-5c26-49c4-a58f-2d0343cd2a28 service swift] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:07:22.149012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e6be9-f0ab-4b0b-89be-c425df94e723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:07:22.149704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e6be9-f0ab-4b0b-89be-c425df94e723 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:07:22.149984 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e6be9-f0ab-4b0b-89be-c425df94e723 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:07:22.155090 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e6be9-f0ab-4b0b-89be-c425df94e723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:07:22.155090 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ae9e6be9-f0ab-4b0b-89be-c425df94e723 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:07:22.167981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e6be9-f0ab-4b0b-89be-c425df94e723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:07:22.169625 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e6be9-f0ab-4b0b-89be-c425df94e723 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:07:22.179799 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1238/2475] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:07:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:07:23.417627 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b656e73-0587-4407-9dd0-ff559edfa9de service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:07:23.419167 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-2b656e73-0587-4407-9dd0-ff559edfa9de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:07:23.453743 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b656e73-0587-4407-9dd0-ff559edfa9de service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:07:23.460516 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c33860-bb6b-4ac6-b16f-916906891006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:07:23.461590 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c33860-bb6b-4ac6-b16f-916906891006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:07:23.461992 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c33860-bb6b-4ac6-b16f-916906891006 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:07:23.462437 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c33860-bb6b-4ac6-b16f-916906891006 admin admin] PATH_INFO: `/v3/users/0e6cce45bcf44dc18fff389fd75e95db` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:07:23.463823 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c33860-bb6b-4ac6-b16f-916906891006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e6cce45bcf44dc18fff389fd75e95db)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:07:23.465925 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c33860-bb6b-4ac6-b16f-916906891006 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:07:23.714851 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-17c33860-bb6b-4ac6-b16f-916906891006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e6cce45bcf44dc18fff389fd75e95db'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:23.715525 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-17c33860-bb6b-4ac6-b16f-916906891006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e6cce45bcf44dc18fff389fd75e95db'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:23.731671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-17c33860-bb6b-4ac6-b16f-916906891006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e6cce45bcf44dc18fff389fd75e95db'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:23.739791 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-17c33860-bb6b-4ac6-b16f-916906891006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e6cce45bcf44dc18fff389fd75e95db'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:23.740496 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-17c33860-bb6b-4ac6-b16f-916906891006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e6cce45bcf44dc18fff389fd75e95db'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:23.837282 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1238/2476] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:07:23 2022] DELETE /identity/v3/users/0e6cce45bcf44dc18fff389fd75e95db => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:07:24.113037 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e6be9-f0ab-4b0b-89be-c425df94e723 service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:07:24.125061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e6be9-f0ab-4b0b-89be-c425df94e723 service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:07:24.189132 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084f646-ff1f-477a-aa9b-6cad7734f890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:07:24.189983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084f646-ff1f-477a-aa9b-6cad7734f890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:07:24.190263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084f646-ff1f-477a-aa9b-6cad7734f890 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:07:24.190535 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084f646-ff1f-477a-aa9b-6cad7734f890 admin admin] PATH_INFO: `/v3/projects/36c976f9546746d293b7a29600a0fad3` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:07:24.213748 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084f646-ff1f-477a-aa9b-6cad7734f890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c976f9546746d293b7a29600a0fad3)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:07:24.213748 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084f646-ff1f-477a-aa9b-6cad7734f890 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:07:24.317934 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6084f646-ff1f-477a-aa9b-6cad7734f890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c976f9546746d293b7a29600a0fad3', 'request_id': 'req-6084f646-ff1f-477a-aa9b-6cad7734f890'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:24.442999 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6084f646-ff1f-477a-aa9b-6cad7734f890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c976f9546746d293b7a29600a0fad3', 'request_id': 'req-6084f646-ff1f-477a-aa9b-6cad7734f890'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:24.449878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6084f646-ff1f-477a-aa9b-6cad7734f890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c976f9546746d293b7a29600a0fad3', 'request_id': 'req-6084f646-ff1f-477a-aa9b-6cad7734f890'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:24.461833 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6084f646-ff1f-477a-aa9b-6cad7734f890 admin admin] The token cache is being invalidate because project 36c976f9546746d293b7a29600a0fad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:07:24.462118 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6084f646-ff1f-477a-aa9b-6cad7734f890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:24.462772 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6084f646-ff1f-477a-aa9b-6cad7734f890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:24.464362 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1239/2477] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:07:24 2022] DELETE /identity/v3/projects/36c976f9546746d293b7a29600a0fad3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:07:24.468479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c33860-bb6b-4ac6-b16f-916906891006 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:07:24.470026 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-17c33860-bb6b-4ac6-b16f-916906891006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:07:24.483637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c33860-bb6b-4ac6-b16f-916906891006 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:07:24.542279 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958eba2-7d3c-4cc8-af70-fea4f71aa0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:07:24.543163 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958eba2-7d3c-4cc8-af70-fea4f71aa0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:07:24.543449 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958eba2-7d3c-4cc8-af70-fea4f71aa0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:07:24.543722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958eba2-7d3c-4cc8-af70-fea4f71aa0e8 admin admin] PATH_INFO: `/v3/users/3aef7113a1c04baeab0b5cab00b544cb` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:07:24.545023 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958eba2-7d3c-4cc8-af70-fea4f71aa0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aef7113a1c04baeab0b5cab00b544cb)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:07:24.547375 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958eba2-7d3c-4cc8-af70-fea4f71aa0e8 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:07:24.770831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-2958eba2-7d3c-4cc8-af70-fea4f71aa0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aef7113a1c04baeab0b5cab00b544cb'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:24.771605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-2958eba2-7d3c-4cc8-af70-fea4f71aa0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aef7113a1c04baeab0b5cab00b544cb'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:24.782888 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-2958eba2-7d3c-4cc8-af70-fea4f71aa0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aef7113a1c04baeab0b5cab00b544cb'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:24.789476 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-2958eba2-7d3c-4cc8-af70-fea4f71aa0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aef7113a1c04baeab0b5cab00b544cb'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:24.790322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-2958eba2-7d3c-4cc8-af70-fea4f71aa0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aef7113a1c04baeab0b5cab00b544cb'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:24.887512 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1239/2478] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:07:24 2022] DELETE /identity/v3/users/3aef7113a1c04baeab0b5cab00b544cb => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:07:25.297609 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084f646-ff1f-477a-aa9b-6cad7734f890 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:07:25.297609 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-6084f646-ff1f-477a-aa9b-6cad7734f890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:07:25.297609 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084f646-ff1f-477a-aa9b-6cad7734f890 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:07:25.322198 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799945f-a58a-4cca-83bb-2b5a26424f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:07:25.323242 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799945f-a58a-4cca-83bb-2b5a26424f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:07:25.323517 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799945f-a58a-4cca-83bb-2b5a26424f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:07:25.323788 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799945f-a58a-4cca-83bb-2b5a26424f43 admin admin] PATH_INFO: `/v3/projects/456b46582603477682a2f5c447cb58cd` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:07:25.325024 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799945f-a58a-4cca-83bb-2b5a26424f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=456b46582603477682a2f5c447cb58cd)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:07:25.326970 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799945f-a58a-4cca-83bb-2b5a26424f43 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:07:25.491109 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3799945f-a58a-4cca-83bb-2b5a26424f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '456b46582603477682a2f5c447cb58cd', 'request_id': 'req-3799945f-a58a-4cca-83bb-2b5a26424f43'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:25.609527 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3799945f-a58a-4cca-83bb-2b5a26424f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '456b46582603477682a2f5c447cb58cd', 'request_id': 'req-3799945f-a58a-4cca-83bb-2b5a26424f43'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:25.616412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3799945f-a58a-4cca-83bb-2b5a26424f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '456b46582603477682a2f5c447cb58cd', 'request_id': 'req-3799945f-a58a-4cca-83bb-2b5a26424f43'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:25.627756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3799945f-a58a-4cca-83bb-2b5a26424f43 admin admin] The token cache is being invalidate because project 456b46582603477682a2f5c447cb58cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:07:25.628875 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3799945f-a58a-4cca-83bb-2b5a26424f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:25.633017 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3799945f-a58a-4cca-83bb-2b5a26424f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:07:25.634595 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1240/2479] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:07:25 2022] DELETE /identity/v3/projects/456b46582603477682a2f5c447cb58cd => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:07:43.682623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895f397-23ad-4c8c-b0a4-a30e5e7c98bd None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:07:43.685921 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895f397-23ad-4c8c-b0a4-a30e5e7c98bd None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:07:43.685921 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895f397-23ad-4c8c-b0a4-a30e5e7c98bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:07:43.702574 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-f895f397-23ad-4c8c-b0a4-a30e5e7c98bd None None] MFA Rules not processed for user `f7fe7ea486834f6e9e8a7685d9c36bac`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:07:43.703438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f895f397-23ad-4c8c-b0a4-a30e5e7c98bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:07:43.765880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1240/2480] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:07:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:07:44.099697 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799945f-a58a-4cca-83bb-2b5a26424f43 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:07:44.101177 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-3799945f-a58a-4cca-83bb-2b5a26424f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:07:44.158302 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799945f-a58a-4cca-83bb-2b5a26424f43 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:07:44.161915 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677c200-e2e7-4e19-809b-d011a3baaa46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:07:44.162561 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677c200-e2e7-4e19-809b-d011a3baaa46 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:07:44.162837 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677c200-e2e7-4e19-809b-d011a3baaa46 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:07:44.163121 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677c200-e2e7-4e19-809b-d011a3baaa46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:07:44.164882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1677c200-e2e7-4e19-809b-d011a3baaa46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:07:44.175510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677c200-e2e7-4e19-809b-d011a3baaa46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:07:44.176982 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677c200-e2e7-4e19-809b-d011a3baaa46 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:07:44.185102 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1241/2481] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:07:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:07:44.623207 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895f397-23ad-4c8c-b0a4-a30e5e7c98bd None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:07:44.625594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f895f397-23ad-4c8c-b0a4-a30e5e7c98bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:07:44.702478 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895f397-23ad-4c8c-b0a4-a30e5e7c98bd None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:07:44.708469 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126d12b-5de9-4099-84c2-53f9412cd6a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e166c6b0e5542f7b912cbefa88bb5f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:07:44.709199 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126d12b-5de9-4099-84c2-53f9412cd6a3 service placement] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:07:44.709597 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126d12b-5de9-4099-84c2-53f9412cd6a3 service placement] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:07:44.709967 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126d12b-5de9-4099-84c2-53f9412cd6a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:07:44.712210 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c126d12b-5de9-4099-84c2-53f9412cd6a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:07:44.725920 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126d12b-5de9-4099-84c2-53f9412cd6a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:07:44.727592 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126d12b-5de9-4099-84c2-53f9412cd6a3 service placement] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:07:44.744616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1241/2482] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:07:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:07:53.829704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677c200-e2e7-4e19-809b-d011a3baaa46 service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:07:53.831305 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1677c200-e2e7-4e19-809b-d011a3baaa46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:07:53.926361 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677c200-e2e7-4e19-809b-d011a3baaa46 service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:07:53.932468 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d2caf-11b6-426f-b7cc-ebfaa1656271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:07:53.933154 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d2caf-11b6-426f-b7cc-ebfaa1656271 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:07:53.933437 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d2caf-11b6-426f-b7cc-ebfaa1656271 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:07:53.933733 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d2caf-11b6-426f-b7cc-ebfaa1656271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:07:53.935550 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-031d2caf-11b6-426f-b7cc-ebfaa1656271 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:07:53.948572 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d2caf-11b6-426f-b7cc-ebfaa1656271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:07:53.954829 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d2caf-11b6-426f-b7cc-ebfaa1656271 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:07:53.961381 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1242/2483] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:07:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:07:59.739507 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126d12b-5de9-4099-84c2-53f9412cd6a3 service placement] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:07:59.742567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c126d12b-5de9-4099-84c2-53f9412cd6a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:07:59.760156 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126d12b-5de9-4099-84c2-53f9412cd6a3 service placement] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:07:59.770685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4320059-22aa-46cb-b8fd-47cfe2226f25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:07:59.772034 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4320059-22aa-46cb-b8fd-47cfe2226f25 service nova] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:07:59.772722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4320059-22aa-46cb-b8fd-47cfe2226f25 service nova] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:07:59.778370 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4320059-22aa-46cb-b8fd-47cfe2226f25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:07:59.778370 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b4320059-22aa-46cb-b8fd-47cfe2226f25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:07:59.796010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4320059-22aa-46cb-b8fd-47cfe2226f25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:07:59.797838 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4320059-22aa-46cb-b8fd-47cfe2226f25 service nova] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:07:59.813254 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1242/2484] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:07:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:08:05.755893 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d2caf-11b6-426f-b7cc-ebfaa1656271 service nova] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:05.795175 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d2caf-11b6-426f-b7cc-ebfaa1656271 service nova] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:05.799444 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f19c6d-bb56-45d4-a973-28013f13552a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:05.800085 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f19c6d-bb56-45d4-a973-28013f13552a service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:05.800368 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f19c6d-bb56-45d4-a973-28013f13552a service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:05.800663 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f19c6d-bb56-45d4-a973-28013f13552a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:05.802480 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-50f19c6d-bb56-45d4-a973-28013f13552a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:08:05.924745 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f19c6d-bb56-45d4-a973-28013f13552a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:05.926091 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f19c6d-bb56-45d4-a973-28013f13552a service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:05.945958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1243/2485] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:08:09.666579 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4320059-22aa-46cb-b8fd-47cfe2226f25 service nova] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:09.668068 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b4320059-22aa-46cb-b8fd-47cfe2226f25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:08:09.721558 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4320059-22aa-46cb-b8fd-47cfe2226f25 service nova] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:09.726857 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4c8b5-f5db-46f3-883f-60bf2bf95c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:09.727673 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4c8b5-f5db-46f3-883f-60bf2bf95c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:09.727960 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4c8b5-f5db-46f3-883f-60bf2bf95c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:09.728239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4c8b5-f5db-46f3-883f-60bf2bf95c28 admin admin] PATH_INFO: `/v3/users/5fe1c344dfc940479b4ed781461bd89b` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:09.729543 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4c8b5-f5db-46f3-883f-60bf2bf95c28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe1c344dfc940479b4ed781461bd89b)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:09.731525 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4c8b5-f5db-46f3-883f-60bf2bf95c28 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:09.959651 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-13c4c8b5-f5db-46f3-883f-60bf2bf95c28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe1c344dfc940479b4ed781461bd89b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:09.960394 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-13c4c8b5-f5db-46f3-883f-60bf2bf95c28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe1c344dfc940479b4ed781461bd89b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:09.974121 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-13c4c8b5-f5db-46f3-883f-60bf2bf95c28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe1c344dfc940479b4ed781461bd89b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:09.981053 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-13c4c8b5-f5db-46f3-883f-60bf2bf95c28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe1c344dfc940479b4ed781461bd89b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:09.981749 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-13c4c8b5-f5db-46f3-883f-60bf2bf95c28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe1c344dfc940479b4ed781461bd89b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:10.120492 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1243/2486] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:08:09 2022] DELETE /identity/v3/users/5fe1c344dfc940479b4ed781461bd89b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:08:10.364529 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f19c6d-bb56-45d4-a973-28013f13552a service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:10.376046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f19c6d-bb56-45d4-a973-28013f13552a service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:10.439130 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e208fa9-871f-4238-beff-420c6046413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:10.439502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e208fa9-871f-4238-beff-420c6046413e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:10.439774 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e208fa9-871f-4238-beff-420c6046413e admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:10.440047 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e208fa9-871f-4238-beff-420c6046413e admin admin] PATH_INFO: `/v3/projects/4341bd0e366648d2a8e427316961d985` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:10.441467 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e208fa9-871f-4238-beff-420c6046413e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4341bd0e366648d2a8e427316961d985)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:10.443369 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e208fa9-871f-4238-beff-420c6046413e admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:10.620756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-2e208fa9-871f-4238-beff-420c6046413e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4341bd0e366648d2a8e427316961d985', 'request_id': 'req-2e208fa9-871f-4238-beff-420c6046413e'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:10.697340 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-2e208fa9-871f-4238-beff-420c6046413e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4341bd0e366648d2a8e427316961d985', 'request_id': 'req-2e208fa9-871f-4238-beff-420c6046413e'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:10.704442 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-2e208fa9-871f-4238-beff-420c6046413e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4341bd0e366648d2a8e427316961d985', 'request_id': 'req-2e208fa9-871f-4238-beff-420c6046413e'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:10.715269 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-2e208fa9-871f-4238-beff-420c6046413e admin admin] The token cache is being invalidate because project 4341bd0e366648d2a8e427316961d985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:08:10.715580 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-2e208fa9-871f-4238-beff-420c6046413e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:10.716238 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-2e208fa9-871f-4238-beff-420c6046413e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:10.718105 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1244/2487] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:08:10 2022] DELETE /identity/v3/projects/4341bd0e366648d2a8e427316961d985 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:08:10.723532 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a73e11-1a38-4bc9-8b64-95ddccdb7a30 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:10.724057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a73e11-1a38-4bc9-8b64-95ddccdb7a30 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:10.724318 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a73e11-1a38-4bc9-8b64-95ddccdb7a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:10.782959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-e1a73e11-1a38-4bc9-8b64-95ddccdb7a30 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:08:10.784167 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e1a73e11-1a38-4bc9-8b64-95ddccdb7a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:08:10.847757 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1244/2488] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:08:10.856144 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eab414-8860-42a8-89c1-b9b625ff3514 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:10.856428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eab414-8860-42a8-89c1-b9b625ff3514 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:10.856740 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eab414-8860-42a8-89c1-b9b625ff3514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:10.876248 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-08eab414-8860-42a8-89c1-b9b625ff3514 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:08:10.877382 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-08eab414-8860-42a8-89c1-b9b625ff3514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:08:10.885208 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1245/2489] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:08:10.889405 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a73e11-1a38-4bc9-8b64-95ddccdb7a30 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:10.899235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a73e11-1a38-4bc9-8b64-95ddccdb7a30 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:10.904319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0efbb-8dfd-49a0-b11e-8e25a0808f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:10.904998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0efbb-8dfd-49a0-b11e-8e25a0808f15 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:10.905273 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0efbb-8dfd-49a0-b11e-8e25a0808f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:10.905577 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0efbb-8dfd-49a0-b11e-8e25a0808f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:10.906305 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0efbb-8dfd-49a0-b11e-8e25a0808f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:08:10.906610 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0efbb-8dfd-49a0-b11e-8e25a0808f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:10.908300 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0efbb-8dfd-49a0-b11e-8e25a0808f15 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:10.922572 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1245/2490] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:08:10.927015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eab414-8860-42a8-89c1-b9b625ff3514 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:10.937179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eab414-8860-42a8-89c1-b9b625ff3514 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:10.941855 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41284bd0-d397-425c-ad48-22a74547e187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:10.942514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41284bd0-d397-425c-ad48-22a74547e187 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:10.942789 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41284bd0-d397-425c-ad48-22a74547e187 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:10.943472 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41284bd0-d397-425c-ad48-22a74547e187 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:10.944033 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41284bd0-d397-425c-ad48-22a74547e187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:10.945952 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41284bd0-d397-425c-ad48-22a74547e187 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:11.117725 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1246/2491] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:08:10 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:08:11.121920 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0efbb-8dfd-49a0-b11e-8e25a0808f15 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:11.132519 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0efbb-8dfd-49a0-b11e-8e25a0808f15 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:11.195640 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cf83a-ce16-4f56-9d41-af960d6ee38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:11.196321 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cf83a-ce16-4f56-9d41-af960d6ee38d admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:11.196638 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cf83a-ce16-4f56-9d41-af960d6ee38d admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:11.196919 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cf83a-ce16-4f56-9d41-af960d6ee38d admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:11.197623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cf83a-ce16-4f56-9d41-af960d6ee38d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:11.199554 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cf83a-ce16-4f56-9d41-af960d6ee38d admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:11.328546 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1246/2492] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:08:11 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:08:11.332878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41284bd0-d397-425c-ad48-22a74547e187 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:11.343778 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41284bd0-d397-425c-ad48-22a74547e187 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:11.348766 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc514a-58cd-4154-8a26-ef34f6c10f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:11.349428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc514a-58cd-4154-8a26-ef34f6c10f3a admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:11.349702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc514a-58cd-4154-8a26-ef34f6c10f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:11.349970 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc514a-58cd-4154-8a26-ef34f6c10f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:11.350690 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc514a-58cd-4154-8a26-ef34f6c10f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:11.352287 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc514a-58cd-4154-8a26-ef34f6c10f3a admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:11.362667 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1247/2493] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:08:11.367081 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cf83a-ce16-4f56-9d41-af960d6ee38d admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:11.377178 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cf83a-ce16-4f56-9d41-af960d6ee38d admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:11.381823 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b244347-a70c-42ff-bba2-5dd856796869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:11.382485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b244347-a70c-42ff-bba2-5dd856796869 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:11.382816 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b244347-a70c-42ff-bba2-5dd856796869 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:11.383035 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b244347-a70c-42ff-bba2-5dd856796869 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:11.383763 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b244347-a70c-42ff-bba2-5dd856796869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:11.385393 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b244347-a70c-42ff-bba2-5dd856796869 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:11.397290 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1247/2494] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:08:11.401502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc514a-58cd-4154-8a26-ef34f6c10f3a admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:11.412785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc514a-58cd-4154-8a26-ef34f6c10f3a admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:11.417338 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fe547-7bd3-49a6-a921-5cc39b5e9633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:11.418199 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fe547-7bd3-49a6-a921-5cc39b5e9633 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:11.418475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fe547-7bd3-49a6-a921-5cc39b5e9633 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:11.418745 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fe547-7bd3-49a6-a921-5cc39b5e9633 admin admin] PATH_INFO: `/v3/projects/1ea1238962b9443ca72ee0ffae62707f/users/0158054156064413b38556560468f776/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:11.433580 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fe547-7bd3-49a6-a921-5cc39b5e9633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea1238962b9443ca72ee0ffae62707f, user_id=0158054156064413b38556560468f776, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:11.436790 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fe547-7bd3-49a6-a921-5cc39b5e9633 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:11.522736 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1248/2495] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:08:11 2022] PUT /identity/v3/projects/1ea1238962b9443ca72ee0ffae62707f/users/0158054156064413b38556560468f776/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:08:11.534246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb2a4b-006d-4bc8-9261-9297cbfd2d00 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:11.534652 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb2a4b-006d-4bc8-9261-9297cbfd2d00 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:11.534808 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb2a4b-006d-4bc8-9261-9297cbfd2d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:11.562152 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-71cb2a4b-006d-4bc8-9261-9297cbfd2d00 None None] MFA Rules not processed for user `0158054156064413b38556560468f776`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:08:11.563375 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-71cb2a4b-006d-4bc8-9261-9297cbfd2d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:08:11.636980 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1248/2496] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:08:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:08:11.648443 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fe547-7bd3-49a6-a921-5cc39b5e9633 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:11.650132 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-df7fe547-7bd3-49a6-a921-5cc39b5e9633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:08:11.723935 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fe547-7bd3-49a6-a921-5cc39b5e9633 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:11.729402 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f8cd1-45f1-466d-a871-1108add99675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:11.730078 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f8cd1-45f1-466d-a871-1108add99675 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:11.730355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f8cd1-45f1-466d-a871-1108add99675 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:11.730624 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f8cd1-45f1-466d-a871-1108add99675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:11.739295 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f8cd1-45f1-466d-a871-1108add99675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:11.740966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f8cd1-45f1-466d-a871-1108add99675 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:11.750571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1249/2497] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:08:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:08:22.223522 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb2a4b-006d-4bc8-9261-9297cbfd2d00 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:22.285582 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb2a4b-006d-4bc8-9261-9297cbfd2d00 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:22.290282 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3d0ac-2eb3-4711-b169-44e1597c7091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:22.291141 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3d0ac-2eb3-4711-b169-44e1597c7091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:22.291468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3d0ac-2eb3-4711-b169-44e1597c7091 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:22.291752 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3d0ac-2eb3-4711-b169-44e1597c7091 admin admin] PATH_INFO: `/v3/users/0158054156064413b38556560468f776` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:22.292957 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3d0ac-2eb3-4711-b169-44e1597c7091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0158054156064413b38556560468f776)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:22.295709 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3d0ac-2eb3-4711-b169-44e1597c7091 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:22.535674 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c8d3d0ac-2eb3-4711-b169-44e1597c7091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0158054156064413b38556560468f776'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:22.536265 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c8d3d0ac-2eb3-4711-b169-44e1597c7091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0158054156064413b38556560468f776'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:22.548232 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c8d3d0ac-2eb3-4711-b169-44e1597c7091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0158054156064413b38556560468f776'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:22.555278 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c8d3d0ac-2eb3-4711-b169-44e1597c7091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0158054156064413b38556560468f776'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:22.555983 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c8d3d0ac-2eb3-4711-b169-44e1597c7091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0158054156064413b38556560468f776'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:22.676072 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1249/2498] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:08:22 2022] DELETE /identity/v3/users/0158054156064413b38556560468f776 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:08:22.680716 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82abdf-e05c-4a3f-a332-b1bf266d3394 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:22.681355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82abdf-e05c-4a3f-a332-b1bf266d3394 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:22.681355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82abdf-e05c-4a3f-a332-b1bf266d3394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:22.698308 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-1f82abdf-e05c-4a3f-a332-b1bf266d3394 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:08:22.699516 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1f82abdf-e05c-4a3f-a332-b1bf266d3394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:08:22.759677 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1250/2499] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:08:22.769939 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3d0ac-2eb3-4711-b169-44e1597c7091 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:22.771363 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c8d3d0ac-2eb3-4711-b169-44e1597c7091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:08:22.840651 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3d0ac-2eb3-4711-b169-44e1597c7091 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:22.845073 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0118a92-e9c0-4c8a-8ae6-d64b32e3aba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:22.845738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0118a92-e9c0-4c8a-8ae6-d64b32e3aba7 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:22.846275 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0118a92-e9c0-4c8a-8ae6-d64b32e3aba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:22.846551 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0118a92-e9c0-4c8a-8ae6-d64b32e3aba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:22.855738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0118a92-e9c0-4c8a-8ae6-d64b32e3aba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:22.857272 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0118a92-e9c0-4c8a-8ae6-d64b32e3aba7 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:22.866827 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1250/2500] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:08:23.365486 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82abdf-e05c-4a3f-a332-b1bf266d3394 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:23.366981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1f82abdf-e05c-4a3f-a332-b1bf266d3394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:08:23.380132 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82abdf-e05c-4a3f-a332-b1bf266d3394 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:23.384885 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e648f0-3b6c-4227-a2de-0b5d48c958cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:23.385752 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e648f0-3b6c-4227-a2de-0b5d48c958cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:23.386030 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e648f0-3b6c-4227-a2de-0b5d48c958cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:23.386305 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e648f0-3b6c-4227-a2de-0b5d48c958cd admin admin] PATH_INFO: `/v3/projects/1ea1238962b9443ca72ee0ffae62707f` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:23.387547 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e648f0-3b6c-4227-a2de-0b5d48c958cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea1238962b9443ca72ee0ffae62707f)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:23.389732 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e648f0-3b6c-4227-a2de-0b5d48c958cd admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:23.545592 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-13e648f0-3b6c-4227-a2de-0b5d48c958cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea1238962b9443ca72ee0ffae62707f', 'request_id': 'req-13e648f0-3b6c-4227-a2de-0b5d48c958cd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:23.658936 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-13e648f0-3b6c-4227-a2de-0b5d48c958cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea1238962b9443ca72ee0ffae62707f', 'request_id': 'req-13e648f0-3b6c-4227-a2de-0b5d48c958cd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:23.665592 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-13e648f0-3b6c-4227-a2de-0b5d48c958cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea1238962b9443ca72ee0ffae62707f', 'request_id': 'req-13e648f0-3b6c-4227-a2de-0b5d48c958cd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:23.675852 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-13e648f0-3b6c-4227-a2de-0b5d48c958cd admin admin] The token cache is being invalidate because project 1ea1238962b9443ca72ee0ffae62707f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:08:23.676139 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-13e648f0-3b6c-4227-a2de-0b5d48c958cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:23.676815 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-13e648f0-3b6c-4227-a2de-0b5d48c958cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:08:23.678385 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1251/2501] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:08:23 2022] DELETE /identity/v3/projects/1ea1238962b9443ca72ee0ffae62707f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:08:23.683342 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3704b8c-52e0-4d56-84fc-7470c746d24a None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:23.683823 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3704b8c-52e0-4d56-84fc-7470c746d24a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:23.683948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3704b8c-52e0-4d56-84fc-7470c746d24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:23.704076 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-b3704b8c-52e0-4d56-84fc-7470c746d24a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:08:23.705349 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b3704b8c-52e0-4d56-84fc-7470c746d24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:08:23.765781 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1251/2502] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:08:23.773684 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeeda1-64bd-4d53-9d45-33b30d77170f None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:23.774180 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeeda1-64bd-4d53-9d45-33b30d77170f None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:23.774279 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeeda1-64bd-4d53-9d45-33b30d77170f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:23.792359 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-5aaeeda1-64bd-4d53-9d45-33b30d77170f None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:08:23.793595 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5aaeeda1-64bd-4d53-9d45-33b30d77170f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:08:23.801700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1252/2503] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:08:23.806334 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3704b8c-52e0-4d56-84fc-7470c746d24a None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:23.816956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3704b8c-52e0-4d56-84fc-7470c746d24a None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:23.821544 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b18a6-9409-4017-840c-f0635be38971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:23.822181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b18a6-9409-4017-840c-f0635be38971 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:23.822464 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b18a6-9409-4017-840c-f0635be38971 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:23.822732 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b18a6-9409-4017-840c-f0635be38971 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:23.823474 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b18a6-9409-4017-840c-f0635be38971 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:08:23.823779 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b18a6-9409-4017-840c-f0635be38971 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:23.826243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b18a6-9409-4017-840c-f0635be38971 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:23.837990 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1252/2504] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:08:23.842294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaeeda1-64bd-4d53-9d45-33b30d77170f None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:23.851963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaeeda1-64bd-4d53-9d45-33b30d77170f None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:23.856771 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a36dd-6e79-4df8-a9e4-554fbc13c1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:23.857447 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a36dd-6e79-4df8-a9e4-554fbc13c1ea admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:23.857728 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a36dd-6e79-4df8-a9e4-554fbc13c1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:23.858021 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a36dd-6e79-4df8-a9e4-554fbc13c1ea admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:23.858744 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a36dd-6e79-4df8-a9e4-554fbc13c1ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:23.860661 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a36dd-6e79-4df8-a9e4-554fbc13c1ea admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:23.946125 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1253/2505] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:08:23 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:08:23.950941 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b18a6-9409-4017-840c-f0635be38971 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:23.960967 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b18a6-9409-4017-840c-f0635be38971 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:24.018381 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcda769-dcfa-45f0-ae5f-add28edb084a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:24.019049 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcda769-dcfa-45f0-ae5f-add28edb084a admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:24.019327 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcda769-dcfa-45f0-ae5f-add28edb084a admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:24.019635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcda769-dcfa-45f0-ae5f-add28edb084a admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:24.020345 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcda769-dcfa-45f0-ae5f-add28edb084a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:24.022419 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcda769-dcfa-45f0-ae5f-add28edb084a admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:24.150090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1253/2506] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:08:23 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:08:24.154381 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a36dd-6e79-4df8-a9e4-554fbc13c1ea admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:24.164732 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a36dd-6e79-4df8-a9e4-554fbc13c1ea admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:24.169969 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f565f-e9c7-4288-b077-fa86d7a4a62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:24.170622 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f565f-e9c7-4288-b077-fa86d7a4a62f admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:24.170917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f565f-e9c7-4288-b077-fa86d7a4a62f admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:24.171219 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f565f-e9c7-4288-b077-fa86d7a4a62f admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:24.171948 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f565f-e9c7-4288-b077-fa86d7a4a62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:24.173666 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f565f-e9c7-4288-b077-fa86d7a4a62f admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:24.184280 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1254/2507] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:08:24.188898 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcda769-dcfa-45f0-ae5f-add28edb084a admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:24.198824 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcda769-dcfa-45f0-ae5f-add28edb084a admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:24.204116 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e34c9-1ca2-41d3-9065-34a69bd20d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:24.204854 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e34c9-1ca2-41d3-9065-34a69bd20d6e admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:24.205133 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e34c9-1ca2-41d3-9065-34a69bd20d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:24.205405 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e34c9-1ca2-41d3-9065-34a69bd20d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:24.206131 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e34c9-1ca2-41d3-9065-34a69bd20d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:24.207714 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e34c9-1ca2-41d3-9065-34a69bd20d6e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:24.218184 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1254/2508] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:08:24.222646 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f565f-e9c7-4288-b077-fa86d7a4a62f admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:24.233174 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f565f-e9c7-4288-b077-fa86d7a4a62f admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:24.237949 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76358b75-2db9-409c-9ae5-798f0d360e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:24.238929 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358b75-2db9-409c-9ae5-798f0d360e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:24.239244 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358b75-2db9-409c-9ae5-798f0d360e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:24.239554 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358b75-2db9-409c-9ae5-798f0d360e19 admin admin] PATH_INFO: `/v3/projects/084ad8f1a4c042f2a4e6e4c493b058c2/users/244017c1dce847f7bb9e97e072ceadb4/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:24.255263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76358b75-2db9-409c-9ae5-798f0d360e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=084ad8f1a4c042f2a4e6e4c493b058c2, user_id=244017c1dce847f7bb9e97e072ceadb4, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:24.257934 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76358b75-2db9-409c-9ae5-798f0d360e19 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:24.365795 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1255/2509] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:08:24 2022] PUT /identity/v3/projects/084ad8f1a4c042f2a4e6e4c493b058c2/users/244017c1dce847f7bb9e97e072ceadb4/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:08:24.377843 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf7b60-194c-4fb5-8150-38d6b9bad2dd None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:24.378129 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf7b60-194c-4fb5-8150-38d6b9bad2dd None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:24.378407 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf7b60-194c-4fb5-8150-38d6b9bad2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:24.404820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-b0bf7b60-194c-4fb5-8150-38d6b9bad2dd None None] MFA Rules not processed for user `244017c1dce847f7bb9e97e072ceadb4`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:08:24.406204 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b0bf7b60-194c-4fb5-8150-38d6b9bad2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:08:24.470193 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1255/2510] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:08:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:08:24.475019 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76358b75-2db9-409c-9ae5-798f0d360e19 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:24.536078 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76358b75-2db9-409c-9ae5-798f0d360e19 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:24.541200 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c28fc-32fe-43ef-8edf-414a60de3e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:24.551135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c28fc-32fe-43ef-8edf-414a60de3e38 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:24.551135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c28fc-32fe-43ef-8edf-414a60de3e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:24.551135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c28fc-32fe-43ef-8edf-414a60de3e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:24.551135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c28fc-32fe-43ef-8edf-414a60de3e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:24.551135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c28fc-32fe-43ef-8edf-414a60de3e38 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:24.655313 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1256/2511] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:08:24 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:08:24.659447 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf7b60-194c-4fb5-8150-38d6b9bad2dd None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:24.671058 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf7b60-194c-4fb5-8150-38d6b9bad2dd None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:24.730987 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e846f-4cc8-43f9-817f-bc264d32fb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:24.731884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e846f-4cc8-43f9-817f-bc264d32fb76 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:24.732000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e846f-4cc8-43f9-817f-bc264d32fb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:24.732240 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e846f-4cc8-43f9-817f-bc264d32fb76 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:24.732976 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e846f-4cc8-43f9-817f-bc264d32fb76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:24.734951 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e846f-4cc8-43f9-817f-bc264d32fb76 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:24.876600 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1256/2512] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:08:24 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:08:24.880742 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c28fc-32fe-43ef-8edf-414a60de3e38 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:24.892005 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c28fc-32fe-43ef-8edf-414a60de3e38 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:24.897544 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085f65f-91fa-448c-9b90-5e1c314cd47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:24.898233 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085f65f-91fa-448c-9b90-5e1c314cd47c admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:24.898504 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085f65f-91fa-448c-9b90-5e1c314cd47c admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:24.898773 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085f65f-91fa-448c-9b90-5e1c314cd47c admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:24.899499 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085f65f-91fa-448c-9b90-5e1c314cd47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:24.901174 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085f65f-91fa-448c-9b90-5e1c314cd47c admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:24.913630 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1257/2513] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:08:24.917930 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e846f-4cc8-43f9-817f-bc264d32fb76 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:24.928685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e846f-4cc8-43f9-817f-bc264d32fb76 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:24.933437 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44e2a3-874a-4415-b7e8-fe0e21de92b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:24.934332 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44e2a3-874a-4415-b7e8-fe0e21de92b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:24.934807 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44e2a3-874a-4415-b7e8-fe0e21de92b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:24.935311 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44e2a3-874a-4415-b7e8-fe0e21de92b9 admin admin] PATH_INFO: `/v3/projects/e41b91e70455400494267ce7c03271b6/users/7d1551f3b41244ff80e59b149dfcd761/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:24.950892 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44e2a3-874a-4415-b7e8-fe0e21de92b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41b91e70455400494267ce7c03271b6, user_id=7d1551f3b41244ff80e59b149dfcd761, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:24.954365 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44e2a3-874a-4415-b7e8-fe0e21de92b9 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:25.065377 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1257/2514] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:08:24 2022] PUT /identity/v3/projects/e41b91e70455400494267ce7c03271b6/users/7d1551f3b41244ff80e59b149dfcd761/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:08:25.069439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085f65f-91fa-448c-9b90-5e1c314cd47c admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:25.080243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085f65f-91fa-448c-9b90-5e1c314cd47c admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:25.136280 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80599e1-06f9-403b-917f-2a873121be31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:25.136966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80599e1-06f9-403b-917f-2a873121be31 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:25.137243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80599e1-06f9-403b-917f-2a873121be31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:25.138678 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80599e1-06f9-403b-917f-2a873121be31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:25.139411 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80599e1-06f9-403b-917f-2a873121be31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:25.141123 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80599e1-06f9-403b-917f-2a873121be31 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:25.150786 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1258/2515] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:08:25.155199 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44e2a3-874a-4415-b7e8-fe0e21de92b9 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:25.165323 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44e2a3-874a-4415-b7e8-fe0e21de92b9 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:25.170785 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc817c-91b2-455e-afc0-b7dfe4010092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:25.171695 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc817c-91b2-455e-afc0-b7dfe4010092 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:25.171972 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc817c-91b2-455e-afc0-b7dfe4010092 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:25.172240 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc817c-91b2-455e-afc0-b7dfe4010092 admin admin] PATH_INFO: `/v3/projects/e41b91e70455400494267ce7c03271b6/users/7d1551f3b41244ff80e59b149dfcd761/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:25.174226 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc817c-91b2-455e-afc0-b7dfe4010092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41b91e70455400494267ce7c03271b6, user_id=7d1551f3b41244ff80e59b149dfcd761, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:25.176904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc817c-91b2-455e-afc0-b7dfe4010092 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:25.188316 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1258/2516] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:08:25 2022] PUT /identity/v3/projects/e41b91e70455400494267ce7c03271b6/users/7d1551f3b41244ff80e59b149dfcd761/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:08:25.198650 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594945f-c2d5-4056-bcc2-df23cadf74ad None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:25.198936 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594945f-c2d5-4056-bcc2-df23cadf74ad None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:25.199210 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594945f-c2d5-4056-bcc2-df23cadf74ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:25.225683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-2594945f-c2d5-4056-bcc2-df23cadf74ad None None] MFA Rules not processed for user `7d1551f3b41244ff80e59b149dfcd761`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:08:25.227051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-2594945f-c2d5-4056-bcc2-df23cadf74ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:08:25.293876 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1259/2517] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:08:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:08:25.305314 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc817c-91b2-455e-afc0-b7dfe4010092 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:25.307011 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b3fc817c-91b2-455e-afc0-b7dfe4010092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:08:25.365287 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc817c-91b2-455e-afc0-b7dfe4010092 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:25.368838 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0a2a4-b809-4c67-8991-0faeeb2f3c09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:25.369473 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0a2a4-b809-4c67-8991-0faeeb2f3c09 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:25.369748 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0a2a4-b809-4c67-8991-0faeeb2f3c09 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:25.370016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0a2a4-b809-4c67-8991-0faeeb2f3c09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:25.380356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0a2a4-b809-4c67-8991-0faeeb2f3c09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:25.381816 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0a2a4-b809-4c67-8991-0faeeb2f3c09 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:25.392045 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1259/2518] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:08:25 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:08:25.664402 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594945f-c2d5-4056-bcc2-df23cadf74ad None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:08:25.674435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594945f-c2d5-4056-bcc2-df23cadf74ad None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:08:25.678026 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecca381-8905-4e8b-8134-a504a0cfd26c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:08:25.678706 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca381-8905-4e8b-8134-a504a0cfd26c service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:25.678987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca381-8905-4e8b-8134-a504a0cfd26c service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:25.679259 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca381-8905-4e8b-8134-a504a0cfd26c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:25.737038 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecca381-8905-4e8b-8134-a504a0cfd26c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:08:25.738501 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecca381-8905-4e8b-8134-a504a0cfd26c service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:08:25.748464 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1260/2519] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:08:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:08:44.867186 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460038e-1a75-4123-9d26-9e833c7318fe None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:08:44.867855 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460038e-1a75-4123-9d26-9e833c7318fe None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:08:44.867855 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460038e-1a75-4123-9d26-9e833c7318fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:08:44.885772 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-f460038e-1a75-4123-9d26-9e833c7318fe None None] MFA Rules not processed for user `8066cbf7602941abbe345006dac52359`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:08:44.887168 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f460038e-1a75-4123-9d26-9e833c7318fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:08:44.942031 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1260/2520] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:08:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:09:13.429873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecca381-8905-4e8b-8134-a504a0cfd26c service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:13.431358 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-0ecca381-8905-4e8b-8134-a504a0cfd26c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:13.552190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecca381-8905-4e8b-8134-a504a0cfd26c service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:13.559248 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b910f5-a182-4f3c-b357-b645ccfa9cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:13.559955 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b910f5-a182-4f3c-b357-b645ccfa9cc6 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:13.560403 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b910f5-a182-4f3c-b357-b645ccfa9cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:13.560606 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b910f5-a182-4f3c-b357-b645ccfa9cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:13.563488 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b8b910f5-a182-4f3c-b357-b645ccfa9cc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:13.583274 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b910f5-a182-4f3c-b357-b645ccfa9cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:13.584928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b910f5-a182-4f3c-b357-b645ccfa9cc6 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:13.597817 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1261/2521] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:09:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:09:23.196151 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460038e-1a75-4123-9d26-9e833c7318fe None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:23.199537 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f460038e-1a75-4123-9d26-9e833c7318fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:23.299107 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460038e-1a75-4123-9d26-9e833c7318fe None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:23.303952 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777d16f-60a8-4583-a1dd-c50662363a20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e166c6b0e5542f7b912cbefa88bb5f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:23.304616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777d16f-60a8-4583-a1dd-c50662363a20 service placement] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:23.304898 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777d16f-60a8-4583-a1dd-c50662363a20 service placement] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:23.305796 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777d16f-60a8-4583-a1dd-c50662363a20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:23.308497 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-3777d16f-60a8-4583-a1dd-c50662363a20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:23.320107 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777d16f-60a8-4583-a1dd-c50662363a20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:23.321733 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777d16f-60a8-4583-a1dd-c50662363a20 service placement] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:23.332665 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1261/2522] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:09:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:09:28.496929 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b910f5-a182-4f3c-b357-b645ccfa9cc6 service nova] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:28.568735 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b910f5-a182-4f3c-b357-b645ccfa9cc6 service nova] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:28.573965 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea15cc7-d748-4fe7-a8fe-01b61b032275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:28.574834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea15cc7-d748-4fe7-a8fe-01b61b032275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:28.575108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea15cc7-d748-4fe7-a8fe-01b61b032275 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:28.575379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea15cc7-d748-4fe7-a8fe-01b61b032275 admin admin] PATH_INFO: `/v3/users/244017c1dce847f7bb9e97e072ceadb4` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:28.576565 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea15cc7-d748-4fe7-a8fe-01b61b032275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=244017c1dce847f7bb9e97e072ceadb4)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:28.578501 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea15cc7-d748-4fe7-a8fe-01b61b032275 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:28.809435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fea15cc7-d748-4fe7-a8fe-01b61b032275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244017c1dce847f7bb9e97e072ceadb4'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:28.810142 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fea15cc7-d748-4fe7-a8fe-01b61b032275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244017c1dce847f7bb9e97e072ceadb4'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:28.828805 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fea15cc7-d748-4fe7-a8fe-01b61b032275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244017c1dce847f7bb9e97e072ceadb4'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:28.836167 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fea15cc7-d748-4fe7-a8fe-01b61b032275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244017c1dce847f7bb9e97e072ceadb4'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:28.839274 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fea15cc7-d748-4fe7-a8fe-01b61b032275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244017c1dce847f7bb9e97e072ceadb4'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:28.937317 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1262/2523] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:09:28 2022] DELETE /identity/v3/users/244017c1dce847f7bb9e97e072ceadb4 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:28.942181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac24793-c236-4c55-b75f-046abe452ea8 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:28.942733 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac24793-c236-4c55-b75f-046abe452ea8 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:28.942733 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac24793-c236-4c55-b75f-046abe452ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:28.964714 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-4ac24793-c236-4c55-b75f-046abe452ea8 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:09:28.964714 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-4ac24793-c236-4c55-b75f-046abe452ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:29.029541 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1262/2524] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:09:29.039541 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea15cc7-d748-4fe7-a8fe-01b61b032275 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:29.041313 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-fea15cc7-d748-4fe7-a8fe-01b61b032275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:29.105296 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea15cc7-d748-4fe7-a8fe-01b61b032275 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:29.109048 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507158e-44c1-4954-bd4d-87694e575ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:29.109703 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507158e-44c1-4954-bd4d-87694e575ced service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:29.109982 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507158e-44c1-4954-bd4d-87694e575ced service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:29.110253 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507158e-44c1-4954-bd4d-87694e575ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:29.120040 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507158e-44c1-4954-bd4d-87694e575ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:29.121519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507158e-44c1-4954-bd4d-87694e575ced service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:29.131482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1263/2525] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:09:29.588856 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac24793-c236-4c55-b75f-046abe452ea8 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:29.591356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-4ac24793-c236-4c55-b75f-046abe452ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:29.605707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac24793-c236-4c55-b75f-046abe452ea8 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:29.614809 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8abee1-ad3e-49e2-8837-ad68646268ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:29.615748 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8abee1-ad3e-49e2-8837-ad68646268ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:29.616124 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8abee1-ad3e-49e2-8837-ad68646268ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:29.616427 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8abee1-ad3e-49e2-8837-ad68646268ac admin admin] PATH_INFO: `/v3/projects/084ad8f1a4c042f2a4e6e4c493b058c2` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:29.617671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8abee1-ad3e-49e2-8837-ad68646268ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=084ad8f1a4c042f2a4e6e4c493b058c2)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:29.619699 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8abee1-ad3e-49e2-8837-ad68646268ac admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:29.750145 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5d8abee1-ad3e-49e2-8837-ad68646268ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '084ad8f1a4c042f2a4e6e4c493b058c2', 'request_id': 'req-5d8abee1-ad3e-49e2-8837-ad68646268ac'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:29.846280 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5d8abee1-ad3e-49e2-8837-ad68646268ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '084ad8f1a4c042f2a4e6e4c493b058c2', 'request_id': 'req-5d8abee1-ad3e-49e2-8837-ad68646268ac'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:29.854795 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5d8abee1-ad3e-49e2-8837-ad68646268ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '084ad8f1a4c042f2a4e6e4c493b058c2', 'request_id': 'req-5d8abee1-ad3e-49e2-8837-ad68646268ac'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:29.865282 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5d8abee1-ad3e-49e2-8837-ad68646268ac admin admin] The token cache is being invalidate because project 084ad8f1a4c042f2a4e6e4c493b058c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:09:29.865567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5d8abee1-ad3e-49e2-8837-ad68646268ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:29.866222 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5d8abee1-ad3e-49e2-8837-ad68646268ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:29.867772 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1263/2526] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:09:29 2022] DELETE /identity/v3/projects/084ad8f1a4c042f2a4e6e4c493b058c2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:29.872563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507158e-44c1-4954-bd4d-87694e575ced service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:29.882227 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507158e-44c1-4954-bd4d-87694e575ced service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:29.938275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe0f19-25b2-4809-95e2-6ebe80f2441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:29.939128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe0f19-25b2-4809-95e2-6ebe80f2441e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:29.939409 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe0f19-25b2-4809-95e2-6ebe80f2441e admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:29.939684 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe0f19-25b2-4809-95e2-6ebe80f2441e admin admin] PATH_INFO: `/v3/users/7d1551f3b41244ff80e59b149dfcd761` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:29.941774 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe0f19-25b2-4809-95e2-6ebe80f2441e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d1551f3b41244ff80e59b149dfcd761)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:29.943156 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe0f19-25b2-4809-95e2-6ebe80f2441e admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:30.192883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-84fe0f19-25b2-4809-95e2-6ebe80f2441e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d1551f3b41244ff80e59b149dfcd761'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:30.193476 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-84fe0f19-25b2-4809-95e2-6ebe80f2441e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d1551f3b41244ff80e59b149dfcd761'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:30.205850 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-84fe0f19-25b2-4809-95e2-6ebe80f2441e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d1551f3b41244ff80e59b149dfcd761'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:30.212784 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-84fe0f19-25b2-4809-95e2-6ebe80f2441e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d1551f3b41244ff80e59b149dfcd761'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:30.215993 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-84fe0f19-25b2-4809-95e2-6ebe80f2441e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d1551f3b41244ff80e59b149dfcd761'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:30.337851 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1264/2527] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:09:29 2022] DELETE /identity/v3/users/7d1551f3b41244ff80e59b149dfcd761 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:30.801841 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8abee1-ad3e-49e2-8837-ad68646268ac admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:30.803298 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-5d8abee1-ad3e-49e2-8837-ad68646268ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:30.819790 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8abee1-ad3e-49e2-8837-ad68646268ac admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:30.883886 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed877e1-ff80-473e-96b8-9a67ab0823c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:30.885677 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed877e1-ff80-473e-96b8-9a67ab0823c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:30.885950 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed877e1-ff80-473e-96b8-9a67ab0823c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:30.886222 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed877e1-ff80-473e-96b8-9a67ab0823c0 admin admin] PATH_INFO: `/v3/projects/e41b91e70455400494267ce7c03271b6` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:30.887445 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed877e1-ff80-473e-96b8-9a67ab0823c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e41b91e70455400494267ce7c03271b6)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:30.889397 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed877e1-ff80-473e-96b8-9a67ab0823c0 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:30.988356 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fed877e1-ff80-473e-96b8-9a67ab0823c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e41b91e70455400494267ce7c03271b6', 'request_id': 'req-fed877e1-ff80-473e-96b8-9a67ab0823c0'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:31.073717 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fed877e1-ff80-473e-96b8-9a67ab0823c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e41b91e70455400494267ce7c03271b6', 'request_id': 'req-fed877e1-ff80-473e-96b8-9a67ab0823c0'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:31.081712 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fed877e1-ff80-473e-96b8-9a67ab0823c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e41b91e70455400494267ce7c03271b6', 'request_id': 'req-fed877e1-ff80-473e-96b8-9a67ab0823c0'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:31.092565 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fed877e1-ff80-473e-96b8-9a67ab0823c0 admin admin] The token cache is being invalidate because project e41b91e70455400494267ce7c03271b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:09:31.092876 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fed877e1-ff80-473e-96b8-9a67ab0823c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:31.093525 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-fed877e1-ff80-473e-96b8-9a67ab0823c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:31.095275 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1264/2528] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:09:30 2022] DELETE /identity/v3/projects/e41b91e70455400494267ce7c03271b6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:31.101638 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a5d46-a89f-4d6d-892d-52887c33b44e None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:31.102191 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a5d46-a89f-4d6d-892d-52887c33b44e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:31.102736 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a5d46-a89f-4d6d-892d-52887c33b44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:31.122771 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-a53a5d46-a89f-4d6d-892d-52887c33b44e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:09:31.124031 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a53a5d46-a89f-4d6d-892d-52887c33b44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:31.192705 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1265/2529] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:09:31.201831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f21fd-b995-4a25-bb31-a14a2d81de89 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:31.202114 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f21fd-b995-4a25-bb31-a14a2d81de89 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:31.202390 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f21fd-b995-4a25-bb31-a14a2d81de89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:31.225712 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-cd9f21fd-b995-4a25-bb31-a14a2d81de89 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:09:31.226980 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-cd9f21fd-b995-4a25-bb31-a14a2d81de89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:31.235267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1265/2530] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:09:31.239942 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a5d46-a89f-4d6d-892d-52887c33b44e None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:31.252127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a5d46-a89f-4d6d-892d-52887c33b44e None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:31.257039 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f9292-92b9-4cc1-bc6d-120d783a94bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:31.257700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f9292-92b9-4cc1-bc6d-120d783a94bc admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:31.257981 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f9292-92b9-4cc1-bc6d-120d783a94bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:31.258265 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f9292-92b9-4cc1-bc6d-120d783a94bc admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:31.258989 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f9292-92b9-4cc1-bc6d-120d783a94bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:09:31.259297 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f9292-92b9-4cc1-bc6d-120d783a94bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:31.261596 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f9292-92b9-4cc1-bc6d-120d783a94bc admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:31.273881 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1266/2531] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 22:09:31.278841 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f21fd-b995-4a25-bb31-a14a2d81de89 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:31.288230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f21fd-b995-4a25-bb31-a14a2d81de89 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:31.293407 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e76453-7e4c-43d4-b90c-17c4cdea3656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:31.294060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e76453-7e4c-43d4-b90c-17c4cdea3656 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:31.294340 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e76453-7e4c-43d4-b90c-17c4cdea3656 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:31.294616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e76453-7e4c-43d4-b90c-17c4cdea3656 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:31.295318 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e76453-7e4c-43d4-b90c-17c4cdea3656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:31.297279 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e76453-7e4c-43d4-b90c-17c4cdea3656 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:31.414259 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1266/2532] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:09:31 2022] POST /identity/v3/projects => generated 393 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:09:31.419769 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f9292-92b9-4cc1-bc6d-120d783a94bc admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:31.432469 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f9292-92b9-4cc1-bc6d-120d783a94bc admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:31.499413 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4299484-414d-4142-b3f7-16c37f3f20f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:31.500082 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4299484-414d-4142-b3f7-16c37f3f20f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:31.500368 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4299484-414d-4142-b3f7-16c37f3f20f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:31.500666 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4299484-414d-4142-b3f7-16c37f3f20f0 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:31.501380 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4299484-414d-4142-b3f7-16c37f3f20f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:31.503305 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4299484-414d-4142-b3f7-16c37f3f20f0 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:31.629190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1267/2533] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:09:31 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:09:31.633318 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e76453-7e4c-43d4-b90c-17c4cdea3656 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:31.646556 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e76453-7e4c-43d4-b90c-17c4cdea3656 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:31.654840 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa302f6-91b4-4cd8-bf4c-941f3d8a6a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:31.655979 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa302f6-91b4-4cd8-bf4c-941f3d8a6a2a admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:31.656486 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa302f6-91b4-4cd8-bf4c-941f3d8a6a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:31.657018 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa302f6-91b4-4cd8-bf4c-941f3d8a6a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:31.658391 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa302f6-91b4-4cd8-bf4c-941f3d8a6a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:31.661476 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa302f6-91b4-4cd8-bf4c-941f3d8a6a2a admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:31.680174 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1267/2534] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:09:31.687297 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4299484-414d-4142-b3f7-16c37f3f20f0 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:31.697578 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4299484-414d-4142-b3f7-16c37f3f20f0 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:31.702570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d001805-7240-4941-86e5-e4df938d0594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:31.703234 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d001805-7240-4941-86e5-e4df938d0594 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:31.703515 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d001805-7240-4941-86e5-e4df938d0594 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:31.703791 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d001805-7240-4941-86e5-e4df938d0594 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:31.704526 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d001805-7240-4941-86e5-e4df938d0594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:31.706190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d001805-7240-4941-86e5-e4df938d0594 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:31.716698 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1268/2535] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:09:31.721347 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa302f6-91b4-4cd8-bf4c-941f3d8a6a2a admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:31.732341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa302f6-91b4-4cd8-bf4c-941f3d8a6a2a admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:31.737950 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014ab29-10e1-4764-af3a-9ccd184a65b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:31.738846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014ab29-10e1-4764-af3a-9ccd184a65b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:31.739124 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014ab29-10e1-4764-af3a-9ccd184a65b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:31.739393 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014ab29-10e1-4764-af3a-9ccd184a65b6 admin admin] PATH_INFO: `/v3/projects/adf8c003bbc648159a840f5e34010a13/users/ba05f0ec34f34ca19a9639cb384c930f/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:31.756560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014ab29-10e1-4764-af3a-9ccd184a65b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf8c003bbc648159a840f5e34010a13, user_id=ba05f0ec34f34ca19a9639cb384c930f, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:31.759275 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014ab29-10e1-4764-af3a-9ccd184a65b6 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:31.877089 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1268/2536] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:09:31 2022] PUT /identity/v3/projects/adf8c003bbc648159a840f5e34010a13/users/ba05f0ec34f34ca19a9639cb384c930f/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:31.887449 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6873-b0f3-40a0-b1e1-5c8f98cc9597 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:31.887735 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6873-b0f3-40a0-b1e1-5c8f98cc9597 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:31.888009 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6873-b0f3-40a0-b1e1-5c8f98cc9597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:31.915129 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-fdbe6873-b0f3-40a0-b1e1-5c8f98cc9597 None None] MFA Rules not processed for user `ba05f0ec34f34ca19a9639cb384c930f`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:09:31.916896 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-fdbe6873-b0f3-40a0-b1e1-5c8f98cc9597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:31.984126 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1269/2537] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:09:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:09:31.988735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014ab29-10e1-4764-af3a-9ccd184a65b6 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:32.059388 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014ab29-10e1-4764-af3a-9ccd184a65b6 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:32.064379 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99703553-cb27-4b46-b7a3-1a92065d6aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:32.065111 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99703553-cb27-4b46-b7a3-1a92065d6aaa admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:32.065403 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99703553-cb27-4b46-b7a3-1a92065d6aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:32.065683 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99703553-cb27-4b46-b7a3-1a92065d6aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:32.066380 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99703553-cb27-4b46-b7a3-1a92065d6aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:32.068374 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99703553-cb27-4b46-b7a3-1a92065d6aaa admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:32.168117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1269/2538] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:09:31 2022] POST /identity/v3/projects => generated 393 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:09:32.172303 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe6873-b0f3-40a0-b1e1-5c8f98cc9597 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:32.183531 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe6873-b0f3-40a0-b1e1-5c8f98cc9597 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:32.240921 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb0800-a0a0-473c-8ceb-b6ca4d02765d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:32.241512 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0800-a0a0-473c-8ceb-b6ca4d02765d admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:32.241795 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0800-a0a0-473c-8ceb-b6ca4d02765d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:32.242066 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0800-a0a0-473c-8ceb-b6ca4d02765d admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:32.242765 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb0800-a0a0-473c-8ceb-b6ca4d02765d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:32.244756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb0800-a0a0-473c-8ceb-b6ca4d02765d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:32.336366 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1270/2539] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:09:32 2022] POST /identity/v3/users => generated 303 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:09:32.341379 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99703553-cb27-4b46-b7a3-1a92065d6aaa admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:32.358300 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99703553-cb27-4b46-b7a3-1a92065d6aaa admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:32.366344 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a915a-75fa-47d6-a24e-c51e8d43e538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:32.368150 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a915a-75fa-47d6-a24e-c51e8d43e538 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:32.368702 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a915a-75fa-47d6-a24e-c51e8d43e538 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:32.370046 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a915a-75fa-47d6-a24e-c51e8d43e538 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:32.371143 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a915a-75fa-47d6-a24e-c51e8d43e538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:32.372789 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a915a-75fa-47d6-a24e-c51e8d43e538 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:32.383572 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1270/2540] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:09:32.388919 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb0800-a0a0-473c-8ceb-b6ca4d02765d admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:32.399255 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb0800-a0a0-473c-8ceb-b6ca4d02765d admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:32.404958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e837b98-e5c2-4bd5-81ec-a78e38e3b810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:32.405851 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e837b98-e5c2-4bd5-81ec-a78e38e3b810 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:32.406155 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e837b98-e5c2-4bd5-81ec-a78e38e3b810 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:32.406450 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e837b98-e5c2-4bd5-81ec-a78e38e3b810 admin admin] PATH_INFO: `/v3/projects/6747d62137c94974bce0d8bff3c4a671/users/1047c3231c05461888e32ff8d253aa22/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:32.422120 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e837b98-e5c2-4bd5-81ec-a78e38e3b810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6747d62137c94974bce0d8bff3c4a671, user_id=1047c3231c05461888e32ff8d253aa22, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:32.424807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e837b98-e5c2-4bd5-81ec-a78e38e3b810 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:32.547088 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1271/2541] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:09:32 2022] PUT /identity/v3/projects/6747d62137c94974bce0d8bff3c4a671/users/1047c3231c05461888e32ff8d253aa22/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:09:32.551135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a915a-75fa-47d6-a24e-c51e8d43e538 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:32.562429 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a915a-75fa-47d6-a24e-c51e8d43e538 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:32.628227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f5c08-b3f6-40a1-90c1-e3a6a42bceb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:32.628927 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f5c08-b3f6-40a1-90c1-e3a6a42bceb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:32.629207 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f5c08-b3f6-40a1-90c1-e3a6a42bceb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:32.629472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f5c08-b3f6-40a1-90c1-e3a6a42bceb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:32.630199 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f5c08-b3f6-40a1-90c1-e3a6a42bceb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:32.631811 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f5c08-b3f6-40a1-90c1-e3a6a42bceb9 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:32.642616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1271/2542] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:09:32.647116 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e837b98-e5c2-4bd5-81ec-a78e38e3b810 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:32.660348 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e837b98-e5c2-4bd5-81ec-a78e38e3b810 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:32.667114 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b46a03-ba27-4c8b-8791-bd87c2e90daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:32.667761 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b46a03-ba27-4c8b-8791-bd87c2e90daa admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:32.668047 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b46a03-ba27-4c8b-8791-bd87c2e90daa admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:32.668325 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b46a03-ba27-4c8b-8791-bd87c2e90daa admin admin] PATH_INFO: `/v3/projects/6747d62137c94974bce0d8bff3c4a671/users/1047c3231c05461888e32ff8d253aa22/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:32.670479 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b46a03-ba27-4c8b-8791-bd87c2e90daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6747d62137c94974bce0d8bff3c4a671, user_id=1047c3231c05461888e32ff8d253aa22, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:32.673363 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b46a03-ba27-4c8b-8791-bd87c2e90daa admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:32.688036 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1272/2543] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:09:32 2022] PUT /identity/v3/projects/6747d62137c94974bce0d8bff3c4a671/users/1047c3231c05461888e32ff8d253aa22/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:32.699662 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20d116-4a2a-4bd8-91af-e52db63de8a8 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:32.699948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20d116-4a2a-4bd8-91af-e52db63de8a8 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:32.700222 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20d116-4a2a-4bd8-91af-e52db63de8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:32.729790 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-6f20d116-4a2a-4bd8-91af-e52db63de8a8 None None] MFA Rules not processed for user `1047c3231c05461888e32ff8d253aa22`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:09:32.731007 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-6f20d116-4a2a-4bd8-91af-e52db63de8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:32.816981 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1272/2544] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:09:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:09:32.829692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b46a03-ba27-4c8b-8791-bd87c2e90daa admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:32.833620 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-05b46a03-ba27-4c8b-8791-bd87c2e90daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:32.914523 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b46a03-ba27-4c8b-8791-bd87c2e90daa admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:32.920101 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36606622-ebb9-4197-8613-266dd3662b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:32.920792 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36606622-ebb9-4197-8613-266dd3662b56 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:32.921086 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36606622-ebb9-4197-8613-266dd3662b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:32.921384 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36606622-ebb9-4197-8613-266dd3662b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:32.931881 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36606622-ebb9-4197-8613-266dd3662b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:32.932949 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36606622-ebb9-4197-8613-266dd3662b56 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:32.942926 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1273/2545] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:09:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:09:32.992996 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20d116-4a2a-4bd8-91af-e52db63de8a8 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:32.995001 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-6f20d116-4a2a-4bd8-91af-e52db63de8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:33.008285 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20d116-4a2a-4bd8-91af-e52db63de8a8 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:33.012478 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfebbb4-b957-4f46-9eb2-3bd9aba6b602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:33.014899 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfebbb4-b957-4f46-9eb2-3bd9aba6b602 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:33.014899 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfebbb4-b957-4f46-9eb2-3bd9aba6b602 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:33.014899 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfebbb4-b957-4f46-9eb2-3bd9aba6b602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:33.076020 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfebbb4-b957-4f46-9eb2-3bd9aba6b602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:33.077589 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfebbb4-b957-4f46-9eb2-3bd9aba6b602 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:33.089983 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1273/2546] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:09:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:09:39.302233 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36606622-ebb9-4197-8613-266dd3662b56 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:39.371294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36606622-ebb9-4197-8613-266dd3662b56 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:39.377559 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7a803-e6cf-43f1-a284-54fcbaf305e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:39.378833 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7a803-e6cf-43f1-a284-54fcbaf305e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:39.379121 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7a803-e6cf-43f1-a284-54fcbaf305e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:39.379478 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7a803-e6cf-43f1-a284-54fcbaf305e3 admin admin] PATH_INFO: `/v3/users/ba05f0ec34f34ca19a9639cb384c930f` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:39.381096 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7a803-e6cf-43f1-a284-54fcbaf305e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba05f0ec34f34ca19a9639cb384c930f)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:39.383759 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7a803-e6cf-43f1-a284-54fcbaf305e3 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:39.654181 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-95c7a803-e6cf-43f1-a284-54fcbaf305e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba05f0ec34f34ca19a9639cb384c930f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:39.655021 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-95c7a803-e6cf-43f1-a284-54fcbaf305e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba05f0ec34f34ca19a9639cb384c930f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:39.669633 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-95c7a803-e6cf-43f1-a284-54fcbaf305e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba05f0ec34f34ca19a9639cb384c930f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:39.677020 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-95c7a803-e6cf-43f1-a284-54fcbaf305e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba05f0ec34f34ca19a9639cb384c930f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:39.677788 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-95c7a803-e6cf-43f1-a284-54fcbaf305e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba05f0ec34f34ca19a9639cb384c930f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:39.813145 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1274/2547] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:09:39 2022] DELETE /identity/v3/users/ba05f0ec34f34ca19a9639cb384c930f => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:09:39.818016 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693da3-966f-4572-9823-ef329ed5162e None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:39.818698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693da3-966f-4572-9823-ef329ed5162e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:39.818698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693da3-966f-4572-9823-ef329ed5162e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:39.838181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-73693da3-966f-4572-9823-ef329ed5162e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:09:39.839454 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-73693da3-966f-4572-9823-ef329ed5162e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:39.919177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1274/2548] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:09:39.929371 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7a803-e6cf-43f1-a284-54fcbaf305e3 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:39.935930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-95c7a803-e6cf-43f1-a284-54fcbaf305e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:40.001527 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7a803-e6cf-43f1-a284-54fcbaf305e3 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:40.007122 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4b0e8-d7fb-41ab-9ce8-6c9d48a0c7bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:40.007802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4b0e8-d7fb-41ab-9ce8-6c9d48a0c7bb service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:40.008058 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4b0e8-d7fb-41ab-9ce8-6c9d48a0c7bb service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:40.008341 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4b0e8-d7fb-41ab-9ce8-6c9d48a0c7bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:40.018797 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4b0e8-d7fb-41ab-9ce8-6c9d48a0c7bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:40.020229 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4b0e8-d7fb-41ab-9ce8-6c9d48a0c7bb service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:40.032884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1275/2549] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:09:40.543212 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73693da3-966f-4572-9823-ef329ed5162e None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:40.544720 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-73693da3-966f-4572-9823-ef329ed5162e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:40.560920 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73693da3-966f-4572-9823-ef329ed5162e None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:40.563918 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c39c64-a186-4d65-81df-704c11d94d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:40.564810 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c39c64-a186-4d65-81df-704c11d94d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:40.565088 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c39c64-a186-4d65-81df-704c11d94d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:40.565362 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c39c64-a186-4d65-81df-704c11d94d6b admin admin] PATH_INFO: `/v3/projects/adf8c003bbc648159a840f5e34010a13` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:40.566563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c39c64-a186-4d65-81df-704c11d94d6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf8c003bbc648159a840f5e34010a13)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:40.568511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c39c64-a186-4d65-81df-704c11d94d6b admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:40.685527 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f0c39c64-a186-4d65-81df-704c11d94d6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf8c003bbc648159a840f5e34010a13', 'request_id': 'req-f0c39c64-a186-4d65-81df-704c11d94d6b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:40.895215 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f0c39c64-a186-4d65-81df-704c11d94d6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf8c003bbc648159a840f5e34010a13', 'request_id': 'req-f0c39c64-a186-4d65-81df-704c11d94d6b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:40.902890 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f0c39c64-a186-4d65-81df-704c11d94d6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf8c003bbc648159a840f5e34010a13', 'request_id': 'req-f0c39c64-a186-4d65-81df-704c11d94d6b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:40.920771 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f0c39c64-a186-4d65-81df-704c11d94d6b admin admin] The token cache is being invalidate because project adf8c003bbc648159a840f5e34010a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:09:40.921262 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f0c39c64-a186-4d65-81df-704c11d94d6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:40.922282 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-f0c39c64-a186-4d65-81df-704c11d94d6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:40.925027 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1275/2550] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:09:40 2022] DELETE /identity/v3/projects/adf8c003bbc648159a840f5e34010a13 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:40.931813 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4b0e8-d7fb-41ab-9ce8-6c9d48a0c7bb service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:40.941991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4b0e8-d7fb-41ab-9ce8-6c9d48a0c7bb service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:41.005858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607b407-4c88-4d01-9240-cc18eb948168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:41.006730 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607b407-4c88-4d01-9240-cc18eb948168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:41.007010 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607b407-4c88-4d01-9240-cc18eb948168 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:41.007286 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607b407-4c88-4d01-9240-cc18eb948168 admin admin] PATH_INFO: `/v3/users/1047c3231c05461888e32ff8d253aa22` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:41.008475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607b407-4c88-4d01-9240-cc18eb948168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1047c3231c05461888e32ff8d253aa22)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:41.011107 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607b407-4c88-4d01-9240-cc18eb948168 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:41.402452 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-8607b407-4c88-4d01-9240-cc18eb948168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1047c3231c05461888e32ff8d253aa22'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:41.403149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-8607b407-4c88-4d01-9240-cc18eb948168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1047c3231c05461888e32ff8d253aa22'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:41.416085 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-8607b407-4c88-4d01-9240-cc18eb948168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1047c3231c05461888e32ff8d253aa22'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:41.423152 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-8607b407-4c88-4d01-9240-cc18eb948168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1047c3231c05461888e32ff8d253aa22'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:41.435086 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-8607b407-4c88-4d01-9240-cc18eb948168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1047c3231c05461888e32ff8d253aa22'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:41.554925 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1276/2551] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:09:40 2022] DELETE /identity/v3/users/1047c3231c05461888e32ff8d253aa22 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:42.059143 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c39c64-a186-4d65-81df-704c11d94d6b admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:42.061090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f0c39c64-a186-4d65-81df-704c11d94d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:42.079920 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c39c64-a186-4d65-81df-704c11d94d6b admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:42.148450 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866701a-11b2-4241-bff7-76ebee67e1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:42.152852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866701a-11b2-4241-bff7-76ebee67e1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:42.152852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866701a-11b2-4241-bff7-76ebee67e1da admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:42.152852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866701a-11b2-4241-bff7-76ebee67e1da admin admin] PATH_INFO: `/v3/projects/6747d62137c94974bce0d8bff3c4a671` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:42.152852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866701a-11b2-4241-bff7-76ebee67e1da admin admin] RBAC: Authorizing `identity:delete_project(project_id=6747d62137c94974bce0d8bff3c4a671)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:42.153820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866701a-11b2-4241-bff7-76ebee67e1da admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:42.266509 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c866701a-11b2-4241-bff7-76ebee67e1da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6747d62137c94974bce0d8bff3c4a671', 'request_id': 'req-c866701a-11b2-4241-bff7-76ebee67e1da'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:42.346805 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c866701a-11b2-4241-bff7-76ebee67e1da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6747d62137c94974bce0d8bff3c4a671', 'request_id': 'req-c866701a-11b2-4241-bff7-76ebee67e1da'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:42.354160 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c866701a-11b2-4241-bff7-76ebee67e1da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6747d62137c94974bce0d8bff3c4a671', 'request_id': 'req-c866701a-11b2-4241-bff7-76ebee67e1da'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:42.365654 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c866701a-11b2-4241-bff7-76ebee67e1da admin admin] The token cache is being invalidate because project 6747d62137c94974bce0d8bff3c4a671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:09:42.365947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c866701a-11b2-4241-bff7-76ebee67e1da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:42.366630 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-c866701a-11b2-4241-bff7-76ebee67e1da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:42.368211 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1276/2552] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:09:42 2022] DELETE /identity/v3/projects/6747d62137c94974bce0d8bff3c4a671 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:42.373194 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4abafb-e38e-4194-b1a5-61fbd856d423 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:42.373683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4abafb-e38e-4194-b1a5-61fbd856d423 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:42.373859 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4abafb-e38e-4194-b1a5-61fbd856d423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:42.392306 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-4d4abafb-e38e-4194-b1a5-61fbd856d423 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:09:42.393553 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-4d4abafb-e38e-4194-b1a5-61fbd856d423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:42.452915 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1277/2553] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:09:42.460327 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aa475-4deb-4f99-8957-4df73dfb134a None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:42.460636 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aa475-4deb-4f99-8957-4df73dfb134a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:42.460913 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aa475-4deb-4f99-8957-4df73dfb134a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:42.480605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-752aa475-4deb-4f99-8957-4df73dfb134a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:09:42.481818 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-752aa475-4deb-4f99-8957-4df73dfb134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:42.490162 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1277/2554] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:09:42.495192 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4abafb-e38e-4194-b1a5-61fbd856d423 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:42.505156 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4abafb-e38e-4194-b1a5-61fbd856d423 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:42.510494 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ac2e9-9e5d-4d9f-95b6-5c3ed7b9833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:42.511149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac2e9-9e5d-4d9f-95b6-5c3ed7b9833e admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:42.511428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac2e9-9e5d-4d9f-95b6-5c3ed7b9833e admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:42.511702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac2e9-9e5d-4d9f-95b6-5c3ed7b9833e admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:42.512430 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ac2e9-9e5d-4d9f-95b6-5c3ed7b9833e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:09:42.512870 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ac2e9-9e5d-4d9f-95b6-5c3ed7b9833e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:42.514559 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ac2e9-9e5d-4d9f-95b6-5c3ed7b9833e admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:42.527325 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1278/2555] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:09:42.531747 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752aa475-4deb-4f99-8957-4df73dfb134a None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:42.541464 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752aa475-4deb-4f99-8957-4df73dfb134a None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:42.546261 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860134c-2005-4ef4-a628-a95dd951b339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:42.546955 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860134c-2005-4ef4-a628-a95dd951b339 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:42.547208 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860134c-2005-4ef4-a628-a95dd951b339 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:42.547485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860134c-2005-4ef4-a628-a95dd951b339 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:42.548190 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860134c-2005-4ef4-a628-a95dd951b339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:42.550129 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860134c-2005-4ef4-a628-a95dd951b339 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:42.640735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1278/2556] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:09:42 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:09:42.644788 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ac2e9-9e5d-4d9f-95b6-5c3ed7b9833e admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:42.655140 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ac2e9-9e5d-4d9f-95b6-5c3ed7b9833e admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:42.714236 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbabefe-2b1a-4ded-a5a2-63e9fe7f3013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:42.714910 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbabefe-2b1a-4ded-a5a2-63e9fe7f3013 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:42.715191 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbabefe-2b1a-4ded-a5a2-63e9fe7f3013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:42.715490 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbabefe-2b1a-4ded-a5a2-63e9fe7f3013 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:42.716159 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbabefe-2b1a-4ded-a5a2-63e9fe7f3013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:42.718104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbabefe-2b1a-4ded-a5a2-63e9fe7f3013 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:42.847787 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1279/2557] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:09:42 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:09:42.851877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860134c-2005-4ef4-a628-a95dd951b339 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:42.863248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860134c-2005-4ef4-a628-a95dd951b339 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:42.869168 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138b941-0bb6-4bdd-8471-fb6ae0001a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:42.869836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138b941-0bb6-4bdd-8471-fb6ae0001a26 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:42.870117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138b941-0bb6-4bdd-8471-fb6ae0001a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:42.870460 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138b941-0bb6-4bdd-8471-fb6ae0001a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:42.871196 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138b941-0bb6-4bdd-8471-fb6ae0001a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:42.872860 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138b941-0bb6-4bdd-8471-fb6ae0001a26 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:42.883578 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1279/2558] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:09:42.887672 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbabefe-2b1a-4ded-a5a2-63e9fe7f3013 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:42.898305 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbabefe-2b1a-4ded-a5a2-63e9fe7f3013 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:42.903352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33464053-6adf-47f5-b4e4-818fe36f9d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:42.904011 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33464053-6adf-47f5-b4e4-818fe36f9d46 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:42.904286 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33464053-6adf-47f5-b4e4-818fe36f9d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:42.904555 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33464053-6adf-47f5-b4e4-818fe36f9d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:42.905318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33464053-6adf-47f5-b4e4-818fe36f9d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:42.906905 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33464053-6adf-47f5-b4e4-818fe36f9d46 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:42.918449 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1280/2559] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 22:09:42.922714 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138b941-0bb6-4bdd-8471-fb6ae0001a26 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:42.933507 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138b941-0bb6-4bdd-8471-fb6ae0001a26 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:42.938100 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02be97-ff93-44e2-bb03-67306fc903c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:42.938971 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02be97-ff93-44e2-bb03-67306fc903c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:42.939248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02be97-ff93-44e2-bb03-67306fc903c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:42.939518 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02be97-ff93-44e2-bb03-67306fc903c6 admin admin] PATH_INFO: `/v3/projects/87b263cc40a7415ba67fc18db236e95f/users/49c39a2708064d769faf5a57359469a9/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:42.954617 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02be97-ff93-44e2-bb03-67306fc903c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b263cc40a7415ba67fc18db236e95f, user_id=49c39a2708064d769faf5a57359469a9, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:42.958027 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02be97-ff93-44e2-bb03-67306fc903c6 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:43.090509 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1280/2560] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:09:42 2022] PUT /identity/v3/projects/87b263cc40a7415ba67fc18db236e95f/users/49c39a2708064d769faf5a57359469a9/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:43.101192 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32284756-b9d2-40e5-ac0f-6091b4a6e6bb None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:43.101619 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32284756-b9d2-40e5-ac0f-6091b4a6e6bb None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:43.102041 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32284756-b9d2-40e5-ac0f-6091b4a6e6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:43.131975 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-32284756-b9d2-40e5-ac0f-6091b4a6e6bb None None] MFA Rules not processed for user `49c39a2708064d769faf5a57359469a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:09:43.133246 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-32284756-b9d2-40e5-ac0f-6091b4a6e6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:43.200962 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1281/2561] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:09:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:09:43.205881 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02be97-ff93-44e2-bb03-67306fc903c6 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:43.270121 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02be97-ff93-44e2-bb03-67306fc903c6 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:43.275956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04313fe9-ed02-4ecf-9aca-180a0bd82d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:43.276663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04313fe9-ed02-4ecf-9aca-180a0bd82d58 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:43.276946 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04313fe9-ed02-4ecf-9aca-180a0bd82d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:43.277219 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04313fe9-ed02-4ecf-9aca-180a0bd82d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:43.277924 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04313fe9-ed02-4ecf-9aca-180a0bd82d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:43.279824 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04313fe9-ed02-4ecf-9aca-180a0bd82d58 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:43.385070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1281/2562] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:09:43 2022] POST /identity/v3/projects => generated 389 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:09:43.389328 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32284756-b9d2-40e5-ac0f-6091b4a6e6bb None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:43.400573 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32284756-b9d2-40e5-ac0f-6091b4a6e6bb None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:43.459939 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2e995-8f77-4fe8-8916-2508576c8fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:43.460549 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2e995-8f77-4fe8-8916-2508576c8fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:43.460871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2e995-8f77-4fe8-8916-2508576c8fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:43.461149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2e995-8f77-4fe8-8916-2508576c8fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:43.462376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2e995-8f77-4fe8-8916-2508576c8fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:43.464648 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2e995-8f77-4fe8-8916-2508576c8fe7 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:43.593240 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1282/2563] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:09:43 2022] POST /identity/v3/users => generated 301 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:09:43.597701 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04313fe9-ed02-4ecf-9aca-180a0bd82d58 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:43.608870 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04313fe9-ed02-4ecf-9aca-180a0bd82d58 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:43.613723 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15fbe3-ab94-4612-b2c1-0262338fb6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:43.614383 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15fbe3-ab94-4612-b2c1-0262338fb6ee admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:43.614666 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15fbe3-ab94-4612-b2c1-0262338fb6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:43.614940 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15fbe3-ab94-4612-b2c1-0262338fb6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:43.615730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15fbe3-ab94-4612-b2c1-0262338fb6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:43.617394 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15fbe3-ab94-4612-b2c1-0262338fb6ee admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:43.628693 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1282/2564] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 22:09:43.632913 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2e995-8f77-4fe8-8916-2508576c8fe7 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:43.643814 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2e995-8f77-4fe8-8916-2508576c8fe7 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:43.648512 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2209284-9016-491a-a6dc-ab5757d78ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:43.649427 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2209284-9016-491a-a6dc-ab5757d78ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:43.650309 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2209284-9016-491a-a6dc-ab5757d78ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:43.650606 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2209284-9016-491a-a6dc-ab5757d78ee7 admin admin] PATH_INFO: `/v3/projects/dc3d003fadf8478fb9578e0b9e9c032f/users/7789f904cf1c4845b07b8869dcaa64fc/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:43.670075 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2209284-9016-491a-a6dc-ab5757d78ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3d003fadf8478fb9578e0b9e9c032f, user_id=7789f904cf1c4845b07b8869dcaa64fc, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:43.672748 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2209284-9016-491a-a6dc-ab5757d78ee7 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:43.764946 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1283/2565] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:09:43 2022] PUT /identity/v3/projects/dc3d003fadf8478fb9578e0b9e9c032f/users/7789f904cf1c4845b07b8869dcaa64fc/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:43.771078 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15fbe3-ab94-4612-b2c1-0262338fb6ee admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:43.786250 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15fbe3-ab94-4612-b2c1-0262338fb6ee admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:43.842785 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb41ec-2d79-41af-92eb-083d891f2b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:43.843450 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb41ec-2d79-41af-92eb-083d891f2b46 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:43.843723 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb41ec-2d79-41af-92eb-083d891f2b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:43.844000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb41ec-2d79-41af-92eb-083d891f2b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:43.844754 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb41ec-2d79-41af-92eb-083d891f2b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:43.846623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb41ec-2d79-41af-92eb-083d891f2b46 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:43.857477 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1283/2566] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:09:43.861637 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2209284-9016-491a-a6dc-ab5757d78ee7 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:43.872245 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2209284-9016-491a-a6dc-ab5757d78ee7 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:43.876987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829013aa-7518-4410-aef6-af22c1d11b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:43.877865 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829013aa-7518-4410-aef6-af22c1d11b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:43.878144 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829013aa-7518-4410-aef6-af22c1d11b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:43.878411 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829013aa-7518-4410-aef6-af22c1d11b86 admin admin] PATH_INFO: `/v3/projects/dc3d003fadf8478fb9578e0b9e9c032f/users/7789f904cf1c4845b07b8869dcaa64fc/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:43.880404 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829013aa-7518-4410-aef6-af22c1d11b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3d003fadf8478fb9578e0b9e9c032f, user_id=7789f904cf1c4845b07b8869dcaa64fc, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:43.883062 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829013aa-7518-4410-aef6-af22c1d11b86 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:43.894892 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1284/2567] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:09:43 2022] PUT /identity/v3/projects/dc3d003fadf8478fb9578e0b9e9c032f/users/7789f904cf1c4845b07b8869dcaa64fc/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:43.907170 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce6da3-522c-4040-b37d-31b9dc650f81 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:43.907705 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce6da3-522c-4040-b37d-31b9dc650f81 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:43.907979 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce6da3-522c-4040-b37d-31b9dc650f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:43.935619 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-e2ce6da3-522c-4040-b37d-31b9dc650f81 None None] MFA Rules not processed for user `7789f904cf1c4845b07b8869dcaa64fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:09:43.936868 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e2ce6da3-522c-4040-b37d-31b9dc650f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:44.012377 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1284/2568] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:09:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:09:44.023258 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829013aa-7518-4410-aef6-af22c1d11b86 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:44.025504 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-829013aa-7518-4410-aef6-af22c1d11b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:44.083108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829013aa-7518-4410-aef6-af22c1d11b86 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:44.086768 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facb953-51ad-434b-86f1-cc4cb6133fce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:44.087731 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facb953-51ad-434b-86f1-cc4cb6133fce service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:44.088011 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facb953-51ad-434b-86f1-cc4cb6133fce service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:44.088284 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facb953-51ad-434b-86f1-cc4cb6133fce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:44.097617 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facb953-51ad-434b-86f1-cc4cb6133fce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:44.099036 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facb953-51ad-434b-86f1-cc4cb6133fce service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:44.109450 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1285/2569] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:09:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:09:44.242887 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce6da3-522c-4040-b37d-31b9dc650f81 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:44.309540 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce6da3-522c-4040-b37d-31b9dc650f81 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:44.314381 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ac7ec-b87d-4c90-9ff0-e222db5507c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:44.315258 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ac7ec-b87d-4c90-9ff0-e222db5507c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:44.315537 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ac7ec-b87d-4c90-9ff0-e222db5507c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:44.315866 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ac7ec-b87d-4c90-9ff0-e222db5507c6 admin admin] PATH_INFO: `/v3/users/49c39a2708064d769faf5a57359469a9` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:44.317039 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ac7ec-b87d-4c90-9ff0-e222db5507c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49c39a2708064d769faf5a57359469a9)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:44.318986 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ac7ec-b87d-4c90-9ff0-e222db5507c6 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:44.574386 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-6d9ac7ec-b87d-4c90-9ff0-e222db5507c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49c39a2708064d769faf5a57359469a9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:44.575008 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-6d9ac7ec-b87d-4c90-9ff0-e222db5507c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49c39a2708064d769faf5a57359469a9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:44.587827 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-6d9ac7ec-b87d-4c90-9ff0-e222db5507c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49c39a2708064d769faf5a57359469a9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:44.596778 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-6d9ac7ec-b87d-4c90-9ff0-e222db5507c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49c39a2708064d769faf5a57359469a9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:44.597518 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-6d9ac7ec-b87d-4c90-9ff0-e222db5507c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49c39a2708064d769faf5a57359469a9'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:44.715360 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1285/2570] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:09:44 2022] DELETE /identity/v3/users/49c39a2708064d769faf5a57359469a9 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:44.720468 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8a881-bd61-493f-8351-96f272f7eb3f None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:44.721278 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8a881-bd61-493f-8351-96f272f7eb3f None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:44.721278 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8a881-bd61-493f-8351-96f272f7eb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:44.740647 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-f4e8a881-bd61-493f-8351-96f272f7eb3f None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:09:44.741866 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f4e8a881-bd61-493f-8351-96f272f7eb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:44.800640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1286/2571] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:09:44.811496 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ac7ec-b87d-4c90-9ff0-e222db5507c6 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:44.813125 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-6d9ac7ec-b87d-4c90-9ff0-e222db5507c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:44.873151 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ac7ec-b87d-4c90-9ff0-e222db5507c6 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:44.877229 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebe08d-b294-4a14-ae5e-392fe45e02cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:44.877882 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebe08d-b294-4a14-ae5e-392fe45e02cf service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:44.878164 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebe08d-b294-4a14-ae5e-392fe45e02cf service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:44.878449 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebe08d-b294-4a14-ae5e-392fe45e02cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:44.888156 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebe08d-b294-4a14-ae5e-392fe45e02cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:44.889631 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebe08d-b294-4a14-ae5e-392fe45e02cf service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:44.900368 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1286/2572] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:09:45.408005 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8a881-bd61-493f-8351-96f272f7eb3f None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:45.413941 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f4e8a881-bd61-493f-8351-96f272f7eb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:45.425293 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8a881-bd61-493f-8351-96f272f7eb3f None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:45.431290 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367aecc-320a-4130-ab5b-4b59e4d18a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:45.432162 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367aecc-320a-4130-ab5b-4b59e4d18a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:45.432444 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367aecc-320a-4130-ab5b-4b59e4d18a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:45.432753 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367aecc-320a-4130-ab5b-4b59e4d18a56 admin admin] PATH_INFO: `/v3/projects/87b263cc40a7415ba67fc18db236e95f` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:45.433958 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367aecc-320a-4130-ab5b-4b59e4d18a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b263cc40a7415ba67fc18db236e95f)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:45.435910 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367aecc-320a-4130-ab5b-4b59e4d18a56 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:45.570604 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7367aecc-320a-4130-ab5b-4b59e4d18a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b263cc40a7415ba67fc18db236e95f', 'request_id': 'req-7367aecc-320a-4130-ab5b-4b59e4d18a56'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:45.717931 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7367aecc-320a-4130-ab5b-4b59e4d18a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b263cc40a7415ba67fc18db236e95f', 'request_id': 'req-7367aecc-320a-4130-ab5b-4b59e4d18a56'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:45.725207 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7367aecc-320a-4130-ab5b-4b59e4d18a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b263cc40a7415ba67fc18db236e95f', 'request_id': 'req-7367aecc-320a-4130-ab5b-4b59e4d18a56'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:45.735746 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7367aecc-320a-4130-ab5b-4b59e4d18a56 admin admin] The token cache is being invalidate because project 87b263cc40a7415ba67fc18db236e95f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:09:45.736024 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7367aecc-320a-4130-ab5b-4b59e4d18a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:45.736698 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7367aecc-320a-4130-ab5b-4b59e4d18a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:45.738280 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1287/2573] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:09:45 2022] DELETE /identity/v3/projects/87b263cc40a7415ba67fc18db236e95f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:45.742250 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebe08d-b294-4a14-ae5e-392fe45e02cf service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:45.752415 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebe08d-b294-4a14-ae5e-392fe45e02cf service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:45.813574 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90d5fb-a80d-472d-bf3c-f02c528271a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:45.814434 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90d5fb-a80d-472d-bf3c-f02c528271a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:45.814711 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90d5fb-a80d-472d-bf3c-f02c528271a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:45.814983 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90d5fb-a80d-472d-bf3c-f02c528271a8 admin admin] PATH_INFO: `/v3/users/7789f904cf1c4845b07b8869dcaa64fc` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:45.816153 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90d5fb-a80d-472d-bf3c-f02c528271a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7789f904cf1c4845b07b8869dcaa64fc)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:45.818092 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90d5fb-a80d-472d-bf3c-f02c528271a8 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:46.133735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3d90d5fb-a80d-472d-bf3c-f02c528271a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7789f904cf1c4845b07b8869dcaa64fc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:46.134465 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3d90d5fb-a80d-472d-bf3c-f02c528271a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7789f904cf1c4845b07b8869dcaa64fc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:46.147902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3d90d5fb-a80d-472d-bf3c-f02c528271a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7789f904cf1c4845b07b8869dcaa64fc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:46.157135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3d90d5fb-a80d-472d-bf3c-f02c528271a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7789f904cf1c4845b07b8869dcaa64fc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:46.157866 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3d90d5fb-a80d-472d-bf3c-f02c528271a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7789f904cf1c4845b07b8869dcaa64fc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:46.251483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1287/2574] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:09:45 2022] DELETE /identity/v3/users/7789f904cf1c4845b07b8869dcaa64fc => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:46.722219 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367aecc-320a-4130-ab5b-4b59e4d18a56 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:46.723847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-7367aecc-320a-4130-ab5b-4b59e4d18a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:46.741617 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367aecc-320a-4130-ab5b-4b59e4d18a56 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:46.801687 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0153c7-218f-4019-ab91-c58eed3596b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:46.802544 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0153c7-218f-4019-ab91-c58eed3596b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:46.802821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0153c7-218f-4019-ab91-c58eed3596b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:46.803094 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0153c7-218f-4019-ab91-c58eed3596b9 admin admin] PATH_INFO: `/v3/projects/dc3d003fadf8478fb9578e0b9e9c032f` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:46.804316 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0153c7-218f-4019-ab91-c58eed3596b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc3d003fadf8478fb9578e0b9e9c032f)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:46.806722 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0153c7-218f-4019-ab91-c58eed3596b9 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:46.957318 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3b0153c7-218f-4019-ab91-c58eed3596b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc3d003fadf8478fb9578e0b9e9c032f', 'request_id': 'req-3b0153c7-218f-4019-ab91-c58eed3596b9'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:47.100532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3b0153c7-218f-4019-ab91-c58eed3596b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc3d003fadf8478fb9578e0b9e9c032f', 'request_id': 'req-3b0153c7-218f-4019-ab91-c58eed3596b9'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:47.107655 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3b0153c7-218f-4019-ab91-c58eed3596b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc3d003fadf8478fb9578e0b9e9c032f', 'request_id': 'req-3b0153c7-218f-4019-ab91-c58eed3596b9'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:47.117697 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3b0153c7-218f-4019-ab91-c58eed3596b9 admin admin] The token cache is being invalidate because project dc3d003fadf8478fb9578e0b9e9c032f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:09:47.118584 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3b0153c7-218f-4019-ab91-c58eed3596b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:47.119380 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-3b0153c7-218f-4019-ab91-c58eed3596b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:09:47.120896 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1288/2575] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:09:46 2022] DELETE /identity/v3/projects/dc3d003fadf8478fb9578e0b9e9c032f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:47.125926 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b0f41-c679-4bc2-8d39-a8b308875282 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:47.126403 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b0f41-c679-4bc2-8d39-a8b308875282 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:47.126522 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b0f41-c679-4bc2-8d39-a8b308875282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:47.145471 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-6b9b0f41-c679-4bc2-8d39-a8b308875282 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:09:47.146668 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-6b9b0f41-c679-4bc2-8d39-a8b308875282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:47.205696 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1288/2576] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:09:47.214004 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1cf23-0d22-4e00-9be0-1c05bd601311 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:47.214283 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1cf23-0d22-4e00-9be0-1c05bd601311 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:47.214557 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1cf23-0d22-4e00-9be0-1c05bd601311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:47.233534 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-b1f1cf23-0d22-4e00-9be0-1c05bd601311 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:09:47.234755 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b1f1cf23-0d22-4e00-9be0-1c05bd601311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:47.242830 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1289/2577] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:09:47.247829 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b0f41-c679-4bc2-8d39-a8b308875282 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:47.257521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b0f41-c679-4bc2-8d39-a8b308875282 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:47.262930 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3afe1-2ab1-4d20-9a13-71985eea3b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:47.263587 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3afe1-2ab1-4d20-9a13-71985eea3b2c admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:47.263869 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3afe1-2ab1-4d20-9a13-71985eea3b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:47.264178 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3afe1-2ab1-4d20-9a13-71985eea3b2c admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:47.264943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3afe1-2ab1-4d20-9a13-71985eea3b2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:09:47.265254 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3afe1-2ab1-4d20-9a13-71985eea3b2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:47.266865 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3afe1-2ab1-4d20-9a13-71985eea3b2c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:47.278367 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1289/2578] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:09:47.282770 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1cf23-0d22-4e00-9be0-1c05bd601311 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:47.297511 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1cf23-0d22-4e00-9be0-1c05bd601311 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:47.302120 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952d830-bf76-4d5c-be76-cbedc7194817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:47.302773 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952d830-bf76-4d5c-be76-cbedc7194817 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:47.303050 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952d830-bf76-4d5c-be76-cbedc7194817 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:47.303783 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952d830-bf76-4d5c-be76-cbedc7194817 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:47.304487 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952d830-bf76-4d5c-be76-cbedc7194817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:47.306923 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952d830-bf76-4d5c-be76-cbedc7194817 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:47.453076 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1290/2579] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:09:47 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:09:47.457269 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3afe1-2ab1-4d20-9a13-71985eea3b2c admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:47.467938 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3afe1-2ab1-4d20-9a13-71985eea3b2c admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:47.524148 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72291b-b7ea-43d8-b305-510b4263409e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:47.524893 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72291b-b7ea-43d8-b305-510b4263409e admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:47.525177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72291b-b7ea-43d8-b305-510b4263409e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:47.525452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72291b-b7ea-43d8-b305-510b4263409e admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:47.526164 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72291b-b7ea-43d8-b305-510b4263409e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:47.528101 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72291b-b7ea-43d8-b305-510b4263409e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:47.635384 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1290/2580] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:09:47 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:09:47.639524 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952d830-bf76-4d5c-be76-cbedc7194817 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:47.650664 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952d830-bf76-4d5c-be76-cbedc7194817 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:47.655270 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e8366-a8dc-4032-b9a9-62aa6955b7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:47.655941 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e8366-a8dc-4032-b9a9-62aa6955b7cd admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:47.656211 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e8366-a8dc-4032-b9a9-62aa6955b7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:47.656833 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e8366-a8dc-4032-b9a9-62aa6955b7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:47.662064 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e8366-a8dc-4032-b9a9-62aa6955b7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:47.662064 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e8366-a8dc-4032-b9a9-62aa6955b7cd admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:47.673264 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1291/2581] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:09:47.677420 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72291b-b7ea-43d8-b305-510b4263409e admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:47.688399 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72291b-b7ea-43d8-b305-510b4263409e admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:47.693079 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a637fd-c2f8-453b-9a7a-324eb587986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:47.693741 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a637fd-c2f8-453b-9a7a-324eb587986c admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:47.694023 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a637fd-c2f8-453b-9a7a-324eb587986c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:47.694299 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a637fd-c2f8-453b-9a7a-324eb587986c admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:47.695025 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a637fd-c2f8-453b-9a7a-324eb587986c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:47.696677 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a637fd-c2f8-453b-9a7a-324eb587986c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:47.707006 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1291/2582] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:09:47.711089 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e8366-a8dc-4032-b9a9-62aa6955b7cd admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:47.722478 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e8366-a8dc-4032-b9a9-62aa6955b7cd admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:47.727260 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41372cf-2aa0-489b-a049-211b40c481a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:47.728796 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41372cf-2aa0-489b-a049-211b40c481a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:47.729078 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41372cf-2aa0-489b-a049-211b40c481a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:47.729352 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41372cf-2aa0-489b-a049-211b40c481a5 admin admin] PATH_INFO: `/v3/projects/0ce84948867648b4acf0deaed698b9c2/users/4c500b85c820458fbc0bf4195558f39b/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:47.744010 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41372cf-2aa0-489b-a049-211b40c481a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce84948867648b4acf0deaed698b9c2, user_id=4c500b85c820458fbc0bf4195558f39b, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:47.746725 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41372cf-2aa0-489b-a049-211b40c481a5 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:47.834250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1292/2583] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:09:47 2022] PUT /identity/v3/projects/0ce84948867648b4acf0deaed698b9c2/users/4c500b85c820458fbc0bf4195558f39b/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:47.840126 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebf900-930c-4e92-beb2-08204ecbc415 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:47.840413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebf900-930c-4e92-beb2-08204ecbc415 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:47.840713 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebf900-930c-4e92-beb2-08204ecbc415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:47.859117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-71ebf900-930c-4e92-beb2-08204ecbc415 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:09:47.860319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-71ebf900-930c-4e92-beb2-08204ecbc415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:47.920001 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1292/2584] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:09:47.929887 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41372cf-2aa0-489b-a049-211b40c481a5 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:47.931761 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f41372cf-2aa0-489b-a049-211b40c481a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:47.989993 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41372cf-2aa0-489b-a049-211b40c481a5 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:47.993974 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c76d1-fc98-4498-a598-fb024b27dd46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:47.994634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c76d1-fc98-4498-a598-fb024b27dd46 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:47.994901 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c76d1-fc98-4498-a598-fb024b27dd46 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:47.995175 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c76d1-fc98-4498-a598-fb024b27dd46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:48.005360 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c76d1-fc98-4498-a598-fb024b27dd46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:48.006778 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c76d1-fc98-4498-a598-fb024b27dd46 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:48.016779 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1293/2585] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:09:49.463391 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe240bd-a4ed-4fe5-9753-559267047e8c None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:49.463965 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe240bd-a4ed-4fe5-9753-559267047e8c None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:49.464060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe240bd-a4ed-4fe5-9753-559267047e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:49.492676 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-abe240bd-a4ed-4fe5-9753-559267047e8c None None] MFA Rules not processed for user `4c500b85c820458fbc0bf4195558f39b`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:09:49.494031 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-abe240bd-a4ed-4fe5-9753-559267047e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:49.568687 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1293/2586] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:09:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:09:49.572350 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c76d1-fc98-4498-a598-fb024b27dd46 service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:49.582483 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c76d1-fc98-4498-a598-fb024b27dd46 service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:49.588053 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304a68c-b98d-45b4-afb9-bb1104320c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:49.588753 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304a68c-b98d-45b4-afb9-bb1104320c7e admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:49.589039 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304a68c-b98d-45b4-afb9-bb1104320c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:49.589337 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304a68c-b98d-45b4-afb9-bb1104320c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:49.590032 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304a68c-b98d-45b4-afb9-bb1104320c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:49.592050 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304a68c-b98d-45b4-afb9-bb1104320c7e admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:49.684968 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1294/2587] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:09:49 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:09:49.689416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe240bd-a4ed-4fe5-9753-559267047e8c None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:49.701773 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe240bd-a4ed-4fe5-9753-559267047e8c None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:49.757247 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430650e5-1829-40e1-bf7f-c5fe58979ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:49.757920 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430650e5-1829-40e1-bf7f-c5fe58979ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:49.758199 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430650e5-1829-40e1-bf7f-c5fe58979ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:49.758987 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430650e5-1829-40e1-bf7f-c5fe58979ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:49.759730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430650e5-1829-40e1-bf7f-c5fe58979ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:49.761677 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430650e5-1829-40e1-bf7f-c5fe58979ba3 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:49.907509 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1294/2588] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:09:49 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:09:49.911633 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304a68c-b98d-45b4-afb9-bb1104320c7e admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:49.922334 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304a68c-b98d-45b4-afb9-bb1104320c7e admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:49.926890 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cf53c-e637-4328-a0c4-3f1786b497f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:49.927582 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cf53c-e637-4328-a0c4-3f1786b497f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:49.927860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cf53c-e637-4328-a0c4-3f1786b497f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:49.928128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cf53c-e637-4328-a0c4-3f1786b497f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:49.928909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1cf53c-e637-4328-a0c4-3f1786b497f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:49.930508 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1cf53c-e637-4328-a0c4-3f1786b497f0 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:49.941430 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1295/2589] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 22:09:49.952327 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430650e5-1829-40e1-bf7f-c5fe58979ba3 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:49.963142 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430650e5-1829-40e1-bf7f-c5fe58979ba3 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:49.967849 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84cb58-d20c-4c53-ad05-743f9c95bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:49.968767 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84cb58-d20c-4c53-ad05-743f9c95bdbf admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:49.969042 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84cb58-d20c-4c53-ad05-743f9c95bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:49.969317 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84cb58-d20c-4c53-ad05-743f9c95bdbf admin admin] PATH_INFO: `/v3/projects/25520bd7a7794c73a462494fa6451f89/users/f273c2effa9f462d8cfa6656b0e73eb3/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:49.985152 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84cb58-d20c-4c53-ad05-743f9c95bdbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=25520bd7a7794c73a462494fa6451f89, user_id=f273c2effa9f462d8cfa6656b0e73eb3, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:49.987832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84cb58-d20c-4c53-ad05-743f9c95bdbf admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:50.103468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1295/2590] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:09:49 2022] PUT /identity/v3/projects/25520bd7a7794c73a462494fa6451f89/users/f273c2effa9f462d8cfa6656b0e73eb3/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:50.107676 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cf53c-e637-4328-a0c4-3f1786b497f0 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:50.118982 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cf53c-e637-4328-a0c4-3f1786b497f0 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:50.176665 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddcd05-7b42-4569-b7fc-f6ab3872a5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:50.177412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddcd05-7b42-4569-b7fc-f6ab3872a5ea admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:50.177699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddcd05-7b42-4569-b7fc-f6ab3872a5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:50.177974 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddcd05-7b42-4569-b7fc-f6ab3872a5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:50.178704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddcd05-7b42-4569-b7fc-f6ab3872a5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:50.180908 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddcd05-7b42-4569-b7fc-f6ab3872a5ea admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:50.190850 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1296/2591] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:09:50.195012 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84cb58-d20c-4c53-ad05-743f9c95bdbf admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:50.206267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84cb58-d20c-4c53-ad05-743f9c95bdbf admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:50.211020 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89831d-10b7-4133-8f56-9974380e0214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:50.218493 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89831d-10b7-4133-8f56-9974380e0214 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:50.218493 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89831d-10b7-4133-8f56-9974380e0214 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:50.218493 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89831d-10b7-4133-8f56-9974380e0214 admin admin] PATH_INFO: `/v3/projects/25520bd7a7794c73a462494fa6451f89/users/f273c2effa9f462d8cfa6656b0e73eb3/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:50.218493 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89831d-10b7-4133-8f56-9974380e0214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25520bd7a7794c73a462494fa6451f89, user_id=f273c2effa9f462d8cfa6656b0e73eb3, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:50.218493 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89831d-10b7-4133-8f56-9974380e0214 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:50.227999 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1296/2592] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:09:50 2022] PUT /identity/v3/projects/25520bd7a7794c73a462494fa6451f89/users/f273c2effa9f462d8cfa6656b0e73eb3/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:09:51.184527 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddcd05-7b42-4569-b7fc-f6ab3872a5ea admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:51.186397 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-71ddcd05-7b42-4569-b7fc-f6ab3872a5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:51.266610 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddcd05-7b42-4569-b7fc-f6ab3872a5ea admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:51.330310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca9919-32e5-4a45-8b61-f9d19f77d491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:51.330966 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca9919-32e5-4a45-8b61-f9d19f77d491 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:51.331249 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca9919-32e5-4a45-8b61-f9d19f77d491 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:51.331520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca9919-32e5-4a45-8b61-f9d19f77d491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:51.333388 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-29ca9919-32e5-4a45-8b61-f9d19f77d491 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:51.419741 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca9919-32e5-4a45-8b61-f9d19f77d491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:51.421444 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca9919-32e5-4a45-8b61-f9d19f77d491 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:51.439912 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1297/2593] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:09:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:09:51.574133 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470dc5f-ad00-4f35-b96d-57fb7af926cd None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:51.574652 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470dc5f-ad00-4f35-b96d-57fb7af926cd None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:51.577371 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470dc5f-ad00-4f35-b96d-57fb7af926cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:51.604947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-e470dc5f-ad00-4f35-b96d-57fb7af926cd None None] MFA Rules not processed for user `f273c2effa9f462d8cfa6656b0e73eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:09:51.606278 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e470dc5f-ad00-4f35-b96d-57fb7af926cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:51.689351 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1297/2594] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:09:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:09:51.697950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca9919-32e5-4a45-8b61-f9d19f77d491 service nova] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:51.705319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-29ca9919-32e5-4a45-8b61-f9d19f77d491 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:09:51.761704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca9919-32e5-4a45-8b61-f9d19f77d491 service nova] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:51.765752 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164652d2-5486-4ae9-9574-756735489898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:51.766408 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164652d2-5486-4ae9-9574-756735489898 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:51.766688 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164652d2-5486-4ae9-9574-756735489898 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:51.766960 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164652d2-5486-4ae9-9574-756735489898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:51.830528 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164652d2-5486-4ae9-9574-756735489898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:51.832050 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164652d2-5486-4ae9-9574-756735489898 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:51.841754 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1298/2595] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:09:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:09:54.969009 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470dc5f-ad00-4f35-b96d-57fb7af926cd None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:09:54.980355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470dc5f-ad00-4f35-b96d-57fb7af926cd None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:09:54.984135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f47a7-665c-4522-9b60-020a817b064e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:09:54.984832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f47a7-665c-4522-9b60-020a817b064e service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:09:54.985115 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f47a7-665c-4522-9b60-020a817b064e service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:09:54.985392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f47a7-665c-4522-9b60-020a817b064e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:09:54.995819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f47a7-665c-4522-9b60-020a817b064e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:09:54.997360 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f47a7-665c-4522-9b60-020a817b064e service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:09:55.006871 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1298/2596] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:09:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:10:16.227904 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164652d2-5486-4ae9-9574-756735489898 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:16.293440 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164652d2-5486-4ae9-9574-756735489898 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:16.298314 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5adade-a5b0-4bdb-8e64-9ad0a5700617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:16.299240 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5adade-a5b0-4bdb-8e64-9ad0a5700617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:16.299516 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5adade-a5b0-4bdb-8e64-9ad0a5700617 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:16.299785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5adade-a5b0-4bdb-8e64-9ad0a5700617 admin admin] PATH_INFO: `/v3/users/4c500b85c820458fbc0bf4195558f39b` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:16.301129 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5adade-a5b0-4bdb-8e64-9ad0a5700617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c500b85c820458fbc0bf4195558f39b)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:16.303178 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5adade-a5b0-4bdb-8e64-9ad0a5700617 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:16.521994 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7b5adade-a5b0-4bdb-8e64-9ad0a5700617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c500b85c820458fbc0bf4195558f39b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:16.522621 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7b5adade-a5b0-4bdb-8e64-9ad0a5700617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c500b85c820458fbc0bf4195558f39b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:16.535233 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7b5adade-a5b0-4bdb-8e64-9ad0a5700617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c500b85c820458fbc0bf4195558f39b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:16.542399 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7b5adade-a5b0-4bdb-8e64-9ad0a5700617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c500b85c820458fbc0bf4195558f39b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:16.543325 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7b5adade-a5b0-4bdb-8e64-9ad0a5700617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c500b85c820458fbc0bf4195558f39b'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:16.625759 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1299/2597] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:10:16 2022] DELETE /identity/v3/users/4c500b85c820458fbc0bf4195558f39b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:16.912391 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f47a7-665c-4522-9b60-020a817b064e service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:16.926840 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f47a7-665c-4522-9b60-020a817b064e service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:16.988948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:16.989827 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:16.990103 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:16.990436 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf admin admin] PATH_INFO: `/v3/projects/0ce84948867648b4acf0deaed698b9c2` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:16.991841 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce84948867648b4acf0deaed698b9c2)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:16.994386 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:17.123048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce84948867648b4acf0deaed698b9c2', 'request_id': 'req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:17.215157 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce84948867648b4acf0deaed698b9c2', 'request_id': 'req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:17.215157 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce84948867648b4acf0deaed698b9c2', 'request_id': 'req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:17.223265 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf admin admin] The token cache is being invalidate because project 0ce84948867648b4acf0deaed698b9c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:10:17.223571 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:17.224197 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:17.225783 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1299/2598] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:10:16 2022] DELETE /identity/v3/projects/0ce84948867648b4acf0deaed698b9c2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:17.230310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5adade-a5b0-4bdb-8e64-9ad0a5700617 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:17.231756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-7b5adade-a5b0-4bdb-8e64-9ad0a5700617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:17.245922 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5adade-a5b0-4bdb-8e64-9ad0a5700617 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:17.269348 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:17.271231 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:17.305454 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c295d3d-3245-4f1d-87c9-7a6a741f81c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:17.306368 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c295d3d-3245-4f1d-87c9-7a6a741f81c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:17.310474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c295d3d-3245-4f1d-87c9-7a6a741f81c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:17.310474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c295d3d-3245-4f1d-87c9-7a6a741f81c2 admin admin] PATH_INFO: `/v3/users/f273c2effa9f462d8cfa6656b0e73eb3` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:17.310474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c295d3d-3245-4f1d-87c9-7a6a741f81c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f273c2effa9f462d8cfa6656b0e73eb3)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:17.310474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c295d3d-3245-4f1d-87c9-7a6a741f81c2 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:17.329421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dfae4-8ec4-4dc4-96e9-1d47ab5e1fdf admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:17.333178 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde58c2-b7b0-49c4-9f0e-20f9310efb7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:17.333826 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde58c2-b7b0-49c4-9f0e-20f9310efb7a service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:17.334105 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde58c2-b7b0-49c4-9f0e-20f9310efb7a service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:17.334384 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde58c2-b7b0-49c4-9f0e-20f9310efb7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:17.337340 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ddde58c2-b7b0-49c4-9f0e-20f9310efb7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:17.349467 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde58c2-b7b0-49c4-9f0e-20f9310efb7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:17.350947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde58c2-b7b0-49c4-9f0e-20f9310efb7a service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:17.361004 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1300/2599] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:10:17.515076 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7c295d3d-3245-4f1d-87c9-7a6a741f81c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f273c2effa9f462d8cfa6656b0e73eb3'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:17.515699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7c295d3d-3245-4f1d-87c9-7a6a741f81c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f273c2effa9f462d8cfa6656b0e73eb3'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:17.529742 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7c295d3d-3245-4f1d-87c9-7a6a741f81c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f273c2effa9f462d8cfa6656b0e73eb3'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:17.537255 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7c295d3d-3245-4f1d-87c9-7a6a741f81c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f273c2effa9f462d8cfa6656b0e73eb3'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:17.537255 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-7c295d3d-3245-4f1d-87c9-7a6a741f81c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f273c2effa9f462d8cfa6656b0e73eb3'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:17.622505 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1300/2600] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:10:17 2022] DELETE /identity/v3/users/f273c2effa9f462d8cfa6656b0e73eb3 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:17.871306 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde58c2-b7b0-49c4-9f0e-20f9310efb7a service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:17.873606 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ddde58c2-b7b0-49c4-9f0e-20f9310efb7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:17.894511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde58c2-b7b0-49c4-9f0e-20f9310efb7a service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:17.966317 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a220faa-c782-44ff-b6fd-9dd3a1097709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:17.967195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a220faa-c782-44ff-b6fd-9dd3a1097709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:17.967476 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a220faa-c782-44ff-b6fd-9dd3a1097709 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:17.967751 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a220faa-c782-44ff-b6fd-9dd3a1097709 admin admin] PATH_INFO: `/v3/projects/25520bd7a7794c73a462494fa6451f89` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:17.969025 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a220faa-c782-44ff-b6fd-9dd3a1097709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25520bd7a7794c73a462494fa6451f89)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:17.971350 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a220faa-c782-44ff-b6fd-9dd3a1097709 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:18.161338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4a220faa-c782-44ff-b6fd-9dd3a1097709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25520bd7a7794c73a462494fa6451f89', 'request_id': 'req-4a220faa-c782-44ff-b6fd-9dd3a1097709'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:18.273403 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4a220faa-c782-44ff-b6fd-9dd3a1097709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25520bd7a7794c73a462494fa6451f89', 'request_id': 'req-4a220faa-c782-44ff-b6fd-9dd3a1097709'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:18.280034 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4a220faa-c782-44ff-b6fd-9dd3a1097709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25520bd7a7794c73a462494fa6451f89', 'request_id': 'req-4a220faa-c782-44ff-b6fd-9dd3a1097709'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:18.291382 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4a220faa-c782-44ff-b6fd-9dd3a1097709 admin admin] The token cache is being invalidate because project 25520bd7a7794c73a462494fa6451f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:10:18.291671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4a220faa-c782-44ff-b6fd-9dd3a1097709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:18.292314 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4a220faa-c782-44ff-b6fd-9dd3a1097709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:18.293886 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1301/2601] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:10:17 2022] DELETE /identity/v3/projects/25520bd7a7794c73a462494fa6451f89 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:18.298961 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a5cd8-68ec-4e9e-800c-d49ca7b3dc53 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:18.299451 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a5cd8-68ec-4e9e-800c-d49ca7b3dc53 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:18.299585 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a5cd8-68ec-4e9e-800c-d49ca7b3dc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:18.317322 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-be2a5cd8-68ec-4e9e-800c-d49ca7b3dc53 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:18.318519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-be2a5cd8-68ec-4e9e-800c-d49ca7b3dc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:18.378558 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1301/2602] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:18.386453 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5541b1c-98b7-494d-9f18-93ddfac7391f None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:18.386742 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5541b1c-98b7-494d-9f18-93ddfac7391f None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:18.387020 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5541b1c-98b7-494d-9f18-93ddfac7391f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:18.404803 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-c5541b1c-98b7-494d-9f18-93ddfac7391f None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:18.406013 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c5541b1c-98b7-494d-9f18-93ddfac7391f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:18.414651 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1302/2603] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:18.418714 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a5cd8-68ec-4e9e-800c-d49ca7b3dc53 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:18.428291 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a5cd8-68ec-4e9e-800c-d49ca7b3dc53 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:18.433740 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae0732-78f6-4a49-aeaa-cd6d464096fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:18.434390 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae0732-78f6-4a49-aeaa-cd6d464096fa admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:18.434663 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae0732-78f6-4a49-aeaa-cd6d464096fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:18.434932 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae0732-78f6-4a49-aeaa-cd6d464096fa admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:18.435652 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae0732-78f6-4a49-aeaa-cd6d464096fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:10:18.435954 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae0732-78f6-4a49-aeaa-cd6d464096fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:18.437795 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae0732-78f6-4a49-aeaa-cd6d464096fa admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:18.449435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1302/2604] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 22:10:18.454465 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5541b1c-98b7-494d-9f18-93ddfac7391f None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:18.464849 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5541b1c-98b7-494d-9f18-93ddfac7391f None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:18.469511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb3dca-57dc-4348-9d5c-88811f986121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:18.470187 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb3dca-57dc-4348-9d5c-88811f986121 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:18.470463 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb3dca-57dc-4348-9d5c-88811f986121 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:18.470730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb3dca-57dc-4348-9d5c-88811f986121 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:18.471693 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb3dca-57dc-4348-9d5c-88811f986121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:18.473628 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb3dca-57dc-4348-9d5c-88811f986121 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:18.606810 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1303/2605] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:10:18 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:10:18.610874 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae0732-78f6-4a49-aeaa-cd6d464096fa admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:18.622696 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae0732-78f6-4a49-aeaa-cd6d464096fa admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:18.700029 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d85664-0a44-449d-a89b-2b1b89bd1ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:18.700946 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d85664-0a44-449d-a89b-2b1b89bd1ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:18.701465 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d85664-0a44-449d-a89b-2b1b89bd1ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:18.701850 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d85664-0a44-449d-a89b-2b1b89bd1ed8 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:18.702676 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d85664-0a44-449d-a89b-2b1b89bd1ed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:18.704868 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d85664-0a44-449d-a89b-2b1b89bd1ed8 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:18.804369 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1303/2606] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:10:18 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:10:18.804566 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb3dca-57dc-4348-9d5c-88811f986121 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:18.815472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb3dca-57dc-4348-9d5c-88811f986121 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:18.820929 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1aaba-a726-4f5c-bc52-0a10c049b4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:18.821708 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1aaba-a726-4f5c-bc52-0a10c049b4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:18.821988 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1aaba-a726-4f5c-bc52-0a10c049b4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:18.822264 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1aaba-a726-4f5c-bc52-0a10c049b4b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:18.822999 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1aaba-a726-4f5c-bc52-0a10c049b4b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:18.824754 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1aaba-a726-4f5c-bc52-0a10c049b4b5 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:18.836312 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1304/2607] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 22:10:18.840552 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d85664-0a44-449d-a89b-2b1b89bd1ed8 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:18.851909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d85664-0a44-449d-a89b-2b1b89bd1ed8 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:18.856304 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a604f-bfde-41b8-b2e0-7bb1e879a23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:18.857080 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a604f-bfde-41b8-b2e0-7bb1e879a23c admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:18.857435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a604f-bfde-41b8-b2e0-7bb1e879a23c admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:18.857780 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a604f-bfde-41b8-b2e0-7bb1e879a23c admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:18.858575 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a604f-bfde-41b8-b2e0-7bb1e879a23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:18.860241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a604f-bfde-41b8-b2e0-7bb1e879a23c admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:18.870564 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1304/2608] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 22:10:18.874860 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1aaba-a726-4f5c-bc52-0a10c049b4b5 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:18.885533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1aaba-a726-4f5c-bc52-0a10c049b4b5 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:18.890216 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71f82d-7a17-49f3-8309-22946570a2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:18.891096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71f82d-7a17-49f3-8309-22946570a2f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:18.891371 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71f82d-7a17-49f3-8309-22946570a2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:18.891647 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71f82d-7a17-49f3-8309-22946570a2f0 admin admin] PATH_INFO: `/v3/projects/1cd7c00c14c94b32a264217df480065e/users/9ff0501864f3417c86a6e3f58d9223fa/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:18.907553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71f82d-7a17-49f3-8309-22946570a2f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd7c00c14c94b32a264217df480065e, user_id=9ff0501864f3417c86a6e3f58d9223fa, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:18.918361 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71f82d-7a17-49f3-8309-22946570a2f0 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:19.041616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1305/2609] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:10:18 2022] PUT /identity/v3/projects/1cd7c00c14c94b32a264217df480065e/users/9ff0501864f3417c86a6e3f58d9223fa/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:10:19.052941 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf54a1-fa07-413c-bc8a-4b3176f0a26a None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:19.053231 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf54a1-fa07-413c-bc8a-4b3176f0a26a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:19.053503 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf54a1-fa07-413c-bc8a-4b3176f0a26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:19.083029 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-56bf54a1-fa07-413c-bc8a-4b3176f0a26a None None] MFA Rules not processed for user `9ff0501864f3417c86a6e3f58d9223fa`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:19.084253 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-56bf54a1-fa07-413c-bc8a-4b3176f0a26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:19.155975 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1305/2610] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:19.160772 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71f82d-7a17-49f3-8309-22946570a2f0 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:19.224884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71f82d-7a17-49f3-8309-22946570a2f0 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:19.230015 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ddcad-96ec-4f04-b026-603c72bad890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:19.230692 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ddcad-96ec-4f04-b026-603c72bad890 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:19.230970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ddcad-96ec-4f04-b026-603c72bad890 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:19.231245 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ddcad-96ec-4f04-b026-603c72bad890 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:19.231958 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ddcad-96ec-4f04-b026-603c72bad890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:19.233965 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ddcad-96ec-4f04-b026-603c72bad890 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:19.355883 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1306/2611] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:10:19 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:10:19.357320 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf54a1-fa07-413c-bc8a-4b3176f0a26a None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:19.369507 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf54a1-fa07-413c-bc8a-4b3176f0a26a None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:19.437339 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82317008-8ae6-4f0c-8398-1cbe104b367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:19.438141 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82317008-8ae6-4f0c-8398-1cbe104b367f admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:19.438545 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82317008-8ae6-4f0c-8398-1cbe104b367f admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:19.438885 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82317008-8ae6-4f0c-8398-1cbe104b367f admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:19.439656 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82317008-8ae6-4f0c-8398-1cbe104b367f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:19.441697 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82317008-8ae6-4f0c-8398-1cbe104b367f admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:19.536613 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1306/2612] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:10:19 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:10:19.540409 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ddcad-96ec-4f04-b026-603c72bad890 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:19.551743 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ddcad-96ec-4f04-b026-603c72bad890 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:19.557990 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430f178-74bc-43a4-a762-cf952dd086cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:19.558826 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430f178-74bc-43a4-a762-cf952dd086cd admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:19.563221 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430f178-74bc-43a4-a762-cf952dd086cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:19.563221 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430f178-74bc-43a4-a762-cf952dd086cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:19.563221 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430f178-74bc-43a4-a762-cf952dd086cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:19.564697 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430f178-74bc-43a4-a762-cf952dd086cd admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:19.582256 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1307/2613] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:19.586847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82317008-8ae6-4f0c-8398-1cbe104b367f admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:19.598066 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82317008-8ae6-4f0c-8398-1cbe104b367f admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:19.603902 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a5be4-ea45-4ac5-acad-5ca8d1692cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:19.604805 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a5be4-ea45-4ac5-acad-5ca8d1692cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:19.605092 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a5be4-ea45-4ac5-acad-5ca8d1692cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:19.605640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a5be4-ea45-4ac5-acad-5ca8d1692cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:19.606655 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a5be4-ea45-4ac5-acad-5ca8d1692cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:19.609570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a5be4-ea45-4ac5-acad-5ca8d1692cc0 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:19.624881 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1307/2614] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:19.627506 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430f178-74bc-43a4-a762-cf952dd086cd admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:19.643390 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430f178-74bc-43a4-a762-cf952dd086cd admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:19.649844 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cc459-aa7c-404b-98a1-295ad4f707cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:19.651750 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cc459-aa7c-404b-98a1-295ad4f707cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:19.652560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cc459-aa7c-404b-98a1-295ad4f707cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:19.652880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cc459-aa7c-404b-98a1-295ad4f707cd admin admin] PATH_INFO: `/v3/projects/6e17288b16724257997d85bd70912f78/users/d53b287021eb428a9dd55cf64f8ed671/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:19.672935 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91cc459-aa7c-404b-98a1-295ad4f707cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e17288b16724257997d85bd70912f78, user_id=d53b287021eb428a9dd55cf64f8ed671, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:19.675835 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91cc459-aa7c-404b-98a1-295ad4f707cd admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:19.782402 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1308/2615] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:10:19 2022] PUT /identity/v3/projects/6e17288b16724257997d85bd70912f78/users/d53b287021eb428a9dd55cf64f8ed671/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:19.793955 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6f679-ce4a-4323-b754-920ed8528cd4 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:19.794861 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6f679-ce4a-4323-b754-920ed8528cd4 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:19.794861 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6f679-ce4a-4323-b754-920ed8528cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:19.828295 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-70e6f679-ce4a-4323-b754-920ed8528cd4 None None] MFA Rules not processed for user `d53b287021eb428a9dd55cf64f8ed671`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:19.828295 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-70e6f679-ce4a-4323-b754-920ed8528cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:19.919419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1308/2616] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:19.920879 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cc459-aa7c-404b-98a1-295ad4f707cd admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:20.041332 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cc459-aa7c-404b-98a1-295ad4f707cd admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:20.048760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4d656-652f-42f7-8be2-67d984fab642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:20.049570 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4d656-652f-42f7-8be2-67d984fab642 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:20.049851 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4d656-652f-42f7-8be2-67d984fab642 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:20.050129 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4d656-652f-42f7-8be2-67d984fab642 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:20.050943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4d656-652f-42f7-8be2-67d984fab642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:20.053057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4d656-652f-42f7-8be2-67d984fab642 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:20.181580 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1309/2617] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:10:19 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:10:20.186025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6f679-ce4a-4323-b754-920ed8528cd4 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:20.201704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6f679-ce4a-4323-b754-920ed8528cd4 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:20.287429 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a044f-5ec8-4275-aed9-03430385c224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:20.288166 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a044f-5ec8-4275-aed9-03430385c224 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:20.288508 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a044f-5ec8-4275-aed9-03430385c224 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:20.289428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a044f-5ec8-4275-aed9-03430385c224 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:20.290153 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a044f-5ec8-4275-aed9-03430385c224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:20.292431 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a044f-5ec8-4275-aed9-03430385c224 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:20.414865 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1309/2618] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:10:20 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:10:20.419065 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4d656-652f-42f7-8be2-67d984fab642 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:20.430537 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4d656-652f-42f7-8be2-67d984fab642 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:20.435851 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122dc1b-7627-4887-bbf7-18fac50a1edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:20.436762 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122dc1b-7627-4887-bbf7-18fac50a1edd admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:20.441057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122dc1b-7627-4887-bbf7-18fac50a1edd admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:20.441057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122dc1b-7627-4887-bbf7-18fac50a1edd admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:20.441057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122dc1b-7627-4887-bbf7-18fac50a1edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:20.441057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122dc1b-7627-4887-bbf7-18fac50a1edd admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:20.452319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1310/2619] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 22:10:20.456525 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a044f-5ec8-4275-aed9-03430385c224 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:20.469115 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a044f-5ec8-4275-aed9-03430385c224 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:20.475056 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68fe1e-4b74-493e-aa4d-25022aa26b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:20.476918 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68fe1e-4b74-493e-aa4d-25022aa26b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:20.477082 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68fe1e-4b74-493e-aa4d-25022aa26b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:20.477285 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68fe1e-4b74-493e-aa4d-25022aa26b8e admin admin] PATH_INFO: `/v3/projects/79eec3a72976402f8f21434922469e57/users/6403dcbf8a2f4c599e8fd5cbd4106822/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:20.496984 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68fe1e-4b74-493e-aa4d-25022aa26b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=79eec3a72976402f8f21434922469e57, user_id=6403dcbf8a2f4c599e8fd5cbd4106822, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:20.500441 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68fe1e-4b74-493e-aa4d-25022aa26b8e admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:20.609774 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1310/2620] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:10:20 2022] PUT /identity/v3/projects/79eec3a72976402f8f21434922469e57/users/6403dcbf8a2f4c599e8fd5cbd4106822/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:20.614230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122dc1b-7627-4887-bbf7-18fac50a1edd admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:20.627076 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122dc1b-7627-4887-bbf7-18fac50a1edd admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:20.705005 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d540e2c-138e-4f85-8e34-bd8d762e12d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:20.705697 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d540e2c-138e-4f85-8e34-bd8d762e12d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:20.705976 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d540e2c-138e-4f85-8e34-bd8d762e12d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:20.706252 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d540e2c-138e-4f85-8e34-bd8d762e12d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:20.706984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d540e2c-138e-4f85-8e34-bd8d762e12d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:20.708641 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d540e2c-138e-4f85-8e34-bd8d762e12d6 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:20.721820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1311/2621] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:20.726926 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68fe1e-4b74-493e-aa4d-25022aa26b8e admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:20.737905 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68fe1e-4b74-493e-aa4d-25022aa26b8e admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:20.745475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336995b-df9c-42f9-b5a4-d62bb0b05708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:20.746502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336995b-df9c-42f9-b5a4-d62bb0b05708 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:20.746860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336995b-df9c-42f9-b5a4-d62bb0b05708 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:20.747197 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336995b-df9c-42f9-b5a4-d62bb0b05708 admin admin] PATH_INFO: `/v3/projects/79eec3a72976402f8f21434922469e57/users/6403dcbf8a2f4c599e8fd5cbd4106822/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:20.749301 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336995b-df9c-42f9-b5a4-d62bb0b05708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79eec3a72976402f8f21434922469e57, user_id=6403dcbf8a2f4c599e8fd5cbd4106822, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:20.752051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336995b-df9c-42f9-b5a4-d62bb0b05708 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:20.772514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1311/2622] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:10:20 2022] PUT /identity/v3/projects/79eec3a72976402f8f21434922469e57/users/6403dcbf8a2f4c599e8fd5cbd4106822/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:20.787761 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f66f3d-580e-4d1b-a6a1-dc7545f2afcb None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:20.787761 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f66f3d-580e-4d1b-a6a1-dc7545f2afcb None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:20.788083 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f66f3d-580e-4d1b-a6a1-dc7545f2afcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:20.819037 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-e7f66f3d-580e-4d1b-a6a1-dc7545f2afcb None None] MFA Rules not processed for user `6403dcbf8a2f4c599e8fd5cbd4106822`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:20.820439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e7f66f3d-580e-4d1b-a6a1-dc7545f2afcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:20.898232 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1312/2623] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:20.909911 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336995b-df9c-42f9-b5a4-d62bb0b05708 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:20.911646 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9336995b-df9c-42f9-b5a4-d62bb0b05708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:21.002707 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336995b-df9c-42f9-b5a4-d62bb0b05708 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:21.009050 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c162e4-a93f-46ec-8cf8-da69601c2ee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:21.010919 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c162e4-a93f-46ec-8cf8-da69601c2ee9 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:21.011280 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c162e4-a93f-46ec-8cf8-da69601c2ee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:21.011781 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c162e4-a93f-46ec-8cf8-da69601c2ee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:21.112267 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c162e4-a93f-46ec-8cf8-da69601c2ee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:21.114291 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c162e4-a93f-46ec-8cf8-da69601c2ee9 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:21.127253 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1312/2624] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:10:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:10:21.785685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f66f3d-580e-4d1b-a6a1-dc7545f2afcb None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:21.787182 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e7f66f3d-580e-4d1b-a6a1-dc7545f2afcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:21.857882 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f66f3d-580e-4d1b-a6a1-dc7545f2afcb None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:21.863194 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3514b-f2a5-4ccd-8896-0579426779fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:21.864083 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3514b-f2a5-4ccd-8896-0579426779fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:21.864363 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3514b-f2a5-4ccd-8896-0579426779fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:21.864663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3514b-f2a5-4ccd-8896-0579426779fd admin admin] PATH_INFO: `/v3/users/f7fe7ea486834f6e9e8a7685d9c36bac` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:21.865965 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3514b-f2a5-4ccd-8896-0579426779fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7fe7ea486834f6e9e8a7685d9c36bac)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:21.868803 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3514b-f2a5-4ccd-8896-0579426779fd admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:22.099374 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-20b3514b-f2a5-4ccd-8896-0579426779fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7fe7ea486834f6e9e8a7685d9c36bac'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:22.100324 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-20b3514b-f2a5-4ccd-8896-0579426779fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7fe7ea486834f6e9e8a7685d9c36bac'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:22.114733 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-20b3514b-f2a5-4ccd-8896-0579426779fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7fe7ea486834f6e9e8a7685d9c36bac'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:22.122943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-20b3514b-f2a5-4ccd-8896-0579426779fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7fe7ea486834f6e9e8a7685d9c36bac'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:22.123738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-20b3514b-f2a5-4ccd-8896-0579426779fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7fe7ea486834f6e9e8a7685d9c36bac'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:22.199983 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1313/2625] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:10:21 2022] DELETE /identity/v3/users/f7fe7ea486834f6e9e8a7685d9c36bac => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:22.553409 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c162e4-a93f-46ec-8cf8-da69601c2ee9 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:22.565400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c162e4-a93f-46ec-8cf8-da69601c2ee9 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:22.629186 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1d57b-589e-4bb7-aa8c-5c3411dab165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:22.630165 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1d57b-589e-4bb7-aa8c-5c3411dab165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:22.630536 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1d57b-589e-4bb7-aa8c-5c3411dab165 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:22.630868 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1d57b-589e-4bb7-aa8c-5c3411dab165 admin admin] PATH_INFO: `/v3/projects/a65a6dd5b01d4404afb6a740fb56fd54` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:22.632975 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1d57b-589e-4bb7-aa8c-5c3411dab165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a65a6dd5b01d4404afb6a740fb56fd54)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:22.635241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1d57b-589e-4bb7-aa8c-5c3411dab165 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:22.798373 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fac1d57b-589e-4bb7-aa8c-5c3411dab165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a65a6dd5b01d4404afb6a740fb56fd54', 'request_id': 'req-fac1d57b-589e-4bb7-aa8c-5c3411dab165'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:22.953566 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fac1d57b-589e-4bb7-aa8c-5c3411dab165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a65a6dd5b01d4404afb6a740fb56fd54', 'request_id': 'req-fac1d57b-589e-4bb7-aa8c-5c3411dab165'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:22.961236 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fac1d57b-589e-4bb7-aa8c-5c3411dab165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a65a6dd5b01d4404afb6a740fb56fd54', 'request_id': 'req-fac1d57b-589e-4bb7-aa8c-5c3411dab165'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:22.972936 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fac1d57b-589e-4bb7-aa8c-5c3411dab165 admin admin] The token cache is being invalidate because project a65a6dd5b01d4404afb6a740fb56fd54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:10:22.973203 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fac1d57b-589e-4bb7-aa8c-5c3411dab165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:22.974017 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fac1d57b-589e-4bb7-aa8c-5c3411dab165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:22.975618 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1313/2626] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:10:22 2022] DELETE /identity/v3/projects/a65a6dd5b01d4404afb6a740fb56fd54 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:22.980914 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92204857-7048-4b84-8219-8cca24e6bfe0 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:22.981431 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92204857-7048-4b84-8219-8cca24e6bfe0 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:22.981531 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92204857-7048-4b84-8219-8cca24e6bfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:23.003847 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-92204857-7048-4b84-8219-8cca24e6bfe0 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:23.006492 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-92204857-7048-4b84-8219-8cca24e6bfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:23.084619 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1314/2627] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:23.086031 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b592ec-afba-47c5-8b09-863c4f1daa93 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:23.086345 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b592ec-afba-47c5-8b09-863c4f1daa93 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:23.086632 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b592ec-afba-47c5-8b09-863c4f1daa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:23.110101 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-c4b592ec-afba-47c5-8b09-863c4f1daa93 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:23.111320 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c4b592ec-afba-47c5-8b09-863c4f1daa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:23.124858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1314/2628] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:23.129286 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92204857-7048-4b84-8219-8cca24e6bfe0 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:23.141246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92204857-7048-4b84-8219-8cca24e6bfe0 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:23.148629 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cddb8-0498-442e-ac5f-1981ebb96466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:23.152956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cddb8-0498-442e-ac5f-1981ebb96466 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:23.152956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cddb8-0498-442e-ac5f-1981ebb96466 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:23.152956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cddb8-0498-442e-ac5f-1981ebb96466 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:23.152956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cddb8-0498-442e-ac5f-1981ebb96466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:10:23.152956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cddb8-0498-442e-ac5f-1981ebb96466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:23.153408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cddb8-0498-442e-ac5f-1981ebb96466 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:23.166497 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1315/2629] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:10:23.171081 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b592ec-afba-47c5-8b09-863c4f1daa93 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:23.181794 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b592ec-afba-47c5-8b09-863c4f1daa93 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:23.186818 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afee3b-6a23-4986-a071-545da26cac21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:23.187512 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afee3b-6a23-4986-a071-545da26cac21 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:23.187794 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afee3b-6a23-4986-a071-545da26cac21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:23.188075 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afee3b-6a23-4986-a071-545da26cac21 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:23.188808 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afee3b-6a23-4986-a071-545da26cac21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:23.190718 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afee3b-6a23-4986-a071-545da26cac21 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:23.307959 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1315/2630] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:10:23 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:10:23.312282 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cddb8-0498-442e-ac5f-1981ebb96466 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:23.323277 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cddb8-0498-442e-ac5f-1981ebb96466 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:23.391775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136a164-5ab9-462a-9f56-86940329dba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:23.392456 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136a164-5ab9-462a-9f56-86940329dba4 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:23.392769 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136a164-5ab9-462a-9f56-86940329dba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:23.393038 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136a164-5ab9-462a-9f56-86940329dba4 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:23.393731 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136a164-5ab9-462a-9f56-86940329dba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:23.395648 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136a164-5ab9-462a-9f56-86940329dba4 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:23.486252 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1316/2631] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:10:23 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:10:23.487494 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afee3b-6a23-4986-a071-545da26cac21 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:23.499128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afee3b-6a23-4986-a071-545da26cac21 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:23.504037 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6862762-afc0-4705-958b-03585182cbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:23.504750 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6862762-afc0-4705-958b-03585182cbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:23.505024 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6862762-afc0-4705-958b-03585182cbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:23.505313 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6862762-afc0-4705-958b-03585182cbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:23.506067 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6862762-afc0-4705-958b-03585182cbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:23.507978 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6862762-afc0-4705-958b-03585182cbe1 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:23.518873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1316/2632] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:23.523162 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136a164-5ab9-462a-9f56-86940329dba4 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:23.533439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136a164-5ab9-462a-9f56-86940329dba4 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:23.538597 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a668f-cc3e-4436-904e-36348972487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:23.539485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a668f-cc3e-4436-904e-36348972487f admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:23.540011 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a668f-cc3e-4436-904e-36348972487f admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:23.540288 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a668f-cc3e-4436-904e-36348972487f admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:23.541054 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a668f-cc3e-4436-904e-36348972487f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:23.542660 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a668f-cc3e-4436-904e-36348972487f admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:23.553213 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1317/2633] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 22:10:23.558503 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6862762-afc0-4705-958b-03585182cbe1 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:23.569015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6862762-afc0-4705-958b-03585182cbe1 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:23.574410 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30c83c-3394-4a74-a1d9-2a3f6907a6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:23.575504 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30c83c-3394-4a74-a1d9-2a3f6907a6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:23.575631 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30c83c-3394-4a74-a1d9-2a3f6907a6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:23.575836 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30c83c-3394-4a74-a1d9-2a3f6907a6f5 admin admin] PATH_INFO: `/v3/projects/a908560c28d44c8197fbb853c0695a94/users/fde4dbf3fe55412ca107b6f680e83706/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:23.591938 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30c83c-3394-4a74-a1d9-2a3f6907a6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a908560c28d44c8197fbb853c0695a94, user_id=fde4dbf3fe55412ca107b6f680e83706, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:23.594700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30c83c-3394-4a74-a1d9-2a3f6907a6f5 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:23.694225 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1317/2634] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:10:23 2022] PUT /identity/v3/projects/a908560c28d44c8197fbb853c0695a94/users/fde4dbf3fe55412ca107b6f680e83706/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:10:23.708559 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915955ec-81ae-4025-bb6c-8e4989a5e43c None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:23.708883 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915955ec-81ae-4025-bb6c-8e4989a5e43c None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:23.709164 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915955ec-81ae-4025-bb6c-8e4989a5e43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:23.737548 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-915955ec-81ae-4025-bb6c-8e4989a5e43c None None] MFA Rules not processed for user `fde4dbf3fe55412ca107b6f680e83706`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:23.738756 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-915955ec-81ae-4025-bb6c-8e4989a5e43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:23.809516 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1318/2635] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:23.814532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30c83c-3394-4a74-a1d9-2a3f6907a6f5 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:23.876463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30c83c-3394-4a74-a1d9-2a3f6907a6f5 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:23.881367 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f749111-345e-4d6b-ba0a-40fc7e46f8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:23.882062 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f749111-345e-4d6b-ba0a-40fc7e46f8dc admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:23.882361 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f749111-345e-4d6b-ba0a-40fc7e46f8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:23.882680 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f749111-345e-4d6b-ba0a-40fc7e46f8dc admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:23.883335 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f749111-345e-4d6b-ba0a-40fc7e46f8dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:23.885277 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f749111-345e-4d6b-ba0a-40fc7e46f8dc admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:24.003778 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1318/2636] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:10:23 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:10:24.008138 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915955ec-81ae-4025-bb6c-8e4989a5e43c None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:24.019122 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915955ec-81ae-4025-bb6c-8e4989a5e43c None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:24.076818 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a231f-036d-48a2-9834-310f76d77c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:24.077697 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a231f-036d-48a2-9834-310f76d77c7f admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:24.077975 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a231f-036d-48a2-9834-310f76d77c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:24.078246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a231f-036d-48a2-9834-310f76d77c7f admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:24.078939 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a231f-036d-48a2-9834-310f76d77c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:24.080875 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a231f-036d-48a2-9834-310f76d77c7f admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:24.345135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1319/2637] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:10:24 2022] POST /identity/v3/users => generated 299 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:10:24.349518 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f749111-345e-4d6b-ba0a-40fc7e46f8dc admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:24.360368 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f749111-345e-4d6b-ba0a-40fc7e46f8dc admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:24.364941 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87853b7b-eb42-4b2c-a45c-d86570fc7432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:24.368366 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87853b7b-eb42-4b2c-a45c-d86570fc7432 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:24.368683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87853b7b-eb42-4b2c-a45c-d86570fc7432 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:24.368964 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87853b7b-eb42-4b2c-a45c-d86570fc7432 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:24.369764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87853b7b-eb42-4b2c-a45c-d86570fc7432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:24.371336 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87853b7b-eb42-4b2c-a45c-d86570fc7432 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:24.383034 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1319/2638] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:24.389554 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a231f-036d-48a2-9834-310f76d77c7f admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:24.401852 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a231f-036d-48a2-9834-310f76d77c7f admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:24.406606 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d094d5-60d7-4396-bafb-23e2cf3ce7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:24.407492 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d094d5-60d7-4396-bafb-23e2cf3ce7f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:24.407770 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d094d5-60d7-4396-bafb-23e2cf3ce7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:24.408043 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d094d5-60d7-4396-bafb-23e2cf3ce7f8 admin admin] PATH_INFO: `/v3/projects/2009e94b5bbb4e0a86c673d72ffeac1a/users/d1670e1ba60f44519fcccaca70b3dc5d/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:24.428499 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d094d5-60d7-4396-bafb-23e2cf3ce7f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2009e94b5bbb4e0a86c673d72ffeac1a, user_id=d1670e1ba60f44519fcccaca70b3dc5d, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:24.428499 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d094d5-60d7-4396-bafb-23e2cf3ce7f8 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:24.598643 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87853b7b-eb42-4b2c-a45c-d86570fc7432 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:24.600394 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-87853b7b-eb42-4b2c-a45c-d86570fc7432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:24.623319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1320/2639] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:10:24 2022] PUT /identity/v3/projects/2009e94b5bbb4e0a86c673d72ffeac1a/users/d1670e1ba60f44519fcccaca70b3dc5d/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:10:24.636464 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d094d5-60d7-4396-bafb-23e2cf3ce7f8 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:24.659971 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87853b7b-eb42-4b2c-a45c-d86570fc7432 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:24.699222 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d094d5-60d7-4396-bafb-23e2cf3ce7f8 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:24.704191 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd1907-b836-429e-81bd-a707df9e76af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:24.704890 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd1907-b836-429e-81bd-a707df9e76af admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:24.705174 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd1907-b836-429e-81bd-a707df9e76af admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:24.705487 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd1907-b836-429e-81bd-a707df9e76af admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:24.706180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd1907-b836-429e-81bd-a707df9e76af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:24.707776 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd1907-b836-429e-81bd-a707df9e76af admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:24.709551 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd50744-23e2-4706-a931-a30b098f51bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:24.710385 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd50744-23e2-4706-a931-a30b098f51bd service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:24.710626 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd50744-23e2-4706-a931-a30b098f51bd service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:24.710898 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd50744-23e2-4706-a931-a30b098f51bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:24.712724 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-edd50744-23e2-4706-a931-a30b098f51bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:24.718165 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1321/2640] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 22:10:24.722532 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd1907-b836-429e-81bd-a707df9e76af admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:24.732927 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd1907-b836-429e-81bd-a707df9e76af admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:24.737802 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670dc86-d20b-4fe3-b45f-9101fb4d0e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:24.738678 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670dc86-d20b-4fe3-b45f-9101fb4d0e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:24.738956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670dc86-d20b-4fe3-b45f-9101fb4d0e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:24.739283 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670dc86-d20b-4fe3-b45f-9101fb4d0e09 admin admin] PATH_INFO: `/v3/projects/2009e94b5bbb4e0a86c673d72ffeac1a/users/d1670e1ba60f44519fcccaca70b3dc5d/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:24.741924 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670dc86-d20b-4fe3-b45f-9101fb4d0e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2009e94b5bbb4e0a86c673d72ffeac1a, user_id=d1670e1ba60f44519fcccaca70b3dc5d, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:24.744598 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670dc86-d20b-4fe3-b45f-9101fb4d0e09 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:24.755186 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1322/2641] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:10:24 2022] PUT /identity/v3/projects/2009e94b5bbb4e0a86c673d72ffeac1a/users/d1670e1ba60f44519fcccaca70b3dc5d/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:10:24.766100 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34e18b-c619-4e8f-ad8c-c56c4c470e4e None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:24.766390 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34e18b-c619-4e8f-ad8c-c56c4c470e4e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:24.766667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34e18b-c619-4e8f-ad8c-c56c4c470e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:24.775164 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd50744-23e2-4706-a931-a30b098f51bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:24.777100 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd50744-23e2-4706-a931-a30b098f51bd service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:24.789439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1320/2642] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:10:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:10:24.802210 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-9b34e18b-c619-4e8f-ad8c-c56c4c470e4e None None] MFA Rules not processed for user `d1670e1ba60f44519fcccaca70b3dc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:24.803458 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-9b34e18b-c619-4e8f-ad8c-c56c4c470e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:24.874039 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1323/2643] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:10:24.886098 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd50744-23e2-4706-a931-a30b098f51bd service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:24.887886 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-edd50744-23e2-4706-a931-a30b098f51bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:24.899612 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd50744-23e2-4706-a931-a30b098f51bd service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:24.950511 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b491c23-8368-4bc8-b8f0-e405c26e68e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:24.951146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b491c23-8368-4bc8-b8f0-e405c26e68e0 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:24.951428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b491c23-8368-4bc8-b8f0-e405c26e68e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:24.951704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b491c23-8368-4bc8-b8f0-e405c26e68e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:24.961227 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b491c23-8368-4bc8-b8f0-e405c26e68e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:24.962690 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b491c23-8368-4bc8-b8f0-e405c26e68e0 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:24.973145 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1321/2644] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:10:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:10:25.004827 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34e18b-c619-4e8f-ad8c-c56c4c470e4e None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:25.068510 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34e18b-c619-4e8f-ad8c-c56c4c470e4e None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:25.073607 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b9bac-9abe-4d6b-97b7-fafb0eb369e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:25.074486 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b9bac-9abe-4d6b-97b7-fafb0eb369e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:25.074770 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b9bac-9abe-4d6b-97b7-fafb0eb369e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:25.075046 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b9bac-9abe-4d6b-97b7-fafb0eb369e6 admin admin] PATH_INFO: `/v3/users/fde4dbf3fe55412ca107b6f680e83706` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:25.076299 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b9bac-9abe-4d6b-97b7-fafb0eb369e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde4dbf3fe55412ca107b6f680e83706)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:25.078347 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b9bac-9abe-4d6b-97b7-fafb0eb369e6 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:25.297701 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-bf8b9bac-9abe-4d6b-97b7-fafb0eb369e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde4dbf3fe55412ca107b6f680e83706'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:25.298462 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-bf8b9bac-9abe-4d6b-97b7-fafb0eb369e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde4dbf3fe55412ca107b6f680e83706'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:25.310856 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-bf8b9bac-9abe-4d6b-97b7-fafb0eb369e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde4dbf3fe55412ca107b6f680e83706'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:25.317495 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-bf8b9bac-9abe-4d6b-97b7-fafb0eb369e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde4dbf3fe55412ca107b6f680e83706'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:25.318180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-bf8b9bac-9abe-4d6b-97b7-fafb0eb369e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde4dbf3fe55412ca107b6f680e83706'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:25.415159 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1324/2645] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:10:25 2022] DELETE /identity/v3/users/fde4dbf3fe55412ca107b6f680e83706 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:25.420022 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c99d12-01b8-47e1-a7f5-7a3df7179724 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:25.420306 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c99d12-01b8-47e1-a7f5-7a3df7179724 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:25.420591 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c99d12-01b8-47e1-a7f5-7a3df7179724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:25.438077 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-e5c99d12-01b8-47e1-a7f5-7a3df7179724 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:25.439290 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e5c99d12-01b8-47e1-a7f5-7a3df7179724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:25.499883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1322/2646] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:25.510137 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b9bac-9abe-4d6b-97b7-fafb0eb369e6 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:25.511600 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-bf8b9bac-9abe-4d6b-97b7-fafb0eb369e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:25.572233 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b9bac-9abe-4d6b-97b7-fafb0eb369e6 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:25.580500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8549e-749a-43db-be75-d5842be8b93c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:25.581188 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8549e-749a-43db-be75-d5842be8b93c service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:25.581469 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8549e-749a-43db-be75-d5842be8b93c service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:25.581744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8549e-749a-43db-be75-d5842be8b93c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:25.593722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8549e-749a-43db-be75-d5842be8b93c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:25.595461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8549e-749a-43db-be75-d5842be8b93c service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:25.608353 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1325/2647] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:10:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:10:26.189998 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c99d12-01b8-47e1-a7f5-7a3df7179724 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:26.191446 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e5c99d12-01b8-47e1-a7f5-7a3df7179724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:26.204892 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c99d12-01b8-47e1-a7f5-7a3df7179724 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:26.210534 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:26.211408 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:26.211691 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:26.211961 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7 admin admin] PATH_INFO: `/v3/projects/a908560c28d44c8197fbb853c0695a94` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:26.213226 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a908560c28d44c8197fbb853c0695a94)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:26.215164 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:26.415206 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a908560c28d44c8197fbb853c0695a94', 'request_id': 'req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:26.530216 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a908560c28d44c8197fbb853c0695a94', 'request_id': 'req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:26.537761 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a908560c28d44c8197fbb853c0695a94', 'request_id': 'req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:26.550324 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7 admin admin] The token cache is being invalidate because project a908560c28d44c8197fbb853c0695a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:10:26.550610 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:26.551284 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:26.553122 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1323/2648] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:10:26 2022] DELETE /identity/v3/projects/a908560c28d44c8197fbb853c0695a94 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:26.557513 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8549e-749a-43db-be75-d5842be8b93c service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:26.569301 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8549e-749a-43db-be75-d5842be8b93c service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:26.573823 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:26.575446 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:26.629605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639158f-48db-4e76-bcd0-72bd58545b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:26.630622 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639158f-48db-4e76-bcd0-72bd58545b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:26.630899 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639158f-48db-4e76-bcd0-72bd58545b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:26.631169 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639158f-48db-4e76-bcd0-72bd58545b27 admin admin] PATH_INFO: `/v3/users/d1670e1ba60f44519fcccaca70b3dc5d` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:26.632738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639158f-48db-4e76-bcd0-72bd58545b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1670e1ba60f44519fcccaca70b3dc5d)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:26.633905 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb96b2a-7991-4cca-a6a6-3af16f3a39b7 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:26.634786 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639158f-48db-4e76-bcd0-72bd58545b27 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:26.637839 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242c8a1-e644-49c3-8aa6-efbdcd0d99e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:26.638490 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242c8a1-e644-49c3-8aa6-efbdcd0d99e5 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:26.638771 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242c8a1-e644-49c3-8aa6-efbdcd0d99e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:26.639042 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242c8a1-e644-49c3-8aa6-efbdcd0d99e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:26.640869 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f242c8a1-e644-49c3-8aa6-efbdcd0d99e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:26.711383 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242c8a1-e644-49c3-8aa6-efbdcd0d99e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:26.712764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242c8a1-e644-49c3-8aa6-efbdcd0d99e5 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:26.722628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1324/2649] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:10:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:10:26.912437 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-1639158f-48db-4e76-bcd0-72bd58545b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1670e1ba60f44519fcccaca70b3dc5d'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:26.913158 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-1639158f-48db-4e76-bcd0-72bd58545b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1670e1ba60f44519fcccaca70b3dc5d'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:26.925328 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-1639158f-48db-4e76-bcd0-72bd58545b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1670e1ba60f44519fcccaca70b3dc5d'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:26.932267 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-1639158f-48db-4e76-bcd0-72bd58545b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1670e1ba60f44519fcccaca70b3dc5d'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:26.932964 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-1639158f-48db-4e76-bcd0-72bd58545b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1670e1ba60f44519fcccaca70b3dc5d'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:27.035549 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1326/2650] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:10:26 2022] DELETE /identity/v3/users/d1670e1ba60f44519fcccaca70b3dc5d => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:27.490358 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242c8a1-e644-49c3-8aa6-efbdcd0d99e5 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:27.492824 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f242c8a1-e644-49c3-8aa6-efbdcd0d99e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:27.506751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242c8a1-e644-49c3-8aa6-efbdcd0d99e5 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:27.567371 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0379381-e8f4-4a83-9b31-2ef36eecd6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:27.568815 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0379381-e8f4-4a83-9b31-2ef36eecd6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:27.570367 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0379381-e8f4-4a83-9b31-2ef36eecd6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:27.571310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0379381-e8f4-4a83-9b31-2ef36eecd6c5 admin admin] PATH_INFO: `/v3/projects/2009e94b5bbb4e0a86c673d72ffeac1a` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:27.573077 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0379381-e8f4-4a83-9b31-2ef36eecd6c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2009e94b5bbb4e0a86c673d72ffeac1a)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:27.576725 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0379381-e8f4-4a83-9b31-2ef36eecd6c5 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:27.716593 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e0379381-e8f4-4a83-9b31-2ef36eecd6c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2009e94b5bbb4e0a86c673d72ffeac1a', 'request_id': 'req-e0379381-e8f4-4a83-9b31-2ef36eecd6c5'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:27.836756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e0379381-e8f4-4a83-9b31-2ef36eecd6c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2009e94b5bbb4e0a86c673d72ffeac1a', 'request_id': 'req-e0379381-e8f4-4a83-9b31-2ef36eecd6c5'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:27.844251 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e0379381-e8f4-4a83-9b31-2ef36eecd6c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2009e94b5bbb4e0a86c673d72ffeac1a', 'request_id': 'req-e0379381-e8f4-4a83-9b31-2ef36eecd6c5'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:27.856938 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e0379381-e8f4-4a83-9b31-2ef36eecd6c5 admin admin] The token cache is being invalidate because project 2009e94b5bbb4e0a86c673d72ffeac1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:10:27.857242 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e0379381-e8f4-4a83-9b31-2ef36eecd6c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:27.857899 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e0379381-e8f4-4a83-9b31-2ef36eecd6c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:27.859478 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1325/2651] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:10:27 2022] DELETE /identity/v3/projects/2009e94b5bbb4e0a86c673d72ffeac1a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:27.864473 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6965d1-d0ba-4d29-b2f3-6efadd729d82 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:27.864979 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6965d1-d0ba-4d29-b2f3-6efadd729d82 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:27.865113 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6965d1-d0ba-4d29-b2f3-6efadd729d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:27.885242 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-1a6965d1-d0ba-4d29-b2f3-6efadd729d82 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:27.886738 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-1a6965d1-d0ba-4d29-b2f3-6efadd729d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:27.954473 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1327/2652] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:27.962425 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cffcf1-8ea9-42ed-bc23-88b3dd54c02d None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:27.962713 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cffcf1-8ea9-42ed-bc23-88b3dd54c02d None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:27.962992 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cffcf1-8ea9-42ed-bc23-88b3dd54c02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:27.983459 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-a1cffcf1-8ea9-42ed-bc23-88b3dd54c02d None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:27.984699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a1cffcf1-8ea9-42ed-bc23-88b3dd54c02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:27.993589 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1326/2653] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:27.997919 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6965d1-d0ba-4d29-b2f3-6efadd729d82 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:28.008007 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6965d1-d0ba-4d29-b2f3-6efadd729d82 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:28.012886 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7832a6-09b4-4201-bae7-529a18dec565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:28.013550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7832a6-09b4-4201-bae7-529a18dec565 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:28.013830 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7832a6-09b4-4201-bae7-529a18dec565 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:28.014104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7832a6-09b4-4201-bae7-529a18dec565 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:28.014836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7832a6-09b4-4201-bae7-529a18dec565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:10:28.015297 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7832a6-09b4-4201-bae7-529a18dec565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:28.016923 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7832a6-09b4-4201-bae7-529a18dec565 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:28.029025 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1328/2654] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:10:28.033419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cffcf1-8ea9-42ed-bc23-88b3dd54c02d None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:28.044120 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cffcf1-8ea9-42ed-bc23-88b3dd54c02d None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:28.049014 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd38f95-71c8-4577-9014-0a92a67be20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:28.049718 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd38f95-71c8-4577-9014-0a92a67be20d admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:28.049999 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd38f95-71c8-4577-9014-0a92a67be20d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:28.050280 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd38f95-71c8-4577-9014-0a92a67be20d admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:28.051007 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd38f95-71c8-4577-9014-0a92a67be20d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:28.052965 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd38f95-71c8-4577-9014-0a92a67be20d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:28.178195 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1327/2655] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:10:28 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:10:28.182935 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7832a6-09b4-4201-bae7-529a18dec565 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:28.193346 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7832a6-09b4-4201-bae7-529a18dec565 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:28.253078 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34691d82-d165-4fd3-9e6a-dc7500683d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:28.253749 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34691d82-d165-4fd3-9e6a-dc7500683d08 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:28.254026 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34691d82-d165-4fd3-9e6a-dc7500683d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:28.254294 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34691d82-d165-4fd3-9e6a-dc7500683d08 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:28.254984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34691d82-d165-4fd3-9e6a-dc7500683d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:28.257005 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34691d82-d165-4fd3-9e6a-dc7500683d08 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:28.385707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1329/2656] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:10:28 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:10:28.390078 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd38f95-71c8-4577-9014-0a92a67be20d admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:28.401906 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd38f95-71c8-4577-9014-0a92a67be20d admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:28.406721 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8f3d1-7b7a-4290-8020-88fab5c3c321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:28.407454 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8f3d1-7b7a-4290-8020-88fab5c3c321 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:28.407763 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8f3d1-7b7a-4290-8020-88fab5c3c321 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:28.408073 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8f3d1-7b7a-4290-8020-88fab5c3c321 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:28.408866 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8f3d1-7b7a-4290-8020-88fab5c3c321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:28.410495 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8f3d1-7b7a-4290-8020-88fab5c3c321 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:28.423145 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1328/2657] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:28.427487 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34691d82-d165-4fd3-9e6a-dc7500683d08 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:28.438245 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34691d82-d165-4fd3-9e6a-dc7500683d08 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:28.443037 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733fe28-2404-4678-9ed6-f3b4751a0d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:28.443700 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733fe28-2404-4678-9ed6-f3b4751a0d76 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:28.444032 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733fe28-2404-4678-9ed6-f3b4751a0d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:28.444329 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733fe28-2404-4678-9ed6-f3b4751a0d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:28.445506 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733fe28-2404-4678-9ed6-f3b4751a0d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:28.447117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733fe28-2404-4678-9ed6-f3b4751a0d76 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:28.457236 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1330/2658] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:28.462195 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8f3d1-7b7a-4290-8020-88fab5c3c321 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:28.472907 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8f3d1-7b7a-4290-8020-88fab5c3c321 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:28.478570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edad0a-737c-44ab-a2b7-240688ec4560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:28.479452 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edad0a-737c-44ab-a2b7-240688ec4560 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:28.479731 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edad0a-737c-44ab-a2b7-240688ec4560 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:28.480002 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edad0a-737c-44ab-a2b7-240688ec4560 admin admin] PATH_INFO: `/v3/projects/824277db4d0a44688b1d5577b1554c5a/users/40e8aed13c8844358b53bc96ffd42b4e/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:28.495866 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edad0a-737c-44ab-a2b7-240688ec4560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=824277db4d0a44688b1d5577b1554c5a, user_id=40e8aed13c8844358b53bc96ffd42b4e, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:28.498570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edad0a-737c-44ab-a2b7-240688ec4560 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:28.578113 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1329/2659] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:10:28 2022] PUT /identity/v3/projects/824277db4d0a44688b1d5577b1554c5a/users/40e8aed13c8844358b53bc96ffd42b4e/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:28.590326 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6b692-1a44-46c4-b530-e1f7c1e13606 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:28.590610 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6b692-1a44-46c4-b530-e1f7c1e13606 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:28.590884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6b692-1a44-46c4-b530-e1f7c1e13606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:28.618445 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-77c6b692-1a44-46c4-b530-e1f7c1e13606 None None] MFA Rules not processed for user `40e8aed13c8844358b53bc96ffd42b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:28.620482 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-77c6b692-1a44-46c4-b530-e1f7c1e13606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:28.693484 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1331/2660] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:28.698831 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edad0a-737c-44ab-a2b7-240688ec4560 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:28.774379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edad0a-737c-44ab-a2b7-240688ec4560 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:28.779250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f5d9e-890a-493f-819b-fb8c29ba047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:28.779906 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f5d9e-890a-493f-819b-fb8c29ba047f admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:28.780359 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f5d9e-890a-493f-819b-fb8c29ba047f admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:28.780661 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f5d9e-890a-493f-819b-fb8c29ba047f admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:28.781381 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f5d9e-890a-493f-819b-fb8c29ba047f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:28.783253 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f5d9e-890a-493f-819b-fb8c29ba047f admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:28.958858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1330/2661] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:10:28 2022] POST /identity/v3/projects => generated 381 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:10:28.969349 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6b692-1a44-46c4-b530-e1f7c1e13606 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:28.981904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6b692-1a44-46c4-b530-e1f7c1e13606 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:29.044547 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdcc18-5e82-496b-8691-0b6c2a604cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:29.045244 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdcc18-5e82-496b-8691-0b6c2a604cfd admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:29.045943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdcc18-5e82-496b-8691-0b6c2a604cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:29.045943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdcc18-5e82-496b-8691-0b6c2a604cfd admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:29.046499 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdcc18-5e82-496b-8691-0b6c2a604cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:29.048412 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdcc18-5e82-496b-8691-0b6c2a604cfd admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:29.180933 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1332/2662] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:10:28 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:10:29.185061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f5d9e-890a-493f-819b-fb8c29ba047f admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:29.197239 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f5d9e-890a-493f-819b-fb8c29ba047f admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:29.201967 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad91d45-a84e-4eb9-b109-6d01d6ae2b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:29.202669 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad91d45-a84e-4eb9-b109-6d01d6ae2b6c admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:29.206417 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad91d45-a84e-4eb9-b109-6d01d6ae2b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:29.206417 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad91d45-a84e-4eb9-b109-6d01d6ae2b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:29.206417 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad91d45-a84e-4eb9-b109-6d01d6ae2b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:29.206417 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad91d45-a84e-4eb9-b109-6d01d6ae2b6c admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:29.217319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1331/2663] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:29.221829 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdcc18-5e82-496b-8691-0b6c2a604cfd admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:29.232601 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdcc18-5e82-496b-8691-0b6c2a604cfd admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:29.237411 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2f30c-285d-404c-9d0d-cc5f0edf2b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:29.238296 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f30c-285d-404c-9d0d-cc5f0edf2b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:29.238576 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f30c-285d-404c-9d0d-cc5f0edf2b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:29.240828 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f30c-285d-404c-9d0d-cc5f0edf2b73 admin admin] PATH_INFO: `/v3/projects/adfba35426b94850b714abb6918ef8d3/users/f10a7b74557247cb9a8748eed1c415dd/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:29.255240 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2f30c-285d-404c-9d0d-cc5f0edf2b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfba35426b94850b714abb6918ef8d3, user_id=f10a7b74557247cb9a8748eed1c415dd, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:29.259032 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2f30c-285d-404c-9d0d-cc5f0edf2b73 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:29.369243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1333/2664] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:10:29 2022] PUT /identity/v3/projects/adfba35426b94850b714abb6918ef8d3/users/f10a7b74557247cb9a8748eed1c415dd/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:10:29.373407 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad91d45-a84e-4eb9-b109-6d01d6ae2b6c admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:29.388264 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad91d45-a84e-4eb9-b109-6d01d6ae2b6c admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:29.446120 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835080a1-dd1b-4371-af6f-a7835806654c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:29.446849 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835080a1-dd1b-4371-af6f-a7835806654c admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:29.447123 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835080a1-dd1b-4371-af6f-a7835806654c admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:29.447395 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835080a1-dd1b-4371-af6f-a7835806654c admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:29.448120 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835080a1-dd1b-4371-af6f-a7835806654c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:29.449742 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835080a1-dd1b-4371-af6f-a7835806654c admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:29.459570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1332/2665] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:29.464442 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2f30c-285d-404c-9d0d-cc5f0edf2b73 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:29.475839 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2f30c-285d-404c-9d0d-cc5f0edf2b73 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:29.481188 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2b9f7-d42f-4569-8ac8-284129edf87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:29.482205 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2b9f7-d42f-4569-8ac8-284129edf87b admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:29.482485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2b9f7-d42f-4569-8ac8-284129edf87b admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:29.482760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2b9f7-d42f-4569-8ac8-284129edf87b admin admin] PATH_INFO: `/v3/projects/adfba35426b94850b714abb6918ef8d3/users/f10a7b74557247cb9a8748eed1c415dd/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:29.484825 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2b9f7-d42f-4569-8ac8-284129edf87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfba35426b94850b714abb6918ef8d3, user_id=f10a7b74557247cb9a8748eed1c415dd, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:29.487488 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2b9f7-d42f-4569-8ac8-284129edf87b admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:29.504202 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1334/2666] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:10:29 2022] PUT /identity/v3/projects/adfba35426b94850b714abb6918ef8d3/users/f10a7b74557247cb9a8748eed1c415dd/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:10:29.514749 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb488b5f-bffb-4826-904c-4dfd58eba68a None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:29.515277 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb488b5f-bffb-4826-904c-4dfd58eba68a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:29.515277 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb488b5f-bffb-4826-904c-4dfd58eba68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:29.544078 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-cb488b5f-bffb-4826-904c-4dfd58eba68a None None] MFA Rules not processed for user `f10a7b74557247cb9a8748eed1c415dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:29.545362 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-cb488b5f-bffb-4826-904c-4dfd58eba68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:29.617807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1333/2667] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:29.769730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2b9f7-d42f-4569-8ac8-284129edf87b admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:29.771713 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-a7c2b9f7-d42f-4569-8ac8-284129edf87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:29.836416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2b9f7-d42f-4569-8ac8-284129edf87b admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:29.840360 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39918ca7-5588-4230-a2e9-b542045f515d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:29.841077 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39918ca7-5588-4230-a2e9-b542045f515d service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:29.841361 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39918ca7-5588-4230-a2e9-b542045f515d service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:29.841631 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39918ca7-5588-4230-a2e9-b542045f515d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:29.852469 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39918ca7-5588-4230-a2e9-b542045f515d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:29.854032 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39918ca7-5588-4230-a2e9-b542045f515d service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:29.865825 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1335/2668] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:10:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:10:30.599042 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb488b5f-bffb-4826-904c-4dfd58eba68a None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:30.664471 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb488b5f-bffb-4826-904c-4dfd58eba68a None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:30.669111 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e42d13-daf0-4c15-8baa-2337392d649d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:30.669985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e42d13-daf0-4c15-8baa-2337392d649d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:30.670259 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e42d13-daf0-4c15-8baa-2337392d649d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:30.670530 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e42d13-daf0-4c15-8baa-2337392d649d admin admin] PATH_INFO: `/v3/users/40e8aed13c8844358b53bc96ffd42b4e` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:30.671724 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e42d13-daf0-4c15-8baa-2337392d649d admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e8aed13c8844358b53bc96ffd42b4e)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:30.673673 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e42d13-daf0-4c15-8baa-2337392d649d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:30.982805 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-43e42d13-daf0-4c15-8baa-2337392d649d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e8aed13c8844358b53bc96ffd42b4e'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:30.983391 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-43e42d13-daf0-4c15-8baa-2337392d649d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e8aed13c8844358b53bc96ffd42b4e'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:31.008700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-43e42d13-daf0-4c15-8baa-2337392d649d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e8aed13c8844358b53bc96ffd42b4e'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:31.015976 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-43e42d13-daf0-4c15-8baa-2337392d649d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e8aed13c8844358b53bc96ffd42b4e'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:31.020543 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-43e42d13-daf0-4c15-8baa-2337392d649d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e8aed13c8844358b53bc96ffd42b4e'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:31.165509 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1334/2669] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:10:30 2022] DELETE /identity/v3/users/40e8aed13c8844358b53bc96ffd42b4e => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:31.170235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b55b5f-e62b-41bd-bf25-ef72f3fbe518 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:31.170719 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b55b5f-e62b-41bd-bf25-ef72f3fbe518 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:31.170830 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b55b5f-e62b-41bd-bf25-ef72f3fbe518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:31.196809 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-b5b55b5f-e62b-41bd-bf25-ef72f3fbe518 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:31.240277 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b5b55b5f-e62b-41bd-bf25-ef72f3fbe518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:31.258704 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1336/2670] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:31.270030 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e42d13-daf0-4c15-8baa-2337392d649d admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:31.271563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-43e42d13-daf0-4c15-8baa-2337392d649d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:31.332271 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e42d13-daf0-4c15-8baa-2337392d649d admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:31.337417 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad564d68-7548-4a46-8a8e-3af5b2be7b5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:31.338193 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad564d68-7548-4a46-8a8e-3af5b2be7b5c service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:31.338474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad564d68-7548-4a46-8a8e-3af5b2be7b5c service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:31.338750 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad564d68-7548-4a46-8a8e-3af5b2be7b5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:31.349041 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad564d68-7548-4a46-8a8e-3af5b2be7b5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:31.351089 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad564d68-7548-4a46-8a8e-3af5b2be7b5c service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:31.362536 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1335/2671] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:10:31.837143 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b55b5f-e62b-41bd-bf25-ef72f3fbe518 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:31.839072 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b5b55b5f-e62b-41bd-bf25-ef72f3fbe518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:31.855571 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b55b5f-e62b-41bd-bf25-ef72f3fbe518 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:31.868644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab298595-bfc9-465e-9a44-e18d4065ed89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:31.868644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab298595-bfc9-465e-9a44-e18d4065ed89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:31.868644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab298595-bfc9-465e-9a44-e18d4065ed89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:31.868644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab298595-bfc9-465e-9a44-e18d4065ed89 admin admin] PATH_INFO: `/v3/projects/824277db4d0a44688b1d5577b1554c5a` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:31.870570 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab298595-bfc9-465e-9a44-e18d4065ed89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=824277db4d0a44688b1d5577b1554c5a)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:31.870570 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab298595-bfc9-465e-9a44-e18d4065ed89 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:31.871467 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad564d68-7548-4a46-8a8e-3af5b2be7b5c service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:31.873080 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ad564d68-7548-4a46-8a8e-3af5b2be7b5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:31.934137 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad564d68-7548-4a46-8a8e-3af5b2be7b5c service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:31.937812 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9ffd3-f7cc-4df9-8605-89f9c4f319ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:31.938450 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9ffd3-f7cc-4df9-8605-89f9c4f319ef service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:31.938728 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9ffd3-f7cc-4df9-8605-89f9c4f319ef service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:31.938998 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9ffd3-f7cc-4df9-8605-89f9c4f319ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:31.940804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-abf9ffd3-f7cc-4df9-8605-89f9c4f319ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:31.994434 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ab298595-bfc9-465e-9a44-e18d4065ed89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824277db4d0a44688b1d5577b1554c5a', 'request_id': 'req-ab298595-bfc9-465e-9a44-e18d4065ed89'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:32.020117 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9ffd3-f7cc-4df9-8605-89f9c4f319ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:32.021572 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9ffd3-f7cc-4df9-8605-89f9c4f319ef service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:32.031139 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1336/2672] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:10:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:10:32.118864 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ab298595-bfc9-465e-9a44-e18d4065ed89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824277db4d0a44688b1d5577b1554c5a', 'request_id': 'req-ab298595-bfc9-465e-9a44-e18d4065ed89'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:32.125844 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ab298595-bfc9-465e-9a44-e18d4065ed89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824277db4d0a44688b1d5577b1554c5a', 'request_id': 'req-ab298595-bfc9-465e-9a44-e18d4065ed89'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:32.137501 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ab298595-bfc9-465e-9a44-e18d4065ed89 admin admin] The token cache is being invalidate because project 824277db4d0a44688b1d5577b1554c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:10:32.137795 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ab298595-bfc9-465e-9a44-e18d4065ed89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:32.138569 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-ab298595-bfc9-465e-9a44-e18d4065ed89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:32.140096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1337/2673] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:10:31 2022] DELETE /identity/v3/projects/824277db4d0a44688b1d5577b1554c5a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:32.144031 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9ffd3-f7cc-4df9-8605-89f9c4f319ef service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:32.155367 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9ffd3-f7cc-4df9-8605-89f9c4f319ef service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:32.219895 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ea360-54bc-4351-bfed-8f6027a0c707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:32.220802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ea360-54bc-4351-bfed-8f6027a0c707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:32.221341 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ea360-54bc-4351-bfed-8f6027a0c707 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:32.221615 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ea360-54bc-4351-bfed-8f6027a0c707 admin admin] PATH_INFO: `/v3/users/f10a7b74557247cb9a8748eed1c415dd` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:32.222866 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ea360-54bc-4351-bfed-8f6027a0c707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f10a7b74557247cb9a8748eed1c415dd)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:32.224990 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ea360-54bc-4351-bfed-8f6027a0c707 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:32.434457 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-475ea360-54bc-4351-bfed-8f6027a0c707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f10a7b74557247cb9a8748eed1c415dd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:32.435237 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-475ea360-54bc-4351-bfed-8f6027a0c707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f10a7b74557247cb9a8748eed1c415dd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:32.448148 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-475ea360-54bc-4351-bfed-8f6027a0c707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f10a7b74557247cb9a8748eed1c415dd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:32.455524 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-475ea360-54bc-4351-bfed-8f6027a0c707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f10a7b74557247cb9a8748eed1c415dd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:32.456257 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-475ea360-54bc-4351-bfed-8f6027a0c707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f10a7b74557247cb9a8748eed1c415dd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:32.564052 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1337/2674] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:10:32 2022] DELETE /identity/v3/users/f10a7b74557247cb9a8748eed1c415dd => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:32.771605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab298595-bfc9-465e-9a44-e18d4065ed89 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:32.773865 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ab298595-bfc9-465e-9a44-e18d4065ed89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:32.787314 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab298595-bfc9-465e-9a44-e18d4065ed89 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:32.857602 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e432cf1-00c5-4aa4-8424-140ff852228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:32.858797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e432cf1-00c5-4aa4-8424-140ff852228e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:32.859084 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e432cf1-00c5-4aa4-8424-140ff852228e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:32.859365 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e432cf1-00c5-4aa4-8424-140ff852228e admin admin] PATH_INFO: `/v3/users/9ff0501864f3417c86a6e3f58d9223fa` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:32.861001 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e432cf1-00c5-4aa4-8424-140ff852228e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ff0501864f3417c86a6e3f58d9223fa)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:32.863282 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e432cf1-00c5-4aa4-8424-140ff852228e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:33.066606 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ea360-54bc-4351-bfed-8f6027a0c707 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:33.068149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-475ea360-54bc-4351-bfed-8f6027a0c707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:33.089127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ea360-54bc-4351-bfed-8f6027a0c707 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:33.095346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c11e3a-4118-49a4-96c0-6a2edac31dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:33.097608 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c11e3a-4118-49a4-96c0-6a2edac31dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:33.100400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c11e3a-4118-49a4-96c0-6a2edac31dde admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:33.100400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c11e3a-4118-49a4-96c0-6a2edac31dde admin admin] PATH_INFO: `/v3/projects/adfba35426b94850b714abb6918ef8d3` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:33.100830 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c11e3a-4118-49a4-96c0-6a2edac31dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=adfba35426b94850b714abb6918ef8d3)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:33.103108 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c11e3a-4118-49a4-96c0-6a2edac31dde admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:33.165635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9e432cf1-00c5-4aa4-8424-140ff852228e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ff0501864f3417c86a6e3f58d9223fa'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:33.166441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9e432cf1-00c5-4aa4-8424-140ff852228e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ff0501864f3417c86a6e3f58d9223fa'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:33.180872 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9e432cf1-00c5-4aa4-8424-140ff852228e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ff0501864f3417c86a6e3f58d9223fa'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:33.188051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9e432cf1-00c5-4aa4-8424-140ff852228e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ff0501864f3417c86a6e3f58d9223fa'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:33.188843 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9e432cf1-00c5-4aa4-8424-140ff852228e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ff0501864f3417c86a6e3f58d9223fa'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:33.269764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-45c11e3a-4118-49a4-96c0-6a2edac31dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adfba35426b94850b714abb6918ef8d3', 'request_id': 'req-45c11e3a-4118-49a4-96c0-6a2edac31dde'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:33.288280 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1338/2675] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:10:32 2022] DELETE /identity/v3/users/9ff0501864f3417c86a6e3f58d9223fa => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:33.292944 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c64709-c04a-47ab-a2cb-3ca92e0ace7d None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:33.293313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c64709-c04a-47ab-a2cb-3ca92e0ace7d None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:33.293626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c64709-c04a-47ab-a2cb-3ca92e0ace7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:33.313075 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-86c64709-c04a-47ab-a2cb-3ca92e0ace7d None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:33.314286 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-86c64709-c04a-47ab-a2cb-3ca92e0ace7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:33.374358 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1339/2676] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:10:33.379222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-45c11e3a-4118-49a4-96c0-6a2edac31dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adfba35426b94850b714abb6918ef8d3', 'request_id': 'req-45c11e3a-4118-49a4-96c0-6a2edac31dde'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:33.385409 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c64709-c04a-47ab-a2cb-3ca92e0ace7d None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:33.386823 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-86c64709-c04a-47ab-a2cb-3ca92e0ace7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:33.387310 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-45c11e3a-4118-49a4-96c0-6a2edac31dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adfba35426b94850b714abb6918ef8d3', 'request_id': 'req-45c11e3a-4118-49a4-96c0-6a2edac31dde'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:33.398534 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-45c11e3a-4118-49a4-96c0-6a2edac31dde admin admin] The token cache is being invalidate because project adfba35426b94850b714abb6918ef8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:10:33.398813 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-45c11e3a-4118-49a4-96c0-6a2edac31dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:33.399465 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-45c11e3a-4118-49a4-96c0-6a2edac31dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:33.401042 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1338/2677] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:10:33 2022] DELETE /identity/v3/projects/adfba35426b94850b714abb6918ef8d3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:10:33.407283 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dface212-ec17-437c-8e42-ef1bf28e151a None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:33.407817 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dface212-ec17-437c-8e42-ef1bf28e151a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:33.408127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dface212-ec17-437c-8e42-ef1bf28e151a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:33.426820 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-dface212-ec17-437c-8e42-ef1bf28e151a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:33.428365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-dface212-ec17-437c-8e42-ef1bf28e151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:33.436665 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1339/2678] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:10:33.446295 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e67c5-1572-40cf-a8c8-72949fc2f139 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:33.446570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e67c5-1572-40cf-a8c8-72949fc2f139 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:33.446843 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e67c5-1572-40cf-a8c8-72949fc2f139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:33.450059 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c64709-c04a-47ab-a2cb-3ca92e0ace7d None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:33.454086 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a80e0-b7c8-40b0-abed-d5c96e771988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:33.454702 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a80e0-b7c8-40b0-abed-d5c96e771988 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:33.455013 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a80e0-b7c8-40b0-abed-d5c96e771988 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:33.455352 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a80e0-b7c8-40b0-abed-d5c96e771988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:33.457195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c94a80e0-b7c8-40b0-abed-d5c96e771988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:33.466475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-5d9e67c5-1572-40cf-a8c8-72949fc2f139 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:33.467679 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5d9e67c5-1572-40cf-a8c8-72949fc2f139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:33.471620 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a80e0-b7c8-40b0-abed-d5c96e771988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:33.473113 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a80e0-b7c8-40b0-abed-d5c96e771988 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:33.477348 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1340/2679] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:10:33.481851 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e67c5-1572-40cf-a8c8-72949fc2f139 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:33.484891 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1340/2680] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:10:33.493669 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e67c5-1572-40cf-a8c8-72949fc2f139 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:33.499132 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca6b51-ae14-459f-a55a-2f6883ba329d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:33.499937 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca6b51-ae14-459f-a55a-2f6883ba329d admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:33.500309 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca6b51-ae14-459f-a55a-2f6883ba329d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:33.500547 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca6b51-ae14-459f-a55a-2f6883ba329d admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:33.501586 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca6b51-ae14-459f-a55a-2f6883ba329d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:10:33.501938 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca6b51-ae14-459f-a55a-2f6883ba329d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:33.503809 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca6b51-ae14-459f-a55a-2f6883ba329d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:33.519037 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1341/2681] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:10:33.530909 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a80e0-b7c8-40b0-abed-d5c96e771988 service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:33.536253 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a80e0-b7c8-40b0-abed-d5c96e771988 service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:33.541483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2e730-0d1d-4407-adf4-2514828f0adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:33.542308 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2e730-0d1d-4407-adf4-2514828f0adf admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:33.542594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2e730-0d1d-4407-adf4-2514828f0adf admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:33.542905 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2e730-0d1d-4407-adf4-2514828f0adf admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:33.543637 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2e730-0d1d-4407-adf4-2514828f0adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:33.545726 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2e730-0d1d-4407-adf4-2514828f0adf admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:33.705805 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1341/2682] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:10:33 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:10:33.714173 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca6b51-ae14-459f-a55a-2f6883ba329d admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:33.725631 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca6b51-ae14-459f-a55a-2f6883ba329d admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:33.816911 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ad360-8d53-4790-b0a4-f7460959ad7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:33.817700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ad360-8d53-4790-b0a4-f7460959ad7c admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:33.817989 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ad360-8d53-4790-b0a4-f7460959ad7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:33.818294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ad360-8d53-4790-b0a4-f7460959ad7c admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:33.819674 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ad360-8d53-4790-b0a4-f7460959ad7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:33.822436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ad360-8d53-4790-b0a4-f7460959ad7c admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:33.945547 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1342/2683] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:10:33 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:10:33.947465 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2e730-0d1d-4407-adf4-2514828f0adf admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:33.962247 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2e730-0d1d-4407-adf4-2514828f0adf admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:33.967227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bd9c8-aabb-44d5-b19f-4c0791feaad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:33.967903 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bd9c8-aabb-44d5-b19f-4c0791feaad4 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:33.968181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bd9c8-aabb-44d5-b19f-4c0791feaad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:33.968454 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bd9c8-aabb-44d5-b19f-4c0791feaad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:33.969258 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bd9c8-aabb-44d5-b19f-4c0791feaad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:33.970904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bd9c8-aabb-44d5-b19f-4c0791feaad4 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:33.994820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1342/2684] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:33.999195 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ad360-8d53-4790-b0a4-f7460959ad7c admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:34.010235 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ad360-8d53-4790-b0a4-f7460959ad7c admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:34.017214 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36499b-8af4-4ada-99dc-e11dd4a0a7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:34.018187 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36499b-8af4-4ada-99dc-e11dd4a0a7df admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:34.018481 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36499b-8af4-4ada-99dc-e11dd4a0a7df admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:34.018763 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36499b-8af4-4ada-99dc-e11dd4a0a7df admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:34.019518 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36499b-8af4-4ada-99dc-e11dd4a0a7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:34.021176 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36499b-8af4-4ada-99dc-e11dd4a0a7df admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:34.032186 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1343/2685] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:34.036665 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bd9c8-aabb-44d5-b19f-4c0791feaad4 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:34.048431 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bd9c8-aabb-44d5-b19f-4c0791feaad4 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:34.054856 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f9936-2312-478d-8b31-72370c2a0457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:34.055760 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f9936-2312-478d-8b31-72370c2a0457 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:34.057472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f9936-2312-478d-8b31-72370c2a0457 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:34.057472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f9936-2312-478d-8b31-72370c2a0457 admin admin] PATH_INFO: `/v3/projects/bb5ebc0e71c0412a80ea72177b63881f/users/8bab9ce17b0c4e1db32a977c99fe98a6/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:34.064928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36499b-8af4-4ada-99dc-e11dd4a0a7df admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:34.067116 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-3a36499b-8af4-4ada-99dc-e11dd4a0a7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:34.074335 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f9936-2312-478d-8b31-72370c2a0457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5ebc0e71c0412a80ea72177b63881f, user_id=8bab9ce17b0c4e1db32a977c99fe98a6, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:34.077102 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f9936-2312-478d-8b31-72370c2a0457 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:34.082624 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36499b-8af4-4ada-99dc-e11dd4a0a7df admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:34.090500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d199db-b303-4a15-88d8-f31e212716fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:34.091401 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d199db-b303-4a15-88d8-f31e212716fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:34.091699 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d199db-b303-4a15-88d8-f31e212716fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:34.092127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d199db-b303-4a15-88d8-f31e212716fb admin admin] PATH_INFO: `/v3/projects/1cd7c00c14c94b32a264217df480065e` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:34.093338 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d199db-b303-4a15-88d8-f31e212716fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cd7c00c14c94b32a264217df480065e)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:34.095446 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d199db-b303-4a15-88d8-f31e212716fb admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:34.211701 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1343/2686] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:10:34 2022] PUT /identity/v3/projects/bb5ebc0e71c0412a80ea72177b63881f/users/8bab9ce17b0c4e1db32a977c99fe98a6/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:34.222344 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd4c31-34ee-4d54-8e21-8cd4a5951ed4 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:34.222635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd4c31-34ee-4d54-8e21-8cd4a5951ed4 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:34.223020 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd4c31-34ee-4d54-8e21-8cd4a5951ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:34.253226 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-32fd4c31-34ee-4d54-8e21-8cd4a5951ed4 None None] MFA Rules not processed for user `8bab9ce17b0c4e1db32a977c99fe98a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:34.254531 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-32fd4c31-34ee-4d54-8e21-8cd4a5951ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:34.275189 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-39d199db-b303-4a15-88d8-f31e212716fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cd7c00c14c94b32a264217df480065e', 'request_id': 'req-39d199db-b303-4a15-88d8-f31e212716fb'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:34.333908 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1344/2687] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:10:34.348563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd4c31-34ee-4d54-8e21-8cd4a5951ed4 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:34.350121 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-32fd4c31-34ee-4d54-8e21-8cd4a5951ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:34.353739 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-39d199db-b303-4a15-88d8-f31e212716fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cd7c00c14c94b32a264217df480065e', 'request_id': 'req-39d199db-b303-4a15-88d8-f31e212716fb'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:34.362028 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-39d199db-b303-4a15-88d8-f31e212716fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cd7c00c14c94b32a264217df480065e', 'request_id': 'req-39d199db-b303-4a15-88d8-f31e212716fb'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:34.378329 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-39d199db-b303-4a15-88d8-f31e212716fb admin admin] The token cache is being invalidate because project 1cd7c00c14c94b32a264217df480065e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:10:34.378623 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-39d199db-b303-4a15-88d8-f31e212716fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:34.379481 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-39d199db-b303-4a15-88d8-f31e212716fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:34.382548 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1344/2688] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:10:34 2022] DELETE /identity/v3/projects/1cd7c00c14c94b32a264217df480065e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:10:34.387298 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d199db-b303-4a15-88d8-f31e212716fb admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:34.388894 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-39d199db-b303-4a15-88d8-f31e212716fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:34.418346 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd4c31-34ee-4d54-8e21-8cd4a5951ed4 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:34.462189 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d199db-b303-4a15-88d8-f31e212716fb admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:34.468490 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e38fef-28b1-42a5-800e-9228294aab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:34.471210 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e38fef-28b1-42a5-800e-9228294aab80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:34.471210 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e38fef-28b1-42a5-800e-9228294aab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:34.471210 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e38fef-28b1-42a5-800e-9228294aab80 admin admin] PATH_INFO: `/v3/users/d53b287021eb428a9dd55cf64f8ed671` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:34.471637 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e38fef-28b1-42a5-800e-9228294aab80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d53b287021eb428a9dd55cf64f8ed671)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:34.471740 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87782b5e-4ea5-43c7-a77a-e3c29804b2e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:34.472387 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87782b5e-4ea5-43c7-a77a-e3c29804b2e4 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:34.472728 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87782b5e-4ea5-43c7-a77a-e3c29804b2e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:34.472942 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87782b5e-4ea5-43c7-a77a-e3c29804b2e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:34.473817 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e38fef-28b1-42a5-800e-9228294aab80 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:34.475006 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-87782b5e-4ea5-43c7-a77a-e3c29804b2e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:34.539310 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87782b5e-4ea5-43c7-a77a-e3c29804b2e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:34.540836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87782b5e-4ea5-43c7-a77a-e3c29804b2e4 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:34.550667 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1345/2689] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:10:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:10:34.576122 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87782b5e-4ea5-43c7-a77a-e3c29804b2e4 service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:34.577597 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-87782b5e-4ea5-43c7-a77a-e3c29804b2e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:34.592009 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87782b5e-4ea5-43c7-a77a-e3c29804b2e4 service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:34.597532 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c76073-8d94-4668-bb08-a9dc00115092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:34.598493 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c76073-8d94-4668-bb08-a9dc00115092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:34.598777 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c76073-8d94-4668-bb08-a9dc00115092 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:34.599051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c76073-8d94-4668-bb08-a9dc00115092 admin admin] PATH_INFO: `/v3/users/8bab9ce17b0c4e1db32a977c99fe98a6` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:34.600428 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c76073-8d94-4668-bb08-a9dc00115092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bab9ce17b0c4e1db32a977c99fe98a6)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:34.602447 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c76073-8d94-4668-bb08-a9dc00115092 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:34.761657 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-b2e38fef-28b1-42a5-800e-9228294aab80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd53b287021eb428a9dd55cf64f8ed671'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:34.762276 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-b2e38fef-28b1-42a5-800e-9228294aab80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd53b287021eb428a9dd55cf64f8ed671'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:34.774381 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-b2e38fef-28b1-42a5-800e-9228294aab80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd53b287021eb428a9dd55cf64f8ed671'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:34.781068 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-b2e38fef-28b1-42a5-800e-9228294aab80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd53b287021eb428a9dd55cf64f8ed671'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:34.781703 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-b2e38fef-28b1-42a5-800e-9228294aab80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd53b287021eb428a9dd55cf64f8ed671'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:35.003618 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1345/2690] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:10:34 2022] DELETE /identity/v3/users/d53b287021eb428a9dd55cf64f8ed671 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:35.066990 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d5c76073-8d94-4668-bb08-a9dc00115092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bab9ce17b0c4e1db32a977c99fe98a6'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:35.068435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d5c76073-8d94-4668-bb08-a9dc00115092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bab9ce17b0c4e1db32a977c99fe98a6'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:35.082469 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d5c76073-8d94-4668-bb08-a9dc00115092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bab9ce17b0c4e1db32a977c99fe98a6'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:35.090828 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d5c76073-8d94-4668-bb08-a9dc00115092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bab9ce17b0c4e1db32a977c99fe98a6'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:35.094616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d5c76073-8d94-4668-bb08-a9dc00115092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bab9ce17b0c4e1db32a977c99fe98a6'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:35.251364 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1346/2691] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:10:34 2022] DELETE /identity/v3/users/8bab9ce17b0c4e1db32a977c99fe98a6 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:10:35.256087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b866154-47f1-4d23-adf7-1fb7dbca232a None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:35.257418 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b866154-47f1-4d23-adf7-1fb7dbca232a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:35.257603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b866154-47f1-4d23-adf7-1fb7dbca232a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:35.277597 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-4b866154-47f1-4d23-adf7-1fb7dbca232a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:35.281347 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-4b866154-47f1-4d23-adf7-1fb7dbca232a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:35.361804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1346/2692] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:10:35.372074 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c76073-8d94-4668-bb08-a9dc00115092 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:35.376963 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d5c76073-8d94-4668-bb08-a9dc00115092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:35.499246 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c76073-8d94-4668-bb08-a9dc00115092 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:35.505375 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f4f00-5e1f-40d6-b0ba-d6537580f5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:35.506351 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f4f00-5e1f-40d6-b0ba-d6537580f5ca service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:35.506735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f4f00-5e1f-40d6-b0ba-d6537580f5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:35.507769 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f4f00-5e1f-40d6-b0ba-d6537580f5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:35.522398 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f4f00-5e1f-40d6-b0ba-d6537580f5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:35.527062 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f4f00-5e1f-40d6-b0ba-d6537580f5ca service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:35.539307 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1347/2693] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:10:35.685240 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b866154-47f1-4d23-adf7-1fb7dbca232a None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:35.685240 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-4b866154-47f1-4d23-adf7-1fb7dbca232a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:35.697061 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b866154-47f1-4d23-adf7-1fb7dbca232a None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:35.703055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3176e4-cd51-4543-ac9d-fd70cc126744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:35.704513 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3176e4-cd51-4543-ac9d-fd70cc126744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:35.705272 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3176e4-cd51-4543-ac9d-fd70cc126744 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:35.705786 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3176e4-cd51-4543-ac9d-fd70cc126744 admin admin] PATH_INFO: `/v3/projects/6e17288b16724257997d85bd70912f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:35.718261 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3176e4-cd51-4543-ac9d-fd70cc126744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e17288b16724257997d85bd70912f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:35.721554 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3176e4-cd51-4543-ac9d-fd70cc126744 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:35.884358 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6c3176e4-cd51-4543-ac9d-fd70cc126744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e17288b16724257997d85bd70912f78', 'request_id': 'req-6c3176e4-cd51-4543-ac9d-fd70cc126744'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:35.970816 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6c3176e4-cd51-4543-ac9d-fd70cc126744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e17288b16724257997d85bd70912f78', 'request_id': 'req-6c3176e4-cd51-4543-ac9d-fd70cc126744'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:35.978951 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6c3176e4-cd51-4543-ac9d-fd70cc126744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e17288b16724257997d85bd70912f78', 'request_id': 'req-6c3176e4-cd51-4543-ac9d-fd70cc126744'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:35.999838 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6c3176e4-cd51-4543-ac9d-fd70cc126744 admin admin] The token cache is being invalidate because project 6e17288b16724257997d85bd70912f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:10:36.000250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6c3176e4-cd51-4543-ac9d-fd70cc126744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:36.002700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6c3176e4-cd51-4543-ac9d-fd70cc126744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:36.004556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1347/2694] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:10:35 2022] DELETE /identity/v3/projects/6e17288b16724257997d85bd70912f78 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:36.009472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f4f00-5e1f-40d6-b0ba-d6537580f5ca service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:36.021508 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f4f00-5e1f-40d6-b0ba-d6537580f5ca service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:36.099365 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d338ac-4b9f-4997-8db7-700f52ed898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:36.101147 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d338ac-4b9f-4997-8db7-700f52ed898f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:36.101985 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d338ac-4b9f-4997-8db7-700f52ed898f admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:36.102571 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d338ac-4b9f-4997-8db7-700f52ed898f admin admin] PATH_INFO: `/v3/users/6403dcbf8a2f4c599e8fd5cbd4106822` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:36.105504 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d338ac-4b9f-4997-8db7-700f52ed898f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6403dcbf8a2f4c599e8fd5cbd4106822)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:36.109318 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d338ac-4b9f-4997-8db7-700f52ed898f admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:36.276704 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3176e4-cd51-4543-ac9d-fd70cc126744 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:36.281624 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-6c3176e4-cd51-4543-ac9d-fd70cc126744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:36.305495 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3176e4-cd51-4543-ac9d-fd70cc126744 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:36.316210 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7777eb-8226-43c7-9565-8e56861c04fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:36.316210 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7777eb-8226-43c7-9565-8e56861c04fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:36.316210 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7777eb-8226-43c7-9565-8e56861c04fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:36.316210 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7777eb-8226-43c7-9565-8e56861c04fb admin admin] PATH_INFO: `/v3/projects/bb5ebc0e71c0412a80ea72177b63881f` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:36.317424 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7777eb-8226-43c7-9565-8e56861c04fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5ebc0e71c0412a80ea72177b63881f)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:36.319646 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7777eb-8226-43c7-9565-8e56861c04fb admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:36.379888 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-a6d338ac-4b9f-4997-8db7-700f52ed898f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6403dcbf8a2f4c599e8fd5cbd4106822'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:36.380670 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-a6d338ac-4b9f-4997-8db7-700f52ed898f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6403dcbf8a2f4c599e8fd5cbd4106822'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:36.394306 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-a6d338ac-4b9f-4997-8db7-700f52ed898f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6403dcbf8a2f4c599e8fd5cbd4106822'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:36.401257 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-a6d338ac-4b9f-4997-8db7-700f52ed898f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6403dcbf8a2f4c599e8fd5cbd4106822'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:36.402131 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-a6d338ac-4b9f-4997-8db7-700f52ed898f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6403dcbf8a2f4c599e8fd5cbd4106822'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:36.531190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-8f7777eb-8226-43c7-9565-8e56861c04fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5ebc0e71c0412a80ea72177b63881f', 'request_id': 'req-8f7777eb-8226-43c7-9565-8e56861c04fb'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:36.557108 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1348/2695] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:10:36 2022] DELETE /identity/v3/users/6403dcbf8a2f4c599e8fd5cbd4106822 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:10:36.687925 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-8f7777eb-8226-43c7-9565-8e56861c04fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5ebc0e71c0412a80ea72177b63881f', 'request_id': 'req-8f7777eb-8226-43c7-9565-8e56861c04fb'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:36.695194 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-8f7777eb-8226-43c7-9565-8e56861c04fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5ebc0e71c0412a80ea72177b63881f', 'request_id': 'req-8f7777eb-8226-43c7-9565-8e56861c04fb'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:36.705871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-8f7777eb-8226-43c7-9565-8e56861c04fb admin admin] The token cache is being invalidate because project bb5ebc0e71c0412a80ea72177b63881f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:10:36.706160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-8f7777eb-8226-43c7-9565-8e56861c04fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:36.706846 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-8f7777eb-8226-43c7-9565-8e56861c04fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:36.708439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1348/2696] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:10:36 2022] DELETE /identity/v3/projects/bb5ebc0e71c0412a80ea72177b63881f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:10:36.714068 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ef289-a78b-4538-b0e1-96cf194913cc None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:36.714354 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ef289-a78b-4538-b0e1-96cf194913cc None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:36.714634 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ef289-a78b-4538-b0e1-96cf194913cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:36.733820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-089ef289-a78b-4538-b0e1-96cf194913cc None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:36.735024 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-089ef289-a78b-4538-b0e1-96cf194913cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:36.799172 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1349/2697] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:36.806955 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0ff76-8c38-44b9-916e-ebb97ea83c21 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:36.807247 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0ff76-8c38-44b9-916e-ebb97ea83c21 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:36.807524 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0ff76-8c38-44b9-916e-ebb97ea83c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:36.826533 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-edf0ff76-8c38-44b9-916e-ebb97ea83c21 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:36.829187 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-edf0ff76-8c38-44b9-916e-ebb97ea83c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:36.837259 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1349/2698] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:36.841823 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ef289-a78b-4538-b0e1-96cf194913cc None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:36.851896 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ef289-a78b-4538-b0e1-96cf194913cc None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:36.856647 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0536fcb-47b8-4628-8acf-ddbc493afc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:36.857443 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0536fcb-47b8-4628-8acf-ddbc493afc7c admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:36.857588 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0536fcb-47b8-4628-8acf-ddbc493afc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:36.857831 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0536fcb-47b8-4628-8acf-ddbc493afc7c admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:36.858692 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0536fcb-47b8-4628-8acf-ddbc493afc7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:10:36.858995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0536fcb-47b8-4628-8acf-ddbc493afc7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:36.860609 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0536fcb-47b8-4628-8acf-ddbc493afc7c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:36.873485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1350/2699] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:10:36.877601 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0ff76-8c38-44b9-916e-ebb97ea83c21 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:36.887508 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0ff76-8c38-44b9-916e-ebb97ea83c21 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:36.892153 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f87a31-3a34-4f18-9104-b67c0c0c58b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:36.892839 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f87a31-3a34-4f18-9104-b67c0c0c58b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:36.893121 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f87a31-3a34-4f18-9104-b67c0c0c58b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:36.893392 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f87a31-3a34-4f18-9104-b67c0c0c58b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:36.894075 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f87a31-3a34-4f18-9104-b67c0c0c58b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:36.895960 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f87a31-3a34-4f18-9104-b67c0c0c58b4 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:37.017341 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0536fcb-47b8-4628-8acf-ddbc493afc7c admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:37.019095 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f0536fcb-47b8-4628-8acf-ddbc493afc7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:37.033241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0536fcb-47b8-4628-8acf-ddbc493afc7c admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:37.038052 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42876f72-c495-4030-af54-97e51545f4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:37.038896 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42876f72-c495-4030-af54-97e51545f4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:37.039180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42876f72-c495-4030-af54-97e51545f4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:37.039455 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42876f72-c495-4030-af54-97e51545f4e3 admin admin] PATH_INFO: `/v3/projects/79eec3a72976402f8f21434922469e57` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:37.040715 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42876f72-c495-4030-af54-97e51545f4e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79eec3a72976402f8f21434922469e57)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:37.042628 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42876f72-c495-4030-af54-97e51545f4e3 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:37.059355 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1350/2700] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:10:36 2022] POST /identity/v3/projects => generated 391 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:10:37.060232 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f87a31-3a34-4f18-9104-b67c0c0c58b4 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:37.123806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f87a31-3a34-4f18-9104-b67c0c0c58b4 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:37.128680 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244534c5-486a-46bd-ae7e-66f6e05f7678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:37.129367 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244534c5-486a-46bd-ae7e-66f6e05f7678 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:37.129649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244534c5-486a-46bd-ae7e-66f6e05f7678 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:37.129924 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244534c5-486a-46bd-ae7e-66f6e05f7678 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:37.130617 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244534c5-486a-46bd-ae7e-66f6e05f7678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:37.133178 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244534c5-486a-46bd-ae7e-66f6e05f7678 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:37.154620 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-42876f72-c495-4030-af54-97e51545f4e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79eec3a72976402f8f21434922469e57', 'request_id': 'req-42876f72-c495-4030-af54-97e51545f4e3'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:37.225998 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1351/2701] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:10:37 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:10:37.229866 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244534c5-486a-46bd-ae7e-66f6e05f7678 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:37.241496 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244534c5-486a-46bd-ae7e-66f6e05f7678 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:37.255682 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-42876f72-c495-4030-af54-97e51545f4e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79eec3a72976402f8f21434922469e57', 'request_id': 'req-42876f72-c495-4030-af54-97e51545f4e3'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:37.263905 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-42876f72-c495-4030-af54-97e51545f4e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79eec3a72976402f8f21434922469e57', 'request_id': 'req-42876f72-c495-4030-af54-97e51545f4e3'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:37.274884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-42876f72-c495-4030-af54-97e51545f4e3 admin admin] The token cache is being invalidate because project 79eec3a72976402f8f21434922469e57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:10:37.275170 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-42876f72-c495-4030-af54-97e51545f4e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:37.275870 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-42876f72-c495-4030-af54-97e51545f4e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:37.277587 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1351/2702] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:10:37 2022] DELETE /identity/v3/projects/79eec3a72976402f8f21434922469e57 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:37.282466 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad867c66-a665-47df-b719-6cd8019616d0 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:37.285758 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad867c66-a665-47df-b719-6cd8019616d0 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:37.285758 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad867c66-a665-47df-b719-6cd8019616d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:37.298605 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d4790-fe7f-4405-9e9a-0b35e95106ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:37.299288 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4790-fe7f-4405-9e9a-0b35e95106ba admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:37.299570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4790-fe7f-4405-9e9a-0b35e95106ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:37.299847 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4790-fe7f-4405-9e9a-0b35e95106ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:37.300599 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d4790-fe7f-4405-9e9a-0b35e95106ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:37.302193 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d4790-fe7f-4405-9e9a-0b35e95106ba admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:37.302590 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-ad867c66-a665-47df-b719-6cd8019616d0 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:37.304564 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-ad867c66-a665-47df-b719-6cd8019616d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:37.316454 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1352/2703] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:37.323403 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1352/2704] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:10:37.323572 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d4790-fe7f-4405-9e9a-0b35e95106ba admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:37.323572 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-bb6d4790-fe7f-4405-9e9a-0b35e95106ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:37.325456 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff9be5-fecc-4a1b-b64c-9794616eb21f None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:37.325742 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff9be5-fecc-4a1b-b64c-9794616eb21f None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:37.326022 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff9be5-fecc-4a1b-b64c-9794616eb21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:37.332943 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d4790-fe7f-4405-9e9a-0b35e95106ba admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:37.337964 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd8b98-97fb-43a5-9042-e5bb407866e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:37.338626 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd8b98-97fb-43a5-9042-e5bb407866e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:37.338909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd8b98-97fb-43a5-9042-e5bb407866e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:37.339183 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd8b98-97fb-43a5-9042-e5bb407866e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:37.339907 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd8b98-97fb-43a5-9042-e5bb407866e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:37.341573 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd8b98-97fb-43a5-9042-e5bb407866e5 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:37.344906 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-8aff9be5-fecc-4a1b-b64c-9794616eb21f None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:37.346368 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8aff9be5-fecc-4a1b-b64c-9794616eb21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:37.352002 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1353/2705] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 22:10:37.356139 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd8b98-97fb-43a5-9042-e5bb407866e5 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:37.359184 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1353/2706] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:37.368972 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd8b98-97fb-43a5-9042-e5bb407866e5 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:37.371120 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff9be5-fecc-4a1b-b64c-9794616eb21f None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:37.374483 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c18e35-d645-4d45-b63f-5b53f54edea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:37.375555 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c18e35-d645-4d45-b63f-5b53f54edea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:37.375679 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c18e35-d645-4d45-b63f-5b53f54edea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:37.375917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c18e35-d645-4d45-b63f-5b53f54edea7 admin admin] PATH_INFO: `/v3/projects/b86343009b99484da0059d5009bbbc82/users/3b37216cac3b4642852d6467966fedbd/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:37.380894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff9be5-fecc-4a1b-b64c-9794616eb21f None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:37.387018 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3331f1-ac5e-4444-a2ff-cc2399a45689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:37.387677 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3331f1-ac5e-4444-a2ff-cc2399a45689 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:37.387964 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3331f1-ac5e-4444-a2ff-cc2399a45689 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:37.388230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3331f1-ac5e-4444-a2ff-cc2399a45689 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:37.388994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3331f1-ac5e-4444-a2ff-cc2399a45689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:10:37.389305 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3331f1-ac5e-4444-a2ff-cc2399a45689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:37.390940 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3331f1-ac5e-4444-a2ff-cc2399a45689 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:37.394660 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c18e35-d645-4d45-b63f-5b53f54edea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86343009b99484da0059d5009bbbc82, user_id=3b37216cac3b4642852d6467966fedbd, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:37.397490 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c18e35-d645-4d45-b63f-5b53f54edea7 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:37.404235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1354/2707] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 22:10:37.408603 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3331f1-ac5e-4444-a2ff-cc2399a45689 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:37.419410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3331f1-ac5e-4444-a2ff-cc2399a45689 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:37.424090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e332d-f493-4afa-83cb-3f166aa22764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:37.424770 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e332d-f493-4afa-83cb-3f166aa22764 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:37.425048 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e332d-f493-4afa-83cb-3f166aa22764 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:37.425318 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e332d-f493-4afa-83cb-3f166aa22764 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:37.426064 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e332d-f493-4afa-83cb-3f166aa22764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:37.427958 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e332d-f493-4afa-83cb-3f166aa22764 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:37.496729 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1354/2708] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:10:37 2022] PUT /identity/v3/projects/b86343009b99484da0059d5009bbbc82/users/3b37216cac3b4642852d6467966fedbd/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:37.507888 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4277353-8d17-42a9-b010-1597a0d296fb None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:37.508175 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4277353-8d17-42a9-b010-1597a0d296fb None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:37.508455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4277353-8d17-42a9-b010-1597a0d296fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:37.533224 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1355/2709] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:10:37 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:10:37.535127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-b4277353-8d17-42a9-b010-1597a0d296fb None None] MFA Rules not processed for user `3b37216cac3b4642852d6467966fedbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:37.536326 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b4277353-8d17-42a9-b010-1597a0d296fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:37.537111 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e332d-f493-4afa-83cb-3f166aa22764 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:37.599280 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e332d-f493-4afa-83cb-3f166aa22764 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:37.604052 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1355/2710] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:10:37.604414 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae264f-f09f-4dee-b4b4-e2bfd1b32e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:37.605194 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae264f-f09f-4dee-b4b4-e2bfd1b32e24 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:37.605480 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae264f-f09f-4dee-b4b4-e2bfd1b32e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:37.605754 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae264f-f09f-4dee-b4b4-e2bfd1b32e24 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:37.606484 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae264f-f09f-4dee-b4b4-e2bfd1b32e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:37.608542 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae264f-f09f-4dee-b4b4-e2bfd1b32e24 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:37.615257 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4277353-8d17-42a9-b010-1597a0d296fb None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:37.617128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b4277353-8d17-42a9-b010-1597a0d296fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:37.678983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4277353-8d17-42a9-b010-1597a0d296fb None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:37.682882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a1455-9b89-49e7-b834-37ca28578004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:37.683536 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a1455-9b89-49e7-b834-37ca28578004 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:37.683816 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a1455-9b89-49e7-b834-37ca28578004 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:37.684091 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a1455-9b89-49e7-b834-37ca28578004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:37.693002 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a1455-9b89-49e7-b834-37ca28578004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:37.694976 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a1455-9b89-49e7-b834-37ca28578004 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:37.704607 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1356/2711] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:10:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:10:37.753655 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1356/2712] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:10:37 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:10:37.757885 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a1455-9b89-49e7-b834-37ca28578004 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:37.768922 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a1455-9b89-49e7-b834-37ca28578004 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:37.775087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944458e-8c4e-4ee8-b98f-748ae1feb038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:37.775087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944458e-8c4e-4ee8-b98f-748ae1feb038 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:37.775457 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944458e-8c4e-4ee8-b98f-748ae1feb038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:37.775797 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944458e-8c4e-4ee8-b98f-748ae1feb038 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:37.776616 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944458e-8c4e-4ee8-b98f-748ae1feb038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:37.783381 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944458e-8c4e-4ee8-b98f-748ae1feb038 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:37.794895 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1357/2713] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:37.800057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae264f-f09f-4dee-b4b4-e2bfd1b32e24 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:37.811585 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae264f-f09f-4dee-b4b4-e2bfd1b32e24 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:37.816912 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a0e5e-9cbc-4977-a97c-ab86e5fc387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:37.817632 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a0e5e-9cbc-4977-a97c-ab86e5fc387c admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:37.817915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a0e5e-9cbc-4977-a97c-ab86e5fc387c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:37.818207 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a0e5e-9cbc-4977-a97c-ab86e5fc387c admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:37.819998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a0e5e-9cbc-4977-a97c-ab86e5fc387c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:37.821319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a0e5e-9cbc-4977-a97c-ab86e5fc387c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:37.831920 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1357/2714] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:37.836385 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944458e-8c4e-4ee8-b98f-748ae1feb038 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:37.847504 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944458e-8c4e-4ee8-b98f-748ae1feb038 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:37.856432 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667442b5-e24a-4f00-ad9f-fc7d50dd380a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:37.857301 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667442b5-e24a-4f00-ad9f-fc7d50dd380a admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:37.857610 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667442b5-e24a-4f00-ad9f-fc7d50dd380a admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:37.857888 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667442b5-e24a-4f00-ad9f-fc7d50dd380a admin admin] PATH_INFO: `/v3/projects/c377d1b47b1b4495b75ec3c04d542c2f/users/211eb91539204a5d97bf8144a0ede04b/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:37.874346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667442b5-e24a-4f00-ad9f-fc7d50dd380a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c377d1b47b1b4495b75ec3c04d542c2f, user_id=211eb91539204a5d97bf8144a0ede04b, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:37.877203 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667442b5-e24a-4f00-ad9f-fc7d50dd380a admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:37.975771 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1358/2715] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:10:37 2022] PUT /identity/v3/projects/c377d1b47b1b4495b75ec3c04d542c2f/users/211eb91539204a5d97bf8144a0ede04b/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:10:37.986424 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e083d3-095a-4cbe-854a-748b366d6776 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:37.986707 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e083d3-095a-4cbe-854a-748b366d6776 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:37.987040 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e083d3-095a-4cbe-854a-748b366d6776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:38.019019 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-c2e083d3-095a-4cbe-854a-748b366d6776 None None] MFA Rules not processed for user `211eb91539204a5d97bf8144a0ede04b`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:38.020307 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c2e083d3-095a-4cbe-854a-748b366d6776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:38.088080 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1358/2716] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:38.092646 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667442b5-e24a-4f00-ad9f-fc7d50dd380a admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:38.155343 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667442b5-e24a-4f00-ad9f-fc7d50dd380a admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:38.160195 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7334b2-be50-4537-b703-22dce4da2b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:38.160896 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7334b2-be50-4537-b703-22dce4da2b4b admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:38.161176 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7334b2-be50-4537-b703-22dce4da2b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:38.161450 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7334b2-be50-4537-b703-22dce4da2b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:38.162143 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7334b2-be50-4537-b703-22dce4da2b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:38.164853 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7334b2-be50-4537-b703-22dce4da2b4b admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:38.303866 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1359/2717] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:10:38 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:10:38.308257 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e083d3-095a-4cbe-854a-748b366d6776 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:38.320050 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e083d3-095a-4cbe-854a-748b366d6776 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:38.377978 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9249cf8-d8e1-4e5c-ba4a-784b275c085b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:38.378963 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9249cf8-d8e1-4e5c-ba4a-784b275c085b admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:38.379314 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9249cf8-d8e1-4e5c-ba4a-784b275c085b admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:38.379740 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9249cf8-d8e1-4e5c-ba4a-784b275c085b admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:38.380548 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9249cf8-d8e1-4e5c-ba4a-784b275c085b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:38.383498 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9249cf8-d8e1-4e5c-ba4a-784b275c085b admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:38.532929 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1359/2718] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:10:38 2022] POST /identity/v3/users => generated 292 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:10:38.541564 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7334b2-be50-4537-b703-22dce4da2b4b admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:38.551833 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7334b2-be50-4537-b703-22dce4da2b4b admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:38.557160 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5d2d1-5ce4-4152-819f-12153306a178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:38.557828 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5d2d1-5ce4-4152-819f-12153306a178 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:38.558102 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5d2d1-5ce4-4152-819f-12153306a178 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:38.562227 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5d2d1-5ce4-4152-819f-12153306a178 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:38.563234 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5d2d1-5ce4-4152-819f-12153306a178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:38.565136 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5d2d1-5ce4-4152-819f-12153306a178 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:38.577322 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1360/2719] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:38.581325 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9249cf8-d8e1-4e5c-ba4a-784b275c085b admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:38.592057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9249cf8-d8e1-4e5c-ba4a-784b275c085b admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:38.597005 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b04f19-6181-4fd1-94ab-dacdab2dc314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:38.597726 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b04f19-6181-4fd1-94ab-dacdab2dc314 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:38.597949 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b04f19-6181-4fd1-94ab-dacdab2dc314 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:38.598218 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b04f19-6181-4fd1-94ab-dacdab2dc314 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:38.598974 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b04f19-6181-4fd1-94ab-dacdab2dc314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:38.600685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b04f19-6181-4fd1-94ab-dacdab2dc314 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:38.610883 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1360/2720] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:38.614929 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5d2d1-5ce4-4152-819f-12153306a178 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:38.626638 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5d2d1-5ce4-4152-819f-12153306a178 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:38.651357 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb47587-acfe-4202-8859-5a5d2a526024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:38.651357 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb47587-acfe-4202-8859-5a5d2a526024 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:38.651357 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb47587-acfe-4202-8859-5a5d2a526024 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:38.651357 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb47587-acfe-4202-8859-5a5d2a526024 admin admin] PATH_INFO: `/v3/projects/a3c6c31eac0b42dd8ed04cd8882a3669/users/b70cd0fcd5984c308511b9eb8f018d45/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:38.656127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb47587-acfe-4202-8859-5a5d2a526024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c6c31eac0b42dd8ed04cd8882a3669, user_id=b70cd0fcd5984c308511b9eb8f018d45, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:38.659080 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb47587-acfe-4202-8859-5a5d2a526024 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:38.800261 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1361/2721] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:10:38 2022] PUT /identity/v3/projects/a3c6c31eac0b42dd8ed04cd8882a3669/users/b70cd0fcd5984c308511b9eb8f018d45/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:38.814201 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a55b25-b653-4cf1-910b-03865b8bbba2 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:38.814487 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a55b25-b653-4cf1-910b-03865b8bbba2 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:38.814763 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a55b25-b653-4cf1-910b-03865b8bbba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:38.841895 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-d5a55b25-b653-4cf1-910b-03865b8bbba2 None None] MFA Rules not processed for user `b70cd0fcd5984c308511b9eb8f018d45`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:38.843102 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d5a55b25-b653-4cf1-910b-03865b8bbba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:38.907319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1361/2722] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:38.911930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb47587-acfe-4202-8859-5a5d2a526024 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:38.977142 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb47587-acfe-4202-8859-5a5d2a526024 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:38.983835 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aaef87-cdb7-47e7-9ab3-69ae1aa3d115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:38.984628 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaef87-cdb7-47e7-9ab3-69ae1aa3d115 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:38.984920 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaef87-cdb7-47e7-9ab3-69ae1aa3d115 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:38.985202 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaef87-cdb7-47e7-9ab3-69ae1aa3d115 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:38.986029 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aaef87-cdb7-47e7-9ab3-69ae1aa3d115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:38.988359 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aaef87-cdb7-47e7-9ab3-69ae1aa3d115 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:39.166784 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1362/2723] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:10:38 2022] POST /identity/v3/projects => generated 385 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:10:39.170965 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a55b25-b653-4cf1-910b-03865b8bbba2 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:39.182349 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a55b25-b653-4cf1-910b-03865b8bbba2 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:39.243229 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd2a5b-ee2f-4924-ac41-a6bab38d2fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:39.244024 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd2a5b-ee2f-4924-ac41-a6bab38d2fdf admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:39.244284 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd2a5b-ee2f-4924-ac41-a6bab38d2fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:39.244560 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd2a5b-ee2f-4924-ac41-a6bab38d2fdf admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:39.245383 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd2a5b-ee2f-4924-ac41-a6bab38d2fdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:39.247462 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd2a5b-ee2f-4924-ac41-a6bab38d2fdf admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:39.342000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1362/2724] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:10:39 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:10:39.346321 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aaef87-cdb7-47e7-9ab3-69ae1aa3d115 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:39.357933 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aaef87-cdb7-47e7-9ab3-69ae1aa3d115 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:39.362985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfc5d9-b2ea-43c0-b84f-2b8c22f55011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:39.363660 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc5d9-b2ea-43c0-b84f-2b8c22f55011 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:39.363944 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc5d9-b2ea-43c0-b84f-2b8c22f55011 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:39.364223 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc5d9-b2ea-43c0-b84f-2b8c22f55011 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:39.364996 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfc5d9-b2ea-43c0-b84f-2b8c22f55011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:39.367213 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfc5d9-b2ea-43c0-b84f-2b8c22f55011 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:39.378297 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1363/2725] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:39.382545 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd2a5b-ee2f-4924-ac41-a6bab38d2fdf admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:39.392834 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd2a5b-ee2f-4924-ac41-a6bab38d2fdf admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:39.400058 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2856ff-2924-4cb2-9ae3-b7f88249771b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:39.400994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2856ff-2924-4cb2-9ae3-b7f88249771b admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:39.401276 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2856ff-2924-4cb2-9ae3-b7f88249771b admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:39.401552 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2856ff-2924-4cb2-9ae3-b7f88249771b admin admin] PATH_INFO: `/v3/projects/d3b4b98aa0a64f24ac64c83008cf34d1/users/db68a08fa4854d9d9d73a1ef2a969acc/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:39.421744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2856ff-2924-4cb2-9ae3-b7f88249771b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b4b98aa0a64f24ac64c83008cf34d1, user_id=db68a08fa4854d9d9d73a1ef2a969acc, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:39.424478 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2856ff-2924-4cb2-9ae3-b7f88249771b admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:39.516505 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1363/2726] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:10:39 2022] PUT /identity/v3/projects/d3b4b98aa0a64f24ac64c83008cf34d1/users/db68a08fa4854d9d9d73a1ef2a969acc/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:39.520623 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfc5d9-b2ea-43c0-b84f-2b8c22f55011 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:39.532185 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfc5d9-b2ea-43c0-b84f-2b8c22f55011 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:39.609377 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e680bde-b7d9-412d-a6e4-dcde9a7baadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:39.610059 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e680bde-b7d9-412d-a6e4-dcde9a7baadf admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:39.610344 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e680bde-b7d9-412d-a6e4-dcde9a7baadf admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:39.610624 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e680bde-b7d9-412d-a6e4-dcde9a7baadf admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:39.611365 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e680bde-b7d9-412d-a6e4-dcde9a7baadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:39.612988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e680bde-b7d9-412d-a6e4-dcde9a7baadf admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:39.624693 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1364/2727] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:10:39.629019 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2856ff-2924-4cb2-9ae3-b7f88249771b admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:39.640251 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2856ff-2924-4cb2-9ae3-b7f88249771b admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:39.644913 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958675f-ea58-4c6d-92a1-60c3d67bccc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:39.645786 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958675f-ea58-4c6d-92a1-60c3d67bccc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:39.646063 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958675f-ea58-4c6d-92a1-60c3d67bccc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:39.646331 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958675f-ea58-4c6d-92a1-60c3d67bccc6 admin admin] PATH_INFO: `/v3/projects/d3b4b98aa0a64f24ac64c83008cf34d1/users/db68a08fa4854d9d9d73a1ef2a969acc/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:39.649782 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958675f-ea58-4c6d-92a1-60c3d67bccc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b4b98aa0a64f24ac64c83008cf34d1, user_id=db68a08fa4854d9d9d73a1ef2a969acc, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:39.652416 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958675f-ea58-4c6d-92a1-60c3d67bccc6 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:39.664172 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1364/2728] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:10:39 2022] PUT /identity/v3/projects/d3b4b98aa0a64f24ac64c83008cf34d1/users/db68a08fa4854d9d9d73a1ef2a969acc/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:39.674590 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e125a2-ba06-4061-8f88-7441f8acdb9f None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:39.674873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e125a2-ba06-4061-8f88-7441f8acdb9f None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:39.675143 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e125a2-ba06-4061-8f88-7441f8acdb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:39.703538 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-f6e125a2-ba06-4061-8f88-7441f8acdb9f None None] MFA Rules not processed for user `db68a08fa4854d9d9d73a1ef2a969acc`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:39.704763 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f6e125a2-ba06-4061-8f88-7441f8acdb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:39.776128 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1365/2729] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:39.788297 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958675f-ea58-4c6d-92a1-60c3d67bccc6 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:39.790235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-a958675f-ea58-4c6d-92a1-60c3d67bccc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:39.849605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958675f-ea58-4c6d-92a1-60c3d67bccc6 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:39.853648 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dbb2d-ec81-4497-aa57-e54d3fa92318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:39.854293 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dbb2d-ec81-4497-aa57-e54d3fa92318 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:39.854575 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dbb2d-ec81-4497-aa57-e54d3fa92318 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:39.854849 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dbb2d-ec81-4497-aa57-e54d3fa92318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:39.911761 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0dbb2d-ec81-4497-aa57-e54d3fa92318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:39.913503 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0dbb2d-ec81-4497-aa57-e54d3fa92318 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:39.922868 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1365/2730] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:10:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:10:41.149857 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c69986-9665-462c-8793-c70795f8e2d2 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:41.150422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c69986-9665-462c-8793-c70795f8e2d2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:41.150422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c69986-9665-462c-8793-c70795f8e2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:41.169028 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-08c69986-9665-462c-8793-c70795f8e2d2 None None] MFA Rules not processed for user `1ae58a1764394f17a5599d5fed30ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:41.170259 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-08c69986-9665-462c-8793-c70795f8e2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:41.234191 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1366/2731] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:43.262058 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dbb2d-ec81-4497-aa57-e54d3fa92318 service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:43.272461 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dbb2d-ec81-4497-aa57-e54d3fa92318 service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:43.276239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305330e-c72f-4682-847c-797585af0849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:43.276924 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305330e-c72f-4682-847c-797585af0849 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:43.277363 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305330e-c72f-4682-847c-797585af0849 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:43.277662 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305330e-c72f-4682-847c-797585af0849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:43.340635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305330e-c72f-4682-847c-797585af0849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:43.342097 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305330e-c72f-4682-847c-797585af0849 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:43.351813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1366/2732] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:10:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:10:46.179856 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c69986-9665-462c-8793-c70795f8e2d2 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:46.189265 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c69986-9665-462c-8793-c70795f8e2d2 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:46.192829 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04cd4d-230a-4361-879b-8c8f4c7cf0b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:46.194060 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04cd4d-230a-4361-879b-8c8f4c7cf0b2 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:46.194060 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04cd4d-230a-4361-879b-8c8f4c7cf0b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:46.194568 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04cd4d-230a-4361-879b-8c8f4c7cf0b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:46.206769 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04cd4d-230a-4361-879b-8c8f4c7cf0b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:46.208263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04cd4d-230a-4361-879b-8c8f4c7cf0b2 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:46.218552 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1367/2733] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:10:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:10:59.362924 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305330e-c72f-4682-847c-797585af0849 service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:59.439630 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305330e-c72f-4682-847c-797585af0849 service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:59.445293 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556019b8-41c5-469e-b1a7-00366d5e4fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:59.446241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556019b8-41c5-469e-b1a7-00366d5e4fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:59.446594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556019b8-41c5-469e-b1a7-00366d5e4fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:59.446960 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556019b8-41c5-469e-b1a7-00366d5e4fdf admin admin] PATH_INFO: `/v3/users/211eb91539204a5d97bf8144a0ede04b` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:59.448494 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556019b8-41c5-469e-b1a7-00366d5e4fdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=211eb91539204a5d97bf8144a0ede04b)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:59.450282 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556019b8-41c5-469e-b1a7-00366d5e4fdf admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:10:59.702497 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-556019b8-41c5-469e-b1a7-00366d5e4fdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211eb91539204a5d97bf8144a0ede04b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:59.703165 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-556019b8-41c5-469e-b1a7-00366d5e4fdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211eb91539204a5d97bf8144a0ede04b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:59.716900 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-556019b8-41c5-469e-b1a7-00366d5e4fdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211eb91539204a5d97bf8144a0ede04b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:59.724634 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-556019b8-41c5-469e-b1a7-00366d5e4fdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211eb91539204a5d97bf8144a0ede04b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:59.724986 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-556019b8-41c5-469e-b1a7-00366d5e4fdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211eb91539204a5d97bf8144a0ede04b'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:10:59.822441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1367/2734] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:10:59 2022] DELETE /identity/v3/users/211eb91539204a5d97bf8144a0ede04b => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:10:59.827037 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864466b8-7c50-4a14-b184-5425d4eb66e8 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:59.827518 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864466b8-7c50-4a14-b184-5425d4eb66e8 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:59.827644 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864466b8-7c50-4a14-b184-5425d4eb66e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:59.844995 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-864466b8-7c50-4a14-b184-5425d4eb66e8 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:10:59.846499 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-864466b8-7c50-4a14-b184-5425d4eb66e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:59.906871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1368/2735] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:10:59.917084 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556019b8-41c5-469e-b1a7-00366d5e4fdf admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:10:59.918493 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-556019b8-41c5-469e-b1a7-00366d5e4fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:10:59.977410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556019b8-41c5-469e-b1a7-00366d5e4fdf admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:10:59.981329 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45386e98-407f-4dbd-a2e1-9b58ae14964e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:10:59.981975 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45386e98-407f-4dbd-a2e1-9b58ae14964e service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:10:59.982259 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45386e98-407f-4dbd-a2e1-9b58ae14964e service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:10:59.982610 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45386e98-407f-4dbd-a2e1-9b58ae14964e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:10:59.992821 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45386e98-407f-4dbd-a2e1-9b58ae14964e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:10:59.994256 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45386e98-407f-4dbd-a2e1-9b58ae14964e service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:00.004497 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1368/2736] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:11:00.475374 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864466b8-7c50-4a14-b184-5425d4eb66e8 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:00.476795 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-864466b8-7c50-4a14-b184-5425d4eb66e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:00.488923 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864466b8-7c50-4a14-b184-5425d4eb66e8 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:00.495552 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:00.496432 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:00.497295 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:00.497295 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976 admin admin] PATH_INFO: `/v3/projects/c377d1b47b1b4495b75ec3c04d542c2f` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:00.498354 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c377d1b47b1b4495b75ec3c04d542c2f)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:00.500319 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:00.772435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c377d1b47b1b4495b75ec3c04d542c2f', 'request_id': 'req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:00.893042 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c377d1b47b1b4495b75ec3c04d542c2f', 'request_id': 'req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:00.900122 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c377d1b47b1b4495b75ec3c04d542c2f', 'request_id': 'req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:00.910811 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976 admin admin] The token cache is being invalidate because project c377d1b47b1b4495b75ec3c04d542c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:11:00.911088 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:00.912261 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:00.913866 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1369/2737] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:11:00 2022] DELETE /identity/v3/projects/c377d1b47b1b4495b75ec3c04d542c2f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:11:00.917921 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45386e98-407f-4dbd-a2e1-9b58ae14964e service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:00.929561 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45386e98-407f-4dbd-a2e1-9b58ae14964e service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:00.992195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6f012-3780-4a87-b2db-5b171f39fc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:00.993119 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6f012-3780-4a87-b2db-5b171f39fc13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:00.993399 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6f012-3780-4a87-b2db-5b171f39fc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:00.993671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6f012-3780-4a87-b2db-5b171f39fc13 admin admin] PATH_INFO: `/v3/users/b70cd0fcd5984c308511b9eb8f018d45` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:00.994904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6f012-3780-4a87-b2db-5b171f39fc13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b70cd0fcd5984c308511b9eb8f018d45)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:00.996894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6f012-3780-4a87-b2db-5b171f39fc13 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:01.293576 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4fd6f012-3780-4a87-b2db-5b171f39fc13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b70cd0fcd5984c308511b9eb8f018d45'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:01.294169 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4fd6f012-3780-4a87-b2db-5b171f39fc13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b70cd0fcd5984c308511b9eb8f018d45'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:01.306146 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4fd6f012-3780-4a87-b2db-5b171f39fc13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b70cd0fcd5984c308511b9eb8f018d45'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:01.312865 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4fd6f012-3780-4a87-b2db-5b171f39fc13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b70cd0fcd5984c308511b9eb8f018d45'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:01.313511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-4fd6f012-3780-4a87-b2db-5b171f39fc13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b70cd0fcd5984c308511b9eb8f018d45'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:01.392917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1369/2738] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:11:00 2022] DELETE /identity/v3/users/b70cd0fcd5984c308511b9eb8f018d45 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:11:01.840928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:01.845539 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:01.858473 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0baf2c-308b-43f5-866c-c4d9fcf3e976 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:01.928889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b5a4c-b437-43ad-9533-7be9088bf622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:01.929747 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b5a4c-b437-43ad-9533-7be9088bf622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:01.930021 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b5a4c-b437-43ad-9533-7be9088bf622 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:01.930295 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b5a4c-b437-43ad-9533-7be9088bf622 admin admin] PATH_INFO: `/v3/projects/a3c6c31eac0b42dd8ed04cd8882a3669` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:01.931472 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b5a4c-b437-43ad-9533-7be9088bf622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3c6c31eac0b42dd8ed04cd8882a3669)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:01.933390 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b5a4c-b437-43ad-9533-7be9088bf622 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:02.062676 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d10b5a4c-b437-43ad-9533-7be9088bf622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3c6c31eac0b42dd8ed04cd8882a3669', 'request_id': 'req-d10b5a4c-b437-43ad-9533-7be9088bf622'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:02.132862 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d10b5a4c-b437-43ad-9533-7be9088bf622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3c6c31eac0b42dd8ed04cd8882a3669', 'request_id': 'req-d10b5a4c-b437-43ad-9533-7be9088bf622'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:02.139644 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d10b5a4c-b437-43ad-9533-7be9088bf622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3c6c31eac0b42dd8ed04cd8882a3669', 'request_id': 'req-d10b5a4c-b437-43ad-9533-7be9088bf622'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:02.151300 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d10b5a4c-b437-43ad-9533-7be9088bf622 admin admin] The token cache is being invalidate because project a3c6c31eac0b42dd8ed04cd8882a3669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:11:02.155467 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d10b5a4c-b437-43ad-9533-7be9088bf622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:02.155467 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d10b5a4c-b437-43ad-9533-7be9088bf622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:02.155467 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1370/2739] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:11:01 2022] DELETE /identity/v3/projects/a3c6c31eac0b42dd8ed04cd8882a3669 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:11:02.158817 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6f012-3780-4a87-b2db-5b171f39fc13 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:02.160278 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-4fd6f012-3780-4a87-b2db-5b171f39fc13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:02.174090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6f012-3780-4a87-b2db-5b171f39fc13 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:02.237138 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d21ea8-6e0a-4bf2-b82f-e352b2a27ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:02.238034 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d21ea8-6e0a-4bf2-b82f-e352b2a27ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:02.238314 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d21ea8-6e0a-4bf2-b82f-e352b2a27ded admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:02.238600 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d21ea8-6e0a-4bf2-b82f-e352b2a27ded admin admin] PATH_INFO: `/v3/users/db68a08fa4854d9d9d73a1ef2a969acc` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:02.240312 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d21ea8-6e0a-4bf2-b82f-e352b2a27ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=db68a08fa4854d9d9d73a1ef2a969acc)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:02.242328 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d21ea8-6e0a-4bf2-b82f-e352b2a27ded admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:02.482138 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-90d21ea8-6e0a-4bf2-b82f-e352b2a27ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db68a08fa4854d9d9d73a1ef2a969acc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:02.482889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-90d21ea8-6e0a-4bf2-b82f-e352b2a27ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db68a08fa4854d9d9d73a1ef2a969acc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:02.495427 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-90d21ea8-6e0a-4bf2-b82f-e352b2a27ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db68a08fa4854d9d9d73a1ef2a969acc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:02.502205 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-90d21ea8-6e0a-4bf2-b82f-e352b2a27ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db68a08fa4854d9d9d73a1ef2a969acc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:02.506789 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-90d21ea8-6e0a-4bf2-b82f-e352b2a27ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db68a08fa4854d9d9d73a1ef2a969acc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:02.655373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1370/2740] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:11:02 2022] DELETE /identity/v3/users/db68a08fa4854d9d9d73a1ef2a969acc => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:11:03.237645 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b5a4c-b437-43ad-9533-7be9088bf622 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:03.248342 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-d10b5a4c-b437-43ad-9533-7be9088bf622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:03.252947 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b5a4c-b437-43ad-9533-7be9088bf622 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:03.314751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2726c49-2a39-4411-832b-643b5d7984e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:03.315806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2726c49-2a39-4411-832b-643b5d7984e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:03.316131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2726c49-2a39-4411-832b-643b5d7984e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:03.316508 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2726c49-2a39-4411-832b-643b5d7984e9 admin admin] PATH_INFO: `/v3/projects/d3b4b98aa0a64f24ac64c83008cf34d1` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:03.322186 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2726c49-2a39-4411-832b-643b5d7984e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b4b98aa0a64f24ac64c83008cf34d1)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:03.328228 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2726c49-2a39-4411-832b-643b5d7984e9 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:03.452012 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d2726c49-2a39-4411-832b-643b5d7984e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b4b98aa0a64f24ac64c83008cf34d1', 'request_id': 'req-d2726c49-2a39-4411-832b-643b5d7984e9'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:03.522099 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d2726c49-2a39-4411-832b-643b5d7984e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b4b98aa0a64f24ac64c83008cf34d1', 'request_id': 'req-d2726c49-2a39-4411-832b-643b5d7984e9'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:03.528912 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d2726c49-2a39-4411-832b-643b5d7984e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b4b98aa0a64f24ac64c83008cf34d1', 'request_id': 'req-d2726c49-2a39-4411-832b-643b5d7984e9'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:03.540686 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d2726c49-2a39-4411-832b-643b5d7984e9 admin admin] The token cache is being invalidate because project d3b4b98aa0a64f24ac64c83008cf34d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:11:03.542741 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d2726c49-2a39-4411-832b-643b5d7984e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:03.542741 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d2726c49-2a39-4411-832b-643b5d7984e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:03.543385 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1371/2741] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:11:03 2022] DELETE /identity/v3/projects/d3b4b98aa0a64f24ac64c83008cf34d1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:11:03.548475 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5533069-902a-4514-b856-f57ec225031a None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:03.548996 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5533069-902a-4514-b856-f57ec225031a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:03.549110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5533069-902a-4514-b856-f57ec225031a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:03.567142 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-d5533069-902a-4514-b856-f57ec225031a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:11:03.568703 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d5533069-902a-4514-b856-f57ec225031a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:03.631404 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1371/2742] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:11:03.640972 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e3917-8271-49e0-886a-3eada2fba4a4 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:03.641284 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e3917-8271-49e0-886a-3eada2fba4a4 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:03.641515 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e3917-8271-49e0-886a-3eada2fba4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:03.662585 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-725e3917-8271-49e0-886a-3eada2fba4a4 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:11:03.663810 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-725e3917-8271-49e0-886a-3eada2fba4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:03.672460 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1372/2743] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:11:03.676844 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5533069-902a-4514-b856-f57ec225031a None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:03.687819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5533069-902a-4514-b856-f57ec225031a None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:03.692464 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad7683-73de-4dcc-8e85-3bf45848a12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:03.693256 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad7683-73de-4dcc-8e85-3bf45848a12d admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:03.693540 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad7683-73de-4dcc-8e85-3bf45848a12d admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:03.693817 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad7683-73de-4dcc-8e85-3bf45848a12d admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:03.694553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad7683-73de-4dcc-8e85-3bf45848a12d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:11:03.694858 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad7683-73de-4dcc-8e85-3bf45848a12d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:03.696498 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad7683-73de-4dcc-8e85-3bf45848a12d admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:03.709049 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1372/2744] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:11:03.713617 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e3917-8271-49e0-886a-3eada2fba4a4 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:03.723543 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e3917-8271-49e0-886a-3eada2fba4a4 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:03.729866 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da40aa-d1f1-440c-bf02-525f2162d172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:03.730555 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da40aa-d1f1-440c-bf02-525f2162d172 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:03.730834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da40aa-d1f1-440c-bf02-525f2162d172 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:03.731111 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da40aa-d1f1-440c-bf02-525f2162d172 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:03.731831 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da40aa-d1f1-440c-bf02-525f2162d172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:03.733985 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da40aa-d1f1-440c-bf02-525f2162d172 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:03.889778 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1373/2745] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:11:03 2022] POST /identity/v3/projects => generated 397 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:11:03.894562 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad7683-73de-4dcc-8e85-3bf45848a12d admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:03.906624 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad7683-73de-4dcc-8e85-3bf45848a12d admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:03.964984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fac06-8913-443f-92c5-68e4f92c9d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:03.965674 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fac06-8913-443f-92c5-68e4f92c9d2c admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:03.965959 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fac06-8913-443f-92c5-68e4f92c9d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:03.966237 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fac06-8913-443f-92c5-68e4f92c9d2c admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:03.966958 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fac06-8913-443f-92c5-68e4f92c9d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:03.969017 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fac06-8913-443f-92c5-68e4f92c9d2c admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:04.066930 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1373/2746] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:11:03 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:11:04.072009 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da40aa-d1f1-440c-bf02-525f2162d172 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:04.082700 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da40aa-d1f1-440c-bf02-525f2162d172 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:04.088051 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a051e2a-184f-4f71-a0f0-6ae50d7c92e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:04.088815 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a051e2a-184f-4f71-a0f0-6ae50d7c92e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:04.089093 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a051e2a-184f-4f71-a0f0-6ae50d7c92e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:04.089364 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a051e2a-184f-4f71-a0f0-6ae50d7c92e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:04.090085 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a051e2a-184f-4f71-a0f0-6ae50d7c92e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:04.091681 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a051e2a-184f-4f71-a0f0-6ae50d7c92e3 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:04.104720 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1374/2747] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:11:04.108785 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fac06-8913-443f-92c5-68e4f92c9d2c admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:04.119496 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fac06-8913-443f-92c5-68e4f92c9d2c admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:04.125068 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe148aa-3bcd-4099-9e13-e2a9102ce809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:04.125736 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe148aa-3bcd-4099-9e13-e2a9102ce809 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:04.126010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe148aa-3bcd-4099-9e13-e2a9102ce809 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:04.126278 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe148aa-3bcd-4099-9e13-e2a9102ce809 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:04.127006 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe148aa-3bcd-4099-9e13-e2a9102ce809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:04.128604 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe148aa-3bcd-4099-9e13-e2a9102ce809 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:04.140216 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1374/2748] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:11:04.144424 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a051e2a-184f-4f71-a0f0-6ae50d7c92e3 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:04.158679 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a051e2a-184f-4f71-a0f0-6ae50d7c92e3 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:04.164230 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ca733-2e91-45f1-83a3-48149bf9b760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:04.165259 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ca733-2e91-45f1-83a3-48149bf9b760 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:04.165547 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ca733-2e91-45f1-83a3-48149bf9b760 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:04.165934 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ca733-2e91-45f1-83a3-48149bf9b760 admin admin] PATH_INFO: `/v3/projects/6211462f27e24ee08fa5c5f43da12873/users/63f6c5d7a5534ac789d0dd802c309897/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:04.182948 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ca733-2e91-45f1-83a3-48149bf9b760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6211462f27e24ee08fa5c5f43da12873, user_id=63f6c5d7a5534ac789d0dd802c309897, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:04.186135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ca733-2e91-45f1-83a3-48149bf9b760 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:04.282079 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1375/2749] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:11:04 2022] PUT /identity/v3/projects/6211462f27e24ee08fa5c5f43da12873/users/63f6c5d7a5534ac789d0dd802c309897/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:11:04.292325 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db361e4-fe71-4d2e-a4e0-1e55eba59257 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:04.292688 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db361e4-fe71-4d2e-a4e0-1e55eba59257 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:04.293087 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db361e4-fe71-4d2e-a4e0-1e55eba59257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:04.322511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-3db361e4-fe71-4d2e-a4e0-1e55eba59257 None None] MFA Rules not processed for user `63f6c5d7a5534ac789d0dd802c309897`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:11:04.323755 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-3db361e4-fe71-4d2e-a4e0-1e55eba59257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:04.402127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ca733-2e91-45f1-83a3-48149bf9b760 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:04.403868 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-423ca733-2e91-45f1-83a3-48149bf9b760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:04.404283 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1375/2750] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:11:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:11:04.417651 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db361e4-fe71-4d2e-a4e0-1e55eba59257 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:04.419265 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-3db361e4-fe71-4d2e-a4e0-1e55eba59257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:04.476079 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ca733-2e91-45f1-83a3-48149bf9b760 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:04.481346 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1143d2-d3bd-461c-a72d-eb44f04508ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:04.481527 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db361e4-fe71-4d2e-a4e0-1e55eba59257 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:04.481802 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1143d2-d3bd-461c-a72d-eb44f04508ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:04.482085 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1143d2-d3bd-461c-a72d-eb44f04508ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:04.482376 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1143d2-d3bd-461c-a72d-eb44f04508ab admin admin] PATH_INFO: `/v3/users/3b37216cac3b4642852d6467966fedbd` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:04.483591 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1143d2-d3bd-461c-a72d-eb44f04508ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b37216cac3b4642852d6467966fedbd)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:04.485392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3357ee-b019-49ba-a77e-5589770375c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:04.485606 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1143d2-d3bd-461c-a72d-eb44f04508ab admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:04.485870 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3357ee-b019-49ba-a77e-5589770375c7 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:04.486153 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3357ee-b019-49ba-a77e-5589770375c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:04.486419 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3357ee-b019-49ba-a77e-5589770375c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:04.497616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3357ee-b019-49ba-a77e-5589770375c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:04.499057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3357ee-b019-49ba-a77e-5589770375c7 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:04.509075 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1376/2751] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:11:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:11:04.899209 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ab1143d2-d3bd-461c-a72d-eb44f04508ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b37216cac3b4642852d6467966fedbd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:04.899209 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ab1143d2-d3bd-461c-a72d-eb44f04508ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b37216cac3b4642852d6467966fedbd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:04.908825 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ab1143d2-d3bd-461c-a72d-eb44f04508ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b37216cac3b4642852d6467966fedbd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:04.916144 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ab1143d2-d3bd-461c-a72d-eb44f04508ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b37216cac3b4642852d6467966fedbd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:04.917946 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ab1143d2-d3bd-461c-a72d-eb44f04508ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b37216cac3b4642852d6467966fedbd'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:04.986421 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1376/2752] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:11:04 2022] DELETE /identity/v3/users/3b37216cac3b4642852d6467966fedbd => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:11:04.992091 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68392b50-9c0d-499a-bc4a-c2814eff18cb None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:04.992685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68392b50-9c0d-499a-bc4a-c2814eff18cb None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:04.992685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68392b50-9c0d-499a-bc4a-c2814eff18cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:05.010700 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-68392b50-9c0d-499a-bc4a-c2814eff18cb None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:11:05.012012 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-68392b50-9c0d-499a-bc4a-c2814eff18cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:05.070552 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1377/2753] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:11:05.080482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1143d2-d3bd-461c-a72d-eb44f04508ab admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:05.081893 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ab1143d2-d3bd-461c-a72d-eb44f04508ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:05.139867 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1143d2-d3bd-461c-a72d-eb44f04508ab admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:05.143523 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac4609-69ae-433c-8531-0f30480541a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:05.144168 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4609-69ae-433c-8531-0f30480541a2 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:05.144454 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4609-69ae-433c-8531-0f30480541a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:05.144780 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4609-69ae-433c-8531-0f30480541a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:05.153950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac4609-69ae-433c-8531-0f30480541a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:05.155328 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac4609-69ae-433c-8531-0f30480541a2 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:05.165102 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1377/2754] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:11:05.735006 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68392b50-9c0d-499a-bc4a-c2814eff18cb None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:05.738274 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-68392b50-9c0d-499a-bc4a-c2814eff18cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:05.751659 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68392b50-9c0d-499a-bc4a-c2814eff18cb None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:05.759200 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baf6d8-d255-42c8-b76f-8baf041d5ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:05.767573 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baf6d8-d255-42c8-b76f-8baf041d5ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:05.767898 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baf6d8-d255-42c8-b76f-8baf041d5ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:05.768154 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baf6d8-d255-42c8-b76f-8baf041d5ddc admin admin] PATH_INFO: `/v3/projects/b86343009b99484da0059d5009bbbc82` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:05.769724 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baf6d8-d255-42c8-b76f-8baf041d5ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b86343009b99484da0059d5009bbbc82)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:05.772893 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baf6d8-d255-42c8-b76f-8baf041d5ddc admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:05.904279 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-32baf6d8-d255-42c8-b76f-8baf041d5ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b86343009b99484da0059d5009bbbc82', 'request_id': 'req-32baf6d8-d255-42c8-b76f-8baf041d5ddc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:05.998706 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-32baf6d8-d255-42c8-b76f-8baf041d5ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b86343009b99484da0059d5009bbbc82', 'request_id': 'req-32baf6d8-d255-42c8-b76f-8baf041d5ddc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:06.006621 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-32baf6d8-d255-42c8-b76f-8baf041d5ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b86343009b99484da0059d5009bbbc82', 'request_id': 'req-32baf6d8-d255-42c8-b76f-8baf041d5ddc'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:06.018620 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-32baf6d8-d255-42c8-b76f-8baf041d5ddc admin admin] The token cache is being invalidate because project b86343009b99484da0059d5009bbbc82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:11:06.018984 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-32baf6d8-d255-42c8-b76f-8baf041d5ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:06.019801 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-32baf6d8-d255-42c8-b76f-8baf041d5ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:06.022067 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1378/2755] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:11:05 2022] DELETE /identity/v3/projects/b86343009b99484da0059d5009bbbc82 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:11:14.306893 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac4609-69ae-433c-8531-0f30480541a2 service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:14.308335 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e0ac4609-69ae-433c-8531-0f30480541a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:14.368530 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac4609-69ae-433c-8531-0f30480541a2 service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:14.418312 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f70d4-99dc-4e33-9d34-f1abea0ac40c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:14.418959 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f70d4-99dc-4e33-9d34-f1abea0ac40c service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:14.419326 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f70d4-99dc-4e33-9d34-f1abea0ac40c service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:14.419510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f70d4-99dc-4e33-9d34-f1abea0ac40c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:14.421304 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-751f70d4-99dc-4e33-9d34-f1abea0ac40c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:14.481989 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f70d4-99dc-4e33-9d34-f1abea0ac40c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:14.483348 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f70d4-99dc-4e33-9d34-f1abea0ac40c service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:14.492729 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1378/2756] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:11:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:11:14.825173 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baf6d8-d255-42c8-b76f-8baf041d5ddc admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:14.826626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-32baf6d8-d255-42c8-b76f-8baf041d5ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:14.890789 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baf6d8-d255-42c8-b76f-8baf041d5ddc admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:14.895603 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f42014-ebf6-493d-9bc1-d9b12e6f28ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:14.896429 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f42014-ebf6-493d-9bc1-d9b12e6f28ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:14.896744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f42014-ebf6-493d-9bc1-d9b12e6f28ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:14.897014 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f42014-ebf6-493d-9bc1-d9b12e6f28ab admin admin] PATH_INFO: `/v3/users/63f6c5d7a5534ac789d0dd802c309897` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:14.898223 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f42014-ebf6-493d-9bc1-d9b12e6f28ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f6c5d7a5534ac789d0dd802c309897)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:14.900339 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f42014-ebf6-493d-9bc1-d9b12e6f28ab admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:15.186777 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-78f42014-ebf6-493d-9bc1-d9b12e6f28ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f6c5d7a5534ac789d0dd802c309897'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:15.187433 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-78f42014-ebf6-493d-9bc1-d9b12e6f28ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f6c5d7a5534ac789d0dd802c309897'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:15.199483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-78f42014-ebf6-493d-9bc1-d9b12e6f28ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f6c5d7a5534ac789d0dd802c309897'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:15.206292 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-78f42014-ebf6-493d-9bc1-d9b12e6f28ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f6c5d7a5534ac789d0dd802c309897'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:15.206964 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-78f42014-ebf6-493d-9bc1-d9b12e6f28ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f6c5d7a5534ac789d0dd802c309897'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:15.302054 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1379/2757] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:11:14 2022] DELETE /identity/v3/users/63f6c5d7a5534ac789d0dd802c309897 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:11:15.307029 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8033766-de25-4216-b3ab-3c3fd24197d5 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:15.307664 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8033766-de25-4216-b3ab-3c3fd24197d5 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:15.307664 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8033766-de25-4216-b3ab-3c3fd24197d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:15.325250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-e8033766-de25-4216-b3ab-3c3fd24197d5 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:11:15.326490 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e8033766-de25-4216-b3ab-3c3fd24197d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:15.388112 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1379/2758] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:11:15.398308 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f42014-ebf6-493d-9bc1-d9b12e6f28ab admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:15.408708 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-78f42014-ebf6-493d-9bc1-d9b12e6f28ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:15.460466 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f42014-ebf6-493d-9bc1-d9b12e6f28ab admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:15.464305 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212eb358-3e45-450e-a185-e46cf966c1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:15.464997 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eb358-3e45-450e-a185-e46cf966c1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:15.465276 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eb358-3e45-450e-a185-e46cf966c1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:15.465549 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eb358-3e45-450e-a185-e46cf966c1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:15.476133 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212eb358-3e45-450e-a185-e46cf966c1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:15.477619 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212eb358-3e45-450e-a185-e46cf966c1d0 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:15.487199 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1380/2759] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:11:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:11:15.949745 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8033766-de25-4216-b3ab-3c3fd24197d5 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:15.951260 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e8033766-de25-4216-b3ab-3c3fd24197d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:15.966589 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8033766-de25-4216-b3ab-3c3fd24197d5 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:15.983881 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65d52f-e746-49a3-80fa-81ae03e8f07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:15.984868 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65d52f-e746-49a3-80fa-81ae03e8f07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:15.985146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65d52f-e746-49a3-80fa-81ae03e8f07f admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:15.985496 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65d52f-e746-49a3-80fa-81ae03e8f07f admin admin] PATH_INFO: `/v3/projects/6211462f27e24ee08fa5c5f43da12873` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:15.986833 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65d52f-e746-49a3-80fa-81ae03e8f07f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6211462f27e24ee08fa5c5f43da12873)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:15.988857 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65d52f-e746-49a3-80fa-81ae03e8f07f admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:16.165882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-1c65d52f-e746-49a3-80fa-81ae03e8f07f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6211462f27e24ee08fa5c5f43da12873', 'request_id': 'req-1c65d52f-e746-49a3-80fa-81ae03e8f07f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:16.292402 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-1c65d52f-e746-49a3-80fa-81ae03e8f07f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6211462f27e24ee08fa5c5f43da12873', 'request_id': 'req-1c65d52f-e746-49a3-80fa-81ae03e8f07f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:16.299924 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-1c65d52f-e746-49a3-80fa-81ae03e8f07f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6211462f27e24ee08fa5c5f43da12873', 'request_id': 'req-1c65d52f-e746-49a3-80fa-81ae03e8f07f'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:16.311613 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-1c65d52f-e746-49a3-80fa-81ae03e8f07f admin admin] The token cache is being invalidate because project 6211462f27e24ee08fa5c5f43da12873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:11:16.312362 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-1c65d52f-e746-49a3-80fa-81ae03e8f07f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:16.312694 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-1c65d52f-e746-49a3-80fa-81ae03e8f07f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:11:16.314504 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1380/2760] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:11:15 2022] DELETE /identity/v3/projects/6211462f27e24ee08fa5c5f43da12873 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:11:28.824509 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2eb34-943e-425d-81ed-a3e9ad2d508a None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:28.825090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2eb34-943e-425d-81ed-a3e9ad2d508a None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:28.825090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2eb34-943e-425d-81ed-a3e9ad2d508a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:28.843238 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-b1c2eb34-943e-425d-81ed-a3e9ad2d508a None None] MFA Rules not processed for user `8066cbf7602941abbe345006dac52359`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:11:28.844442 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b1c2eb34-943e-425d-81ed-a3e9ad2d508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:28.898762 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1381/2761] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:11:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:11:28.934541 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65d52f-e746-49a3-80fa-81ae03e8f07f admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:28.936000 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1c65d52f-e746-49a3-80fa-81ae03e8f07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:28.997807 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65d52f-e746-49a3-80fa-81ae03e8f07f admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:29.001462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51265343-0c4b-4a48-ab73-91ea7facf9a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:29.002116 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51265343-0c4b-4a48-ab73-91ea7facf9a4 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:29.002392 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51265343-0c4b-4a48-ab73-91ea7facf9a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:29.002665 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51265343-0c4b-4a48-ab73-91ea7facf9a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:29.004544 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-51265343-0c4b-4a48-ab73-91ea7facf9a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:29.076514 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51265343-0c4b-4a48-ab73-91ea7facf9a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:29.077885 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51265343-0c4b-4a48-ab73-91ea7facf9a4 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:29.089968 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1381/2762] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:11:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:11:30.283425 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2eb34-943e-425d-81ed-a3e9ad2d508a None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:30.285456 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-b1c2eb34-943e-425d-81ed-a3e9ad2d508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:30.348856 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2eb34-943e-425d-81ed-a3e9ad2d508a None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:30.352646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93b9e2-5768-4047-8220-2a4486435d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:30.353340 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93b9e2-5768-4047-8220-2a4486435d18 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:30.353618 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93b9e2-5768-4047-8220-2a4486435d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:30.353889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93b9e2-5768-4047-8220-2a4486435d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:30.355664 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-2d93b9e2-5768-4047-8220-2a4486435d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:30.371167 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93b9e2-5768-4047-8220-2a4486435d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:30.372765 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93b9e2-5768-4047-8220-2a4486435d18 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:30.387368 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1382/2763] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:11:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:11:50.523692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51265343-0c4b-4a48-ab73-91ea7facf9a4 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:11:50.533680 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51265343-0c4b-4a48-ab73-91ea7facf9a4 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:11:50.537710 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c70df8-3d04-4789-b44b-0fff50699a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:11:50.538360 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c70df8-3d04-4789-b44b-0fff50699a8b service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:11:50.538701 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c70df8-3d04-4789-b44b-0fff50699a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:11:50.538972 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c70df8-3d04-4789-b44b-0fff50699a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:11:50.540800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-35c70df8-3d04-4789-b44b-0fff50699a8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:11:50.605428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c70df8-3d04-4789-b44b-0fff50699a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:11:50.606863 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c70df8-3d04-4789-b44b-0fff50699a8b service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:11:50.617124 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1382/2764] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:11:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:12:23.801947 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93b9e2-5768-4047-8220-2a4486435d18 service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:12:23.803410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-2d93b9e2-5768-4047-8220-2a4486435d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:12:23.815045 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93b9e2-5768-4047-8220-2a4486435d18 service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:12:23.818722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f056be-5f84-4d1d-81db-afde40185bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:12:23.819354 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f056be-5f84-4d1d-81db-afde40185bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:12:23.819665 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f056be-5f84-4d1d-81db-afde40185bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:12:23.819940 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f056be-5f84-4d1d-81db-afde40185bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:12:23.821719 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-76f056be-5f84-4d1d-81db-afde40185bf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:12:23.832348 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f056be-5f84-4d1d-81db-afde40185bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:12:23.833904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f056be-5f84-4d1d-81db-afde40185bf8 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:12:23.842046 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1383/2765] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:12:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:13:10.185637 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c70df8-3d04-4789-b44b-0fff50699a8b service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:10.185637 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-35c70df8-3d04-4789-b44b-0fff50699a8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:10.200891 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c70df8-3d04-4789-b44b-0fff50699a8b service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:10.208455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26a0d5-ad81-441b-96c4-68c5b0009121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:10.209197 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26a0d5-ad81-441b-96c4-68c5b0009121 service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:10.209478 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26a0d5-ad81-441b-96c4-68c5b0009121 service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:10.209751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26a0d5-ad81-441b-96c4-68c5b0009121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:10.211626 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ca26a0d5-ad81-441b-96c4-68c5b0009121 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:10.226538 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26a0d5-ad81-441b-96c4-68c5b0009121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:10.228247 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26a0d5-ad81-441b-96c4-68c5b0009121 service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:10.240947 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1383/2766] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:13:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:13:16.430671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f056be-5f84-4d1d-81db-afde40185bf8 service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:16.440098 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f056be-5f84-4d1d-81db-afde40185bf8 service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:16.443859 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0165b2d-c312-4ead-a22e-b63ad531446c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:16.444497 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0165b2d-c312-4ead-a22e-b63ad531446c service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:16.444876 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0165b2d-c312-4ead-a22e-b63ad531446c service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:16.445150 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0165b2d-c312-4ead-a22e-b63ad531446c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:16.446895 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-e0165b2d-c312-4ead-a22e-b63ad531446c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:16.510721 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0165b2d-c312-4ead-a22e-b63ad531446c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:16.512170 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0165b2d-c312-4ead-a22e-b63ad531446c service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:16.522019 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1384/2767] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:13:20.761490 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26a0d5-ad81-441b-96c4-68c5b0009121 service nova] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:20.762991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ca26a0d5-ad81-441b-96c4-68c5b0009121 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:20.779962 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26a0d5-ad81-441b-96c4-68c5b0009121 service nova] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:20.785756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a1b19-737a-4d0c-a30c-4122bd54c35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:20.786606 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a1b19-737a-4d0c-a30c-4122bd54c35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:20.786898 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a1b19-737a-4d0c-a30c-4122bd54c35d admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:20.787161 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a1b19-737a-4d0c-a30c-4122bd54c35d admin admin] PATH_INFO: `/v3/users/1ae58a1764394f17a5599d5fed30ce44` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:20.788340 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a1b19-737a-4d0c-a30c-4122bd54c35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae58a1764394f17a5599d5fed30ce44)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:20.790321 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a1b19-737a-4d0c-a30c-4122bd54c35d admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:21.051045 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-699a1b19-737a-4d0c-a30c-4122bd54c35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae58a1764394f17a5599d5fed30ce44'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:21.051688 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-699a1b19-737a-4d0c-a30c-4122bd54c35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae58a1764394f17a5599d5fed30ce44'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:21.064097 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-699a1b19-737a-4d0c-a30c-4122bd54c35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae58a1764394f17a5599d5fed30ce44'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:21.070991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-699a1b19-737a-4d0c-a30c-4122bd54c35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae58a1764394f17a5599d5fed30ce44'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:21.075091 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-699a1b19-737a-4d0c-a30c-4122bd54c35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae58a1764394f17a5599d5fed30ce44'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:21.174786 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1384/2768] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:13:20 2022] DELETE /identity/v3/users/1ae58a1764394f17a5599d5fed30ce44 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:21.415581 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0165b2d-c312-4ead-a22e-b63ad531446c service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:21.427068 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0165b2d-c312-4ead-a22e-b63ad531446c service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:21.483563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d27b23-aaa4-4974-81d0-5cad74c3fa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:21.484598 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d27b23-aaa4-4974-81d0-5cad74c3fa0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:21.484904 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d27b23-aaa4-4974-81d0-5cad74c3fa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:21.485168 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d27b23-aaa4-4974-81d0-5cad74c3fa0e admin admin] PATH_INFO: `/v3/projects/b3fb94b2f5ea4be18bfbb3968b306a53` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:21.486387 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d27b23-aaa4-4974-81d0-5cad74c3fa0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3fb94b2f5ea4be18bfbb3968b306a53)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:21.488316 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d27b23-aaa4-4974-81d0-5cad74c3fa0e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:21.612339 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d7d27b23-aaa4-4974-81d0-5cad74c3fa0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3fb94b2f5ea4be18bfbb3968b306a53', 'request_id': 'req-d7d27b23-aaa4-4974-81d0-5cad74c3fa0e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:21.722721 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d7d27b23-aaa4-4974-81d0-5cad74c3fa0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3fb94b2f5ea4be18bfbb3968b306a53', 'request_id': 'req-d7d27b23-aaa4-4974-81d0-5cad74c3fa0e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:21.729690 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d7d27b23-aaa4-4974-81d0-5cad74c3fa0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3fb94b2f5ea4be18bfbb3968b306a53', 'request_id': 'req-d7d27b23-aaa4-4974-81d0-5cad74c3fa0e'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:21.740117 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d7d27b23-aaa4-4974-81d0-5cad74c3fa0e admin admin] The token cache is being invalidate because project b3fb94b2f5ea4be18bfbb3968b306a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:13:21.740398 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d7d27b23-aaa4-4974-81d0-5cad74c3fa0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:21.741090 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d7d27b23-aaa4-4974-81d0-5cad74c3fa0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:21.742695 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1385/2769] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:13:21 2022] DELETE /identity/v3/projects/b3fb94b2f5ea4be18bfbb3968b306a53 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:21.747598 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7410d3d-4568-4ad7-976d-aaea511023c5 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:21.747877 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7410d3d-4568-4ad7-976d-aaea511023c5 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:21.748148 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7410d3d-4568-4ad7-976d-aaea511023c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:21.766598 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-e7410d3d-4568-4ad7-976d-aaea511023c5 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:21.767782 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e7410d3d-4568-4ad7-976d-aaea511023c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:21.826126 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1385/2770] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:13:21.834996 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab09ea8-11eb-453b-8b8a-7028e3612f0e None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:21.835402 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab09ea8-11eb-453b-8b8a-7028e3612f0e None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:21.835674 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab09ea8-11eb-453b-8b8a-7028e3612f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:21.853780 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-aab09ea8-11eb-453b-8b8a-7028e3612f0e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:21.854967 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-aab09ea8-11eb-453b-8b8a-7028e3612f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:21.863165 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1386/2771] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:13:21.867327 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7410d3d-4568-4ad7-976d-aaea511023c5 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:21.877869 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7410d3d-4568-4ad7-976d-aaea511023c5 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:21.882379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129e320-378e-4d58-b59f-e8d9b240977e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:21.883031 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129e320-378e-4d58-b59f-e8d9b240977e admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:21.883296 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129e320-378e-4d58-b59f-e8d9b240977e admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:21.883564 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129e320-378e-4d58-b59f-e8d9b240977e admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:21.884279 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129e320-378e-4d58-b59f-e8d9b240977e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:13:21.884600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129e320-378e-4d58-b59f-e8d9b240977e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:21.886261 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129e320-378e-4d58-b59f-e8d9b240977e admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:21.898385 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1386/2772] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:13:21.902818 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab09ea8-11eb-453b-8b8a-7028e3612f0e None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:21.912024 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab09ea8-11eb-453b-8b8a-7028e3612f0e None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:21.916766 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc3b32-868b-4d38-8c90-ac0943c4b7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:21.917408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc3b32-868b-4d38-8c90-ac0943c4b7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:21.917685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc3b32-868b-4d38-8c90-ac0943c4b7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:21.917953 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc3b32-868b-4d38-8c90-ac0943c4b7b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:21.918641 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc3b32-868b-4d38-8c90-ac0943c4b7b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:21.920541 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc3b32-868b-4d38-8c90-ac0943c4b7b8 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:22.019697 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1387/2773] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:13:21 2022] POST /identity/v3/projects => generated 401 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:13:22.023811 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129e320-378e-4d58-b59f-e8d9b240977e admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:22.034095 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129e320-378e-4d58-b59f-e8d9b240977e admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:22.090574 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c24200-adb7-423a-a73b-f231f26225ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:22.091240 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c24200-adb7-423a-a73b-f231f26225ec admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:22.091523 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c24200-adb7-423a-a73b-f231f26225ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:22.091798 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c24200-adb7-423a-a73b-f231f26225ec admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:22.092504 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c24200-adb7-423a-a73b-f231f26225ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:22.094571 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c24200-adb7-423a-a73b-f231f26225ec admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:22.192235 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1387/2774] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:13:22 2022] POST /identity/v3/users => generated 301 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:13:22.196500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc3b32-868b-4d38-8c90-ac0943c4b7b8 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:22.207137 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc3b32-868b-4d38-8c90-ac0943c4b7b8 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:22.211879 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16bfd3-7cc3-4d42-ba8a-02cc93e0e9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:22.212555 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16bfd3-7cc3-4d42-ba8a-02cc93e0e9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:22.212872 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16bfd3-7cc3-4d42-ba8a-02cc93e0e9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:22.213170 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16bfd3-7cc3-4d42-ba8a-02cc93e0e9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:22.213958 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16bfd3-7cc3-4d42-ba8a-02cc93e0e9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:22.215609 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16bfd3-7cc3-4d42-ba8a-02cc93e0e9f1 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:22.226451 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1388/2775] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:13:22.230462 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c24200-adb7-423a-a73b-f231f26225ec admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:22.241388 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c24200-adb7-423a-a73b-f231f26225ec admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:22.245912 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04733a5-8974-4185-85cc-a1c56b239b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:22.246555 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04733a5-8974-4185-85cc-a1c56b239b9e admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:22.246854 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04733a5-8974-4185-85cc-a1c56b239b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:22.247126 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04733a5-8974-4185-85cc-a1c56b239b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:22.247843 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04733a5-8974-4185-85cc-a1c56b239b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:22.250572 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04733a5-8974-4185-85cc-a1c56b239b9e admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:22.260196 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1388/2776] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:13:22.264468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16bfd3-7cc3-4d42-ba8a-02cc93e0e9f1 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:22.274785 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16bfd3-7cc3-4d42-ba8a-02cc93e0e9f1 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:22.279477 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e466857-e73f-4829-91b0-245bc359ddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:22.280402 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e466857-e73f-4829-91b0-245bc359ddf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:22.280718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e466857-e73f-4829-91b0-245bc359ddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:22.280985 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e466857-e73f-4829-91b0-245bc359ddf3 admin admin] PATH_INFO: `/v3/projects/ce0b9e819e644e28a887c211dfc3cafb/users/6515ea7d4a604698afa12f4392638822/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:22.295022 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e466857-e73f-4829-91b0-245bc359ddf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce0b9e819e644e28a887c211dfc3cafb, user_id=6515ea7d4a604698afa12f4392638822, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:22.298313 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e466857-e73f-4829-91b0-245bc359ddf3 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:22.391761 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1389/2777] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:13:22 2022] PUT /identity/v3/projects/ce0b9e819e644e28a887c211dfc3cafb/users/6515ea7d4a604698afa12f4392638822/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:22.403077 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bf504-f072-4202-91dc-34d5ac21dde2 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:22.403419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bf504-f072-4202-91dc-34d5ac21dde2 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:22.403716 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bf504-f072-4202-91dc-34d5ac21dde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:22.430440 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-dc0bf504-f072-4202-91dc-34d5ac21dde2 None None] MFA Rules not processed for user `6515ea7d4a604698afa12f4392638822`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:22.431641 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-dc0bf504-f072-4202-91dc-34d5ac21dde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:22.493162 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1389/2778] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:13:22.497565 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e466857-e73f-4829-91b0-245bc359ddf3 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:22.562533 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e466857-e73f-4829-91b0-245bc359ddf3 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:22.568806 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a92c80-24bd-4158-a425-dc50e063dc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:22.569473 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a92c80-24bd-4158-a425-dc50e063dc38 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:22.569757 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a92c80-24bd-4158-a425-dc50e063dc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:22.570052 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a92c80-24bd-4158-a425-dc50e063dc38 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:22.570812 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a92c80-24bd-4158-a425-dc50e063dc38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:22.573024 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a92c80-24bd-4158-a425-dc50e063dc38 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:22.701287 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1390/2779] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:13:22 2022] POST /identity/v3/projects => generated 405 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:13:22.706123 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bf504-f072-4202-91dc-34d5ac21dde2 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:22.717083 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bf504-f072-4202-91dc-34d5ac21dde2 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:22.774806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f633605-0e9a-4b10-b240-a38d6c1419ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:22.775494 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f633605-0e9a-4b10-b240-a38d6c1419ff admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:22.775744 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f633605-0e9a-4b10-b240-a38d6c1419ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:22.776016 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f633605-0e9a-4b10-b240-a38d6c1419ff admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:22.776751 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f633605-0e9a-4b10-b240-a38d6c1419ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:22.778648 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f633605-0e9a-4b10-b240-a38d6c1419ff admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:22.897776 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1390/2780] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:13:22 2022] POST /identity/v3/users => generated 309 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:13:22.901819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a92c80-24bd-4158-a425-dc50e063dc38 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:22.912703 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a92c80-24bd-4158-a425-dc50e063dc38 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:22.917401 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeea197-d407-40a7-826f-89919fad1ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:22.918055 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeea197-d407-40a7-826f-89919fad1ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:22.918336 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeea197-d407-40a7-826f-89919fad1ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:22.918612 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeea197-d407-40a7-826f-89919fad1ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:22.919344 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeea197-d407-40a7-826f-89919fad1ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:22.921581 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeea197-d407-40a7-826f-89919fad1ae1 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:22.932292 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1391/2781] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:13:22.936548 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f633605-0e9a-4b10-b240-a38d6c1419ff admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:22.947046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f633605-0e9a-4b10-b240-a38d6c1419ff admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:22.952705 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf20073-7777-4dfe-9a44-990914be2d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:22.953614 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf20073-7777-4dfe-9a44-990914be2d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:22.953889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf20073-7777-4dfe-9a44-990914be2d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:22.954167 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf20073-7777-4dfe-9a44-990914be2d32 admin admin] PATH_INFO: `/v3/projects/67ca21e676b64783be92e2f1b9c0e431/users/1f4b8149e5914011aad08358f3a483ea/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:22.973334 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf20073-7777-4dfe-9a44-990914be2d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ca21e676b64783be92e2f1b9c0e431, user_id=1f4b8149e5914011aad08358f3a483ea, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:22.975665 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf20073-7777-4dfe-9a44-990914be2d32 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:23.087416 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1391/2782] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:13:22 2022] PUT /identity/v3/projects/67ca21e676b64783be92e2f1b9c0e431/users/1f4b8149e5914011aad08358f3a483ea/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:23.091447 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeea197-d407-40a7-826f-89919fad1ae1 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:23.103544 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeea197-d407-40a7-826f-89919fad1ae1 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:23.162909 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097a1b6-092e-48ef-932b-a9720021e52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:23.163700 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097a1b6-092e-48ef-932b-a9720021e52f admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:23.164049 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097a1b6-092e-48ef-932b-a9720021e52f admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:23.164460 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097a1b6-092e-48ef-932b-a9720021e52f admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:23.165381 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097a1b6-092e-48ef-932b-a9720021e52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:23.167127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097a1b6-092e-48ef-932b-a9720021e52f admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:23.177479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1392/2783] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:13:23.181809 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf20073-7777-4dfe-9a44-990914be2d32 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:23.192527 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf20073-7777-4dfe-9a44-990914be2d32 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:23.199065 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befcf87-b5de-4051-9e45-1b58f36bd364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:23.199963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befcf87-b5de-4051-9e45-1b58f36bd364 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:23.200241 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befcf87-b5de-4051-9e45-1b58f36bd364 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:23.200537 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befcf87-b5de-4051-9e45-1b58f36bd364 admin admin] PATH_INFO: `/v3/projects/67ca21e676b64783be92e2f1b9c0e431/users/1f4b8149e5914011aad08358f3a483ea/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:23.203268 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befcf87-b5de-4051-9e45-1b58f36bd364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ca21e676b64783be92e2f1b9c0e431, user_id=1f4b8149e5914011aad08358f3a483ea, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:23.205956 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befcf87-b5de-4051-9e45-1b58f36bd364 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:23.216563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1392/2784] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:13:23 2022] PUT /identity/v3/projects/67ca21e676b64783be92e2f1b9c0e431/users/1f4b8149e5914011aad08358f3a483ea/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:23.227820 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254669ab-635c-4174-805c-092c728df883 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:23.228107 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254669ab-635c-4174-805c-092c728df883 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:23.233195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254669ab-635c-4174-805c-092c728df883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:23.255695 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-254669ab-635c-4174-805c-092c728df883 None None] MFA Rules not processed for user `1f4b8149e5914011aad08358f3a483ea`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:23.256988 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-254669ab-635c-4174-805c-092c728df883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:23.326890 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1393/2785] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:23 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:13:23.338776 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befcf87-b5de-4051-9e45-1b58f36bd364 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:23.341037 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-6befcf87-b5de-4051-9e45-1b58f36bd364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:23.399384 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befcf87-b5de-4051-9e45-1b58f36bd364 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:23.403090 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09d176-bdc2-4cef-856f-9f2ed82739d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:23.403750 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09d176-bdc2-4cef-856f-9f2ed82739d8 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:23.404015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09d176-bdc2-4cef-856f-9f2ed82739d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:23.404287 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09d176-bdc2-4cef-856f-9f2ed82739d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:23.413720 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09d176-bdc2-4cef-856f-9f2ed82739d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:23.415151 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09d176-bdc2-4cef-856f-9f2ed82739d8 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:23.424657 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1393/2786] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:13:23 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:13:23.569225 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254669ab-635c-4174-805c-092c728df883 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:23.639188 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254669ab-635c-4174-805c-092c728df883 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:23.644398 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546fd4e-7d56-4a50-be1f-edf1bd35a365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:23.645306 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546fd4e-7d56-4a50-be1f-edf1bd35a365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:23.645586 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546fd4e-7d56-4a50-be1f-edf1bd35a365 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:23.645857 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546fd4e-7d56-4a50-be1f-edf1bd35a365 admin admin] PATH_INFO: `/v3/users/6515ea7d4a604698afa12f4392638822` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:23.647057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546fd4e-7d56-4a50-be1f-edf1bd35a365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6515ea7d4a604698afa12f4392638822)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:23.649033 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546fd4e-7d56-4a50-be1f-edf1bd35a365 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:23.931180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d546fd4e-7d56-4a50-be1f-edf1bd35a365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6515ea7d4a604698afa12f4392638822'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:23.937190 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d546fd4e-7d56-4a50-be1f-edf1bd35a365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6515ea7d4a604698afa12f4392638822'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:23.943998 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d546fd4e-7d56-4a50-be1f-edf1bd35a365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6515ea7d4a604698afa12f4392638822'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:23.950485 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d546fd4e-7d56-4a50-be1f-edf1bd35a365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6515ea7d4a604698afa12f4392638822'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:23.951152 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-d546fd4e-7d56-4a50-be1f-edf1bd35a365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6515ea7d4a604698afa12f4392638822'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:24.054889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1394/2787] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:13:23 2022] DELETE /identity/v3/users/6515ea7d4a604698afa12f4392638822 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:24.059574 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7ad13-93e9-465d-8cf0-39e3bb1f6fd6 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:24.060132 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7ad13-93e9-465d-8cf0-39e3bb1f6fd6 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:24.060132 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7ad13-93e9-465d-8cf0-39e3bb1f6fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:24.080244 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-83c7ad13-93e9-465d-8cf0-39e3bb1f6fd6 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:24.081446 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-83c7ad13-93e9-465d-8cf0-39e3bb1f6fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:24.144428 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1394/2788] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:13:24.154436 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546fd4e-7d56-4a50-be1f-edf1bd35a365 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:24.156857 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d546fd4e-7d56-4a50-be1f-edf1bd35a365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:24.218725 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546fd4e-7d56-4a50-be1f-edf1bd35a365 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:24.223062 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34469c94-11c0-4900-be7d-f399822c7f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:24.223713 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34469c94-11c0-4900-be7d-f399822c7f65 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:24.223990 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34469c94-11c0-4900-be7d-f399822c7f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:24.224262 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34469c94-11c0-4900-be7d-f399822c7f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:24.235641 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34469c94-11c0-4900-be7d-f399822c7f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:24.237188 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34469c94-11c0-4900-be7d-f399822c7f65 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:24.247092 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1395/2789] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:13:24.736312 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7ad13-93e9-465d-8cf0-39e3bb1f6fd6 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:24.737750 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-83c7ad13-93e9-465d-8cf0-39e3bb1f6fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:24.749676 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7ad13-93e9-465d-8cf0-39e3bb1f6fd6 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:24.755138 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b0985-dd28-4096-8de6-6fde7c30f7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:24.756176 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b0985-dd28-4096-8de6-6fde7c30f7e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:24.756523 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b0985-dd28-4096-8de6-6fde7c30f7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:24.756846 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b0985-dd28-4096-8de6-6fde7c30f7e6 admin admin] PATH_INFO: `/v3/projects/ce0b9e819e644e28a887c211dfc3cafb` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:24.758836 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b0985-dd28-4096-8de6-6fde7c30f7e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce0b9e819e644e28a887c211dfc3cafb)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:24.760789 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b0985-dd28-4096-8de6-6fde7c30f7e6 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:24.933552 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-a48b0985-dd28-4096-8de6-6fde7c30f7e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce0b9e819e644e28a887c211dfc3cafb', 'request_id': 'req-a48b0985-dd28-4096-8de6-6fde7c30f7e6'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:25.031482 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-a48b0985-dd28-4096-8de6-6fde7c30f7e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce0b9e819e644e28a887c211dfc3cafb', 'request_id': 'req-a48b0985-dd28-4096-8de6-6fde7c30f7e6'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:25.038397 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-a48b0985-dd28-4096-8de6-6fde7c30f7e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce0b9e819e644e28a887c211dfc3cafb', 'request_id': 'req-a48b0985-dd28-4096-8de6-6fde7c30f7e6'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:25.049117 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-a48b0985-dd28-4096-8de6-6fde7c30f7e6 admin admin] The token cache is being invalidate because project ce0b9e819e644e28a887c211dfc3cafb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:13:25.049405 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-a48b0985-dd28-4096-8de6-6fde7c30f7e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:25.050058 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-a48b0985-dd28-4096-8de6-6fde7c30f7e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:25.051626 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1395/2790] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:13:24 2022] DELETE /identity/v3/projects/ce0b9e819e644e28a887c211dfc3cafb => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:25.055651 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34469c94-11c0-4900-be7d-f399822c7f65 service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:25.067722 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34469c94-11c0-4900-be7d-f399822c7f65 service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:25.124332 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9793d-6913-4ccb-8d0e-e87a063b6170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:25.125244 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9793d-6913-4ccb-8d0e-e87a063b6170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:25.125525 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9793d-6913-4ccb-8d0e-e87a063b6170 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:25.125798 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9793d-6913-4ccb-8d0e-e87a063b6170 admin admin] PATH_INFO: `/v3/users/1f4b8149e5914011aad08358f3a483ea` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:25.126990 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9793d-6913-4ccb-8d0e-e87a063b6170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f4b8149e5914011aad08358f3a483ea)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:25.128972 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9793d-6913-4ccb-8d0e-e87a063b6170 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:25.382845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-69a9793d-6913-4ccb-8d0e-e87a063b6170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f4b8149e5914011aad08358f3a483ea'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:25.383502 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-69a9793d-6913-4ccb-8d0e-e87a063b6170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f4b8149e5914011aad08358f3a483ea'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:25.395043 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-69a9793d-6913-4ccb-8d0e-e87a063b6170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f4b8149e5914011aad08358f3a483ea'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:25.401925 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-69a9793d-6913-4ccb-8d0e-e87a063b6170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f4b8149e5914011aad08358f3a483ea'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:25.402616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-69a9793d-6913-4ccb-8d0e-e87a063b6170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f4b8149e5914011aad08358f3a483ea'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:25.499724 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1396/2791] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:13:25 2022] DELETE /identity/v3/users/1f4b8149e5914011aad08358f3a483ea => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:25.922005 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b0985-dd28-4096-8de6-6fde7c30f7e6 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:25.923476 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-a48b0985-dd28-4096-8de6-6fde7c30f7e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:25.939480 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b0985-dd28-4096-8de6-6fde7c30f7e6 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:25.997022 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c30118-5488-48b8-b4bd-bc6a18ef14fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:25.997889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c30118-5488-48b8-b4bd-bc6a18ef14fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:25.998170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c30118-5488-48b8-b4bd-bc6a18ef14fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:25.998445 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c30118-5488-48b8-b4bd-bc6a18ef14fa admin admin] PATH_INFO: `/v3/projects/67ca21e676b64783be92e2f1b9c0e431` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:26.000552 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c30118-5488-48b8-b4bd-bc6a18ef14fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ca21e676b64783be92e2f1b9c0e431)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:26.002519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c30118-5488-48b8-b4bd-bc6a18ef14fa admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:26.111542 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d5c30118-5488-48b8-b4bd-bc6a18ef14fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ca21e676b64783be92e2f1b9c0e431', 'request_id': 'req-d5c30118-5488-48b8-b4bd-bc6a18ef14fa'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:26.202831 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d5c30118-5488-48b8-b4bd-bc6a18ef14fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ca21e676b64783be92e2f1b9c0e431', 'request_id': 'req-d5c30118-5488-48b8-b4bd-bc6a18ef14fa'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:26.209455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d5c30118-5488-48b8-b4bd-bc6a18ef14fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ca21e676b64783be92e2f1b9c0e431', 'request_id': 'req-d5c30118-5488-48b8-b4bd-bc6a18ef14fa'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:26.220239 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d5c30118-5488-48b8-b4bd-bc6a18ef14fa admin admin] The token cache is being invalidate because project 67ca21e676b64783be92e2f1b9c0e431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:13:26.220526 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d5c30118-5488-48b8-b4bd-bc6a18ef14fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:26.221457 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d5c30118-5488-48b8-b4bd-bc6a18ef14fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:26.223001 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1396/2792] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:13:25 2022] DELETE /identity/v3/projects/67ca21e676b64783be92e2f1b9c0e431 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:26.235677 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a70fbe-4e2f-4324-ab61-bcb1940e42b4 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:26.236181 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a70fbe-4e2f-4324-ab61-bcb1940e42b4 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:26.236304 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a70fbe-4e2f-4324-ab61-bcb1940e42b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:26.255218 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-05a70fbe-4e2f-4324-ab61-bcb1940e42b4 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:26.256411 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-05a70fbe-4e2f-4324-ab61-bcb1940e42b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:26.313938 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1397/2793] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:13:26.321871 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b107e55-f95e-484a-b7a5-03d4cd2f362a None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:26.322157 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b107e55-f95e-484a-b7a5-03d4cd2f362a None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:26.322435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b107e55-f95e-484a-b7a5-03d4cd2f362a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:26.341600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-6b107e55-f95e-484a-b7a5-03d4cd2f362a None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:26.343305 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-6b107e55-f95e-484a-b7a5-03d4cd2f362a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:26.351721 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1397/2794] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:13:26.356376 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a70fbe-4e2f-4324-ab61-bcb1940e42b4 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:26.366413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a70fbe-4e2f-4324-ab61-bcb1940e42b4 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:26.370970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d5f01-4770-4412-96dd-bf0c01ec1d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:26.371616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5f01-4770-4412-96dd-bf0c01ec1d99 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:26.371895 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5f01-4770-4412-96dd-bf0c01ec1d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:26.372168 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5f01-4770-4412-96dd-bf0c01ec1d99 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:26.372917 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d5f01-4770-4412-96dd-bf0c01ec1d99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:13:26.373223 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d5f01-4770-4412-96dd-bf0c01ec1d99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:26.374849 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d5f01-4770-4412-96dd-bf0c01ec1d99 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:26.386036 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1398/2795] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:13:26.391102 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b107e55-f95e-484a-b7a5-03d4cd2f362a None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:26.400570 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b107e55-f95e-484a-b7a5-03d4cd2f362a None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:26.405852 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b1dd8-d4f7-4aeb-90fb-54506b49f102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:26.406492 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1dd8-d4f7-4aeb-90fb-54506b49f102 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:26.406769 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1dd8-d4f7-4aeb-90fb-54506b49f102 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:26.407040 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1dd8-d4f7-4aeb-90fb-54506b49f102 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:26.407793 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b1dd8-d4f7-4aeb-90fb-54506b49f102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:26.409715 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b1dd8-d4f7-4aeb-90fb-54506b49f102 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:26.501475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1398/2796] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:13:26 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:13:26.505537 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d5f01-4770-4412-96dd-bf0c01ec1d99 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:26.515574 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d5f01-4770-4412-96dd-bf0c01ec1d99 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:26.571051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cfddd-2da9-47bd-81c9-a63ac3a885de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:26.571723 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cfddd-2da9-47bd-81c9-a63ac3a885de admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:26.572006 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cfddd-2da9-47bd-81c9-a63ac3a885de admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:26.572289 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cfddd-2da9-47bd-81c9-a63ac3a885de admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:26.573096 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cfddd-2da9-47bd-81c9-a63ac3a885de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:26.611579 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cfddd-2da9-47bd-81c9-a63ac3a885de admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:26.970134 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1399/2797] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:13:26 2022] POST /identity/v3/users => generated 290 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:13:26.974300 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b1dd8-d4f7-4aeb-90fb-54506b49f102 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:26.985418 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b1dd8-d4f7-4aeb-90fb-54506b49f102 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:26.990439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8f31f-2b29-4a57-b813-0d83262fbb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:26.991104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8f31f-2b29-4a57-b813-0d83262fbb15 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:26.991384 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8f31f-2b29-4a57-b813-0d83262fbb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:26.991659 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8f31f-2b29-4a57-b813-0d83262fbb15 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:26.992380 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8f31f-2b29-4a57-b813-0d83262fbb15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:26.993994 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8f31f-2b29-4a57-b813-0d83262fbb15 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:27.004633 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1399/2798] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:13:27.008586 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cfddd-2da9-47bd-81c9-a63ac3a885de admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:27.020479 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cfddd-2da9-47bd-81c9-a63ac3a885de admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:27.025228 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f99104-4015-4deb-a849-db6a62ebe881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:27.025885 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f99104-4015-4deb-a849-db6a62ebe881 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:27.026164 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f99104-4015-4deb-a849-db6a62ebe881 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:27.026435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f99104-4015-4deb-a849-db6a62ebe881 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:27.027164 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f99104-4015-4deb-a849-db6a62ebe881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:27.028786 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f99104-4015-4deb-a849-db6a62ebe881 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:27.039459 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1400/2799] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:13:27.043585 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8f31f-2b29-4a57-b813-0d83262fbb15 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:27.053972 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8f31f-2b29-4a57-b813-0d83262fbb15 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:27.058495 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db3c0d-458f-4ea5-ace5-0342ce04c47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:27.059367 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db3c0d-458f-4ea5-ace5-0342ce04c47c admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:27.059653 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db3c0d-458f-4ea5-ace5-0342ce04c47c admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:27.059926 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db3c0d-458f-4ea5-ace5-0342ce04c47c admin admin] PATH_INFO: `/v3/projects/270867cc34294eb3bba762b51c5641a2/users/980f6046014a4be783dda57d7339c3ac/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:27.075015 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db3c0d-458f-4ea5-ace5-0342ce04c47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=270867cc34294eb3bba762b51c5641a2, user_id=980f6046014a4be783dda57d7339c3ac, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:27.078965 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db3c0d-458f-4ea5-ace5-0342ce04c47c admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:27.168710 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1400/2800] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:13:27 2022] PUT /identity/v3/projects/270867cc34294eb3bba762b51c5641a2/users/980f6046014a4be783dda57d7339c3ac/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:27.181962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4b689-9e15-4876-8a5d-c30f683d6e79 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:27.182240 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4b689-9e15-4876-8a5d-c30f683d6e79 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:27.182511 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4b689-9e15-4876-8a5d-c30f683d6e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:27.209741 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-a1c4b689-9e15-4876-8a5d-c30f683d6e79 None None] MFA Rules not processed for user `980f6046014a4be783dda57d7339c3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:27.210948 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-a1c4b689-9e15-4876-8a5d-c30f683d6e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:27.274850 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1401/2801] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:13:27.279333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db3c0d-458f-4ea5-ace5-0342ce04c47c admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:27.339311 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db3c0d-458f-4ea5-ace5-0342ce04c47c admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:27.343948 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4a037-dfb6-42de-997e-c886991cf917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:27.344626 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4a037-dfb6-42de-997e-c886991cf917 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:27.344912 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4a037-dfb6-42de-997e-c886991cf917 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:27.345187 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4a037-dfb6-42de-997e-c886991cf917 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:27.346264 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4a037-dfb6-42de-997e-c886991cf917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:27.348159 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4a037-dfb6-42de-997e-c886991cf917 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:27.490268 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1401/2802] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:13:27 2022] POST /identity/v3/projects => generated 381 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:13:27.494551 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4b689-9e15-4876-8a5d-c30f683d6e79 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:27.506051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4b689-9e15-4876-8a5d-c30f683d6e79 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:27.562194 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71d0aa-8741-4411-887f-1f41a27f41d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:27.562797 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71d0aa-8741-4411-887f-1f41a27f41d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:27.563080 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71d0aa-8741-4411-887f-1f41a27f41d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:27.563355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71d0aa-8741-4411-887f-1f41a27f41d7 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:27.564060 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71d0aa-8741-4411-887f-1f41a27f41d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:27.566085 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71d0aa-8741-4411-887f-1f41a27f41d7 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:27.735458 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1402/2803] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:13:27 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:13:27.739484 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4a037-dfb6-42de-997e-c886991cf917 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:27.750208 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4a037-dfb6-42de-997e-c886991cf917 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:27.754816 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b60255-dddf-436a-92bd-cf47ee82eaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:27.755470 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b60255-dddf-436a-92bd-cf47ee82eaea admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:27.755752 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b60255-dddf-436a-92bd-cf47ee82eaea admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:27.756028 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b60255-dddf-436a-92bd-cf47ee82eaea admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:27.756822 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b60255-dddf-436a-92bd-cf47ee82eaea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:27.758407 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b60255-dddf-436a-92bd-cf47ee82eaea admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:27.768655 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1402/2804] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:13:27.772943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71d0aa-8741-4411-887f-1f41a27f41d7 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:27.783450 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71d0aa-8741-4411-887f-1f41a27f41d7 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:27.788325 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1738504-bf51-4f16-8640-89a24f73c50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:27.789247 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1738504-bf51-4f16-8640-89a24f73c50e admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:27.789528 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1738504-bf51-4f16-8640-89a24f73c50e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:27.789799 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1738504-bf51-4f16-8640-89a24f73c50e admin admin] PATH_INFO: `/v3/projects/81ea8e1fe74f4d999b772a1cf3ddb474/users/cf6d05fd8ad947fd8c4ac934b923f119/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:27.804865 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1738504-bf51-4f16-8640-89a24f73c50e admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ea8e1fe74f4d999b772a1cf3ddb474, user_id=cf6d05fd8ad947fd8c4ac934b923f119, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:27.807562 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1738504-bf51-4f16-8640-89a24f73c50e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:27.960486 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1403/2805] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:13:27 2022] PUT /identity/v3/projects/81ea8e1fe74f4d999b772a1cf3ddb474/users/cf6d05fd8ad947fd8c4ac934b923f119/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:27.964651 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b60255-dddf-436a-92bd-cf47ee82eaea admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:27.975436 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b60255-dddf-436a-92bd-cf47ee82eaea admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:28.030532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87254c4a-2513-4577-b49b-804b9236a501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:28.031185 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87254c4a-2513-4577-b49b-804b9236a501 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:28.031461 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87254c4a-2513-4577-b49b-804b9236a501 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:28.031727 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87254c4a-2513-4577-b49b-804b9236a501 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:28.032447 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87254c4a-2513-4577-b49b-804b9236a501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:28.034055 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87254c4a-2513-4577-b49b-804b9236a501 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:28.043505 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1403/2806] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:13:28.048550 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1738504-bf51-4f16-8640-89a24f73c50e admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:28.058776 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1738504-bf51-4f16-8640-89a24f73c50e admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:28.063624 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7af035-741c-46e6-982b-c28c53439b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:28.064494 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7af035-741c-46e6-982b-c28c53439b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:28.064804 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7af035-741c-46e6-982b-c28c53439b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:28.065076 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7af035-741c-46e6-982b-c28c53439b2b admin admin] PATH_INFO: `/v3/projects/81ea8e1fe74f4d999b772a1cf3ddb474/users/cf6d05fd8ad947fd8c4ac934b923f119/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:28.067081 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7af035-741c-46e6-982b-c28c53439b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ea8e1fe74f4d999b772a1cf3ddb474, user_id=cf6d05fd8ad947fd8c4ac934b923f119, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:28.069927 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7af035-741c-46e6-982b-c28c53439b2b admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:28.080989 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1404/2807] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:13:28 2022] PUT /identity/v3/projects/81ea8e1fe74f4d999b772a1cf3ddb474/users/cf6d05fd8ad947fd8c4ac934b923f119/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:28.091104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a7d5c-30c1-4ae3-a7cd-e30e2a2b1664 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:28.091391 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a7d5c-30c1-4ae3-a7cd-e30e2a2b1664 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:28.091668 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a7d5c-30c1-4ae3-a7cd-e30e2a2b1664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:28.118903 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-ec8a7d5c-30c1-4ae3-a7cd-e30e2a2b1664 None None] MFA Rules not processed for user `cf6d05fd8ad947fd8c4ac934b923f119`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:28.120111 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ec8a7d5c-30c1-4ae3-a7cd-e30e2a2b1664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:28.186762 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1404/2808] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:13:28.209832 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7af035-741c-46e6-982b-c28c53439b2b admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:28.211546 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-cc7af035-741c-46e6-982b-c28c53439b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:28.273742 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7af035-741c-46e6-982b-c28c53439b2b admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:28.277383 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153221e-5408-4cac-b105-8bc459de27f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:28.278021 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153221e-5408-4cac-b105-8bc459de27f4 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:28.278297 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153221e-5408-4cac-b105-8bc459de27f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:28.278563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153221e-5408-4cac-b105-8bc459de27f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:28.288000 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153221e-5408-4cac-b105-8bc459de27f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:28.289452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153221e-5408-4cac-b105-8bc459de27f4 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:28.298692 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1405/2809] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:13:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:13:28.587270 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a7d5c-30c1-4ae3-a7cd-e30e2a2b1664 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:28.597294 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a7d5c-30c1-4ae3-a7cd-e30e2a2b1664 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:28.600863 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99821d52-6123-4d3d-b40e-d9be968f66d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:28.601499 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99821d52-6123-4d3d-b40e-d9be968f66d6 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:28.601779 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99821d52-6123-4d3d-b40e-d9be968f66d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:28.602060 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99821d52-6123-4d3d-b40e-d9be968f66d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:28.657969 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99821d52-6123-4d3d-b40e-d9be968f66d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:28.659417 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99821d52-6123-4d3d-b40e-d9be968f66d6 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:28.668504 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1405/2810] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:13:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:13:41.880626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153221e-5408-4cac-b105-8bc459de27f4 service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:41.943943 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153221e-5408-4cac-b105-8bc459de27f4 service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:41.948361 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c135d-e150-4866-9134-2963a1445714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:41.949245 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c135d-e150-4866-9134-2963a1445714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:41.949519 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c135d-e150-4866-9134-2963a1445714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:41.949788 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c135d-e150-4866-9134-2963a1445714 admin admin] PATH_INFO: `/v3/users/980f6046014a4be783dda57d7339c3ac` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:41.950951 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c135d-e150-4866-9134-2963a1445714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=980f6046014a4be783dda57d7339c3ac)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:41.953645 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c135d-e150-4866-9134-2963a1445714 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:42.213099 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-265c135d-e150-4866-9134-2963a1445714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '980f6046014a4be783dda57d7339c3ac'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:42.213712 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-265c135d-e150-4866-9134-2963a1445714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '980f6046014a4be783dda57d7339c3ac'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:42.226125 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-265c135d-e150-4866-9134-2963a1445714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '980f6046014a4be783dda57d7339c3ac'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:42.233577 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-265c135d-e150-4866-9134-2963a1445714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '980f6046014a4be783dda57d7339c3ac'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:42.234239 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-265c135d-e150-4866-9134-2963a1445714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '980f6046014a4be783dda57d7339c3ac'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:42.333483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1406/2811] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:13:41 2022] DELETE /identity/v3/users/980f6046014a4be783dda57d7339c3ac => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:42.338046 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063f537-e805-4422-af50-6354fd8874a8 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:42.338559 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063f537-e805-4422-af50-6354fd8874a8 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:42.338664 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063f537-e805-4422-af50-6354fd8874a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:42.355891 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-5063f537-e805-4422-af50-6354fd8874a8 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:42.358156 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5063f537-e805-4422-af50-6354fd8874a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:42.416486 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1406/2812] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:13:42.426996 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c135d-e150-4866-9134-2963a1445714 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:42.428399 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-265c135d-e150-4866-9134-2963a1445714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:42.484884 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c135d-e150-4866-9134-2963a1445714 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:42.488338 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f8b23-7423-421e-a119-ef8aef15579f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:42.489003 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f8b23-7423-421e-a119-ef8aef15579f service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:42.489282 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f8b23-7423-421e-a119-ef8aef15579f service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:42.489553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f8b23-7423-421e-a119-ef8aef15579f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:42.498452 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f8b23-7423-421e-a119-ef8aef15579f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:42.499933 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f8b23-7423-421e-a119-ef8aef15579f service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:42.509282 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1407/2813] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:13:42.978889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063f537-e805-4422-af50-6354fd8874a8 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:42.980320 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5063f537-e805-4422-af50-6354fd8874a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:42.993104 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063f537-e805-4422-af50-6354fd8874a8 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:42.998593 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa672275-ee17-4315-a710-997a08e00962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:42.999627 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa672275-ee17-4315-a710-997a08e00962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:42.999980 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa672275-ee17-4315-a710-997a08e00962 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:43.000325 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa672275-ee17-4315-a710-997a08e00962 admin admin] PATH_INFO: `/v3/projects/270867cc34294eb3bba762b51c5641a2` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:43.001649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa672275-ee17-4315-a710-997a08e00962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=270867cc34294eb3bba762b51c5641a2)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:43.003635 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa672275-ee17-4315-a710-997a08e00962 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:43.141683 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fa672275-ee17-4315-a710-997a08e00962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270867cc34294eb3bba762b51c5641a2', 'request_id': 'req-fa672275-ee17-4315-a710-997a08e00962'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:43.236508 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fa672275-ee17-4315-a710-997a08e00962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270867cc34294eb3bba762b51c5641a2', 'request_id': 'req-fa672275-ee17-4315-a710-997a08e00962'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:43.243402 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fa672275-ee17-4315-a710-997a08e00962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270867cc34294eb3bba762b51c5641a2', 'request_id': 'req-fa672275-ee17-4315-a710-997a08e00962'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:43.254275 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fa672275-ee17-4315-a710-997a08e00962 admin admin] The token cache is being invalidate because project 270867cc34294eb3bba762b51c5641a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:13:43.254559 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fa672275-ee17-4315-a710-997a08e00962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:43.255222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-fa672275-ee17-4315-a710-997a08e00962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:43.256794 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1407/2814] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:13:42 2022] DELETE /identity/v3/projects/270867cc34294eb3bba762b51c5641a2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:13:43.260842 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f8b23-7423-421e-a119-ef8aef15579f service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:43.270568 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f8b23-7423-421e-a119-ef8aef15579f service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:43.325468 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298b642-9adf-4883-bb1e-3453f23195e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:43.326393 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298b642-9adf-4883-bb1e-3453f23195e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:43.326672 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298b642-9adf-4883-bb1e-3453f23195e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:43.326946 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298b642-9adf-4883-bb1e-3453f23195e0 admin admin] PATH_INFO: `/v3/users/cf6d05fd8ad947fd8c4ac934b923f119` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:43.328131 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298b642-9adf-4883-bb1e-3453f23195e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf6d05fd8ad947fd8c4ac934b923f119)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:43.330077 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298b642-9adf-4883-bb1e-3453f23195e0 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:43.590763 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-2298b642-9adf-4883-bb1e-3453f23195e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf6d05fd8ad947fd8c4ac934b923f119'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:43.591412 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-2298b642-9adf-4883-bb1e-3453f23195e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf6d05fd8ad947fd8c4ac934b923f119'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:43.603826 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-2298b642-9adf-4883-bb1e-3453f23195e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf6d05fd8ad947fd8c4ac934b923f119'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:43.611471 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-2298b642-9adf-4883-bb1e-3453f23195e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf6d05fd8ad947fd8c4ac934b923f119'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:43.612129 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-2298b642-9adf-4883-bb1e-3453f23195e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf6d05fd8ad947fd8c4ac934b923f119'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:43.776441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1408/2815] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:13:43 2022] DELETE /identity/v3/users/cf6d05fd8ad947fd8c4ac934b923f119 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:44.203973 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa672275-ee17-4315-a710-997a08e00962 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:44.205473 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-fa672275-ee17-4315-a710-997a08e00962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:44.219667 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa672275-ee17-4315-a710-997a08e00962 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:44.276025 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c535287-cf8c-49ab-a361-46e72af1e0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:44.276902 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c535287-cf8c-49ab-a361-46e72af1e0a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:44.277179 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c535287-cf8c-49ab-a361-46e72af1e0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:44.277445 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c535287-cf8c-49ab-a361-46e72af1e0a3 admin admin] PATH_INFO: `/v3/projects/81ea8e1fe74f4d999b772a1cf3ddb474` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:44.278656 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c535287-cf8c-49ab-a361-46e72af1e0a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ea8e1fe74f4d999b772a1cf3ddb474)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:44.281713 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c535287-cf8c-49ab-a361-46e72af1e0a3 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:44.396860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-8c535287-cf8c-49ab-a361-46e72af1e0a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ea8e1fe74f4d999b772a1cf3ddb474', 'request_id': 'req-8c535287-cf8c-49ab-a361-46e72af1e0a3'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:44.462388 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-8c535287-cf8c-49ab-a361-46e72af1e0a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ea8e1fe74f4d999b772a1cf3ddb474', 'request_id': 'req-8c535287-cf8c-49ab-a361-46e72af1e0a3'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:44.469199 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-8c535287-cf8c-49ab-a361-46e72af1e0a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ea8e1fe74f4d999b772a1cf3ddb474', 'request_id': 'req-8c535287-cf8c-49ab-a361-46e72af1e0a3'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:44.479443 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-8c535287-cf8c-49ab-a361-46e72af1e0a3 admin admin] The token cache is being invalidate because project 81ea8e1fe74f4d999b772a1cf3ddb474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:13:44.482052 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-8c535287-cf8c-49ab-a361-46e72af1e0a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:44.482052 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-8c535287-cf8c-49ab-a361-46e72af1e0a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:44.482052 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1408/2816] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:13:44 2022] DELETE /identity/v3/projects/81ea8e1fe74f4d999b772a1cf3ddb474 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:44.487501 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e66f2a-3e72-4abe-9257-80631cdc4a97 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:44.487994 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e66f2a-3e72-4abe-9257-80631cdc4a97 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:44.488092 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e66f2a-3e72-4abe-9257-80631cdc4a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:44.507401 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-03e66f2a-3e72-4abe-9257-80631cdc4a97 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:44.508605 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-03e66f2a-3e72-4abe-9257-80631cdc4a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:44.568349 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1409/2817] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:13:44.577133 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f7c78-1a6c-4b43-b298-b0cd15cc7073 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:44.577508 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f7c78-1a6c-4b43-b298-b0cd15cc7073 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:44.577808 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f7c78-1a6c-4b43-b298-b0cd15cc7073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:44.596702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-c86f7c78-1a6c-4b43-b298-b0cd15cc7073 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:44.597926 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c86f7c78-1a6c-4b43-b298-b0cd15cc7073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:44.606020 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1409/2818] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:13:44.610995 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e66f2a-3e72-4abe-9257-80631cdc4a97 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:44.620860 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e66f2a-3e72-4abe-9257-80631cdc4a97 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:44.626685 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee779187-bc22-4ed9-a4a9-4489d1a23356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:44.629961 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee779187-bc22-4ed9-a4a9-4489d1a23356 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:44.629961 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee779187-bc22-4ed9-a4a9-4489d1a23356 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:44.629961 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee779187-bc22-4ed9-a4a9-4489d1a23356 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:44.629961 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee779187-bc22-4ed9-a4a9-4489d1a23356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:13:44.629961 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee779187-bc22-4ed9-a4a9-4489d1a23356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:44.630622 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee779187-bc22-4ed9-a4a9-4489d1a23356 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:44.643487 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1410/2819] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:13:44.647911 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f7c78-1a6c-4b43-b298-b0cd15cc7073 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:44.657553 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f7c78-1a6c-4b43-b298-b0cd15cc7073 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:44.662291 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1a587-b262-469a-ac9e-d9125d26e3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:44.662946 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1a587-b262-469a-ac9e-d9125d26e3ca admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:44.663226 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1a587-b262-469a-ac9e-d9125d26e3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:44.663498 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1a587-b262-469a-ac9e-d9125d26e3ca admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:44.664192 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1a587-b262-469a-ac9e-d9125d26e3ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:44.666129 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1a587-b262-469a-ac9e-d9125d26e3ca admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:44.766759 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1410/2820] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:13:44 2022] POST /identity/v3/projects => generated 401 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:13:44.770950 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee779187-bc22-4ed9-a4a9-4489d1a23356 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:44.781248 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee779187-bc22-4ed9-a4a9-4489d1a23356 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:44.838159 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd1dce-7a4c-40c6-8d5a-a70d1a47e0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:44.838817 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd1dce-7a4c-40c6-8d5a-a70d1a47e0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:44.839098 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd1dce-7a4c-40c6-8d5a-a70d1a47e0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:44.839374 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd1dce-7a4c-40c6-8d5a-a70d1a47e0a9 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:44.840072 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd1dce-7a4c-40c6-8d5a-a70d1a47e0a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:44.842018 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd1dce-7a4c-40c6-8d5a-a70d1a47e0a9 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:44.960078 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1411/2821] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:13:44 2022] POST /identity/v3/users => generated 301 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:13:44.964101 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1a587-b262-469a-ac9e-d9125d26e3ca admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:44.975058 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1a587-b262-469a-ac9e-d9125d26e3ca admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:44.979756 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94211e7b-8b31-435c-bcf3-995262be0131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:44.980419 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94211e7b-8b31-435c-bcf3-995262be0131 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:44.980747 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94211e7b-8b31-435c-bcf3-995262be0131 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:44.981031 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94211e7b-8b31-435c-bcf3-995262be0131 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:44.981762 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94211e7b-8b31-435c-bcf3-995262be0131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:44.983956 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94211e7b-8b31-435c-bcf3-995262be0131 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:44.995790 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1411/2822] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:13:45.000659 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd1dce-7a4c-40c6-8d5a-a70d1a47e0a9 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:45.010966 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd1dce-7a4c-40c6-8d5a-a70d1a47e0a9 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:45.015850 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdc88c-4bf5-4ec1-bbe4-afbf6b3d2789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:45.016500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdc88c-4bf5-4ec1-bbe4-afbf6b3d2789 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:45.016880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdc88c-4bf5-4ec1-bbe4-afbf6b3d2789 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:45.017084 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdc88c-4bf5-4ec1-bbe4-afbf6b3d2789 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:45.017836 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdc88c-4bf5-4ec1-bbe4-afbf6b3d2789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:45.019428 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdc88c-4bf5-4ec1-bbe4-afbf6b3d2789 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:45.029118 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1412/2823] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:13:45.033306 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94211e7b-8b31-435c-bcf3-995262be0131 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:45.042934 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94211e7b-8b31-435c-bcf3-995262be0131 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:45.047961 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b5912-4b1a-48e3-a5f6-ff8e11154a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:45.048845 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b5912-4b1a-48e3-a5f6-ff8e11154a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:45.049119 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b5912-4b1a-48e3-a5f6-ff8e11154a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:45.049383 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b5912-4b1a-48e3-a5f6-ff8e11154a9e admin admin] PATH_INFO: `/v3/projects/e9a8785963a4460fae7a629df7308a91/users/809698633e814b4b9ef1a52caef24be0/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:45.064135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b5912-4b1a-48e3-a5f6-ff8e11154a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a8785963a4460fae7a629df7308a91, user_id=809698633e814b4b9ef1a52caef24be0, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:45.066784 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b5912-4b1a-48e3-a5f6-ff8e11154a9e admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:45.145741 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1412/2824] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:13:45 2022] PUT /identity/v3/projects/e9a8785963a4460fae7a629df7308a91/users/809698633e814b4b9ef1a52caef24be0/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:45.157720 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4e416-3ac2-4e0c-a8be-696f4d65db3f None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:45.158040 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4e416-3ac2-4e0c-a8be-696f4d65db3f None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:45.158337 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4e416-3ac2-4e0c-a8be-696f4d65db3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:45.185399 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-73c4e416-3ac2-4e0c-a8be-696f4d65db3f None None] MFA Rules not processed for user `809698633e814b4b9ef1a52caef24be0`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:45.186780 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-73c4e416-3ac2-4e0c-a8be-696f4d65db3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:45.248870 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1413/2825] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:13:45.253463 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b5912-4b1a-48e3-a5f6-ff8e11154a9e admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:45.314545 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b5912-4b1a-48e3-a5f6-ff8e11154a9e admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:45.319131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c3c3f-ac4a-4877-aaac-3661c97a59b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:45.319785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c3c3f-ac4a-4877-aaac-3661c97a59b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:45.320065 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c3c3f-ac4a-4877-aaac-3661c97a59b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:45.320340 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c3c3f-ac4a-4877-aaac-3661c97a59b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:45.321093 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c3c3f-ac4a-4877-aaac-3661c97a59b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:45.322988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c3c3f-ac4a-4877-aaac-3661c97a59b7 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:45.481612 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1413/2826] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:13:45 2022] POST /identity/v3/projects => generated 399 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:13:45.485845 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4e416-3ac2-4e0c-a8be-696f4d65db3f None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:45.496539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4e416-3ac2-4e0c-a8be-696f4d65db3f None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:45.552192 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c523d-ad89-4eff-b742-dd08fdaeb6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:45.552951 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c523d-ad89-4eff-b742-dd08fdaeb6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:45.553230 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c523d-ad89-4eff-b742-dd08fdaeb6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:45.553504 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c523d-ad89-4eff-b742-dd08fdaeb6e4 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:45.554210 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c523d-ad89-4eff-b742-dd08fdaeb6e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:45.556183 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c523d-ad89-4eff-b742-dd08fdaeb6e4 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:45.686594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1414/2827] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:13:45 2022] POST /identity/v3/users => generated 306 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:13:45.690970 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c3c3f-ac4a-4877-aaac-3661c97a59b7 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:45.702192 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c3c3f-ac4a-4877-aaac-3661c97a59b7 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:45.706969 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938adf95-df6d-4551-8a0a-e5dc4d1ffd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:45.707670 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938adf95-df6d-4551-8a0a-e5dc4d1ffd76 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:45.707951 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938adf95-df6d-4551-8a0a-e5dc4d1ffd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:45.708223 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938adf95-df6d-4551-8a0a-e5dc4d1ffd76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:45.708990 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938adf95-df6d-4551-8a0a-e5dc4d1ffd76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:45.710677 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938adf95-df6d-4551-8a0a-e5dc4d1ffd76 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:45.722884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1414/2828] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:13:45.727144 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c523d-ad89-4eff-b742-dd08fdaeb6e4 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:45.737623 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c523d-ad89-4eff-b742-dd08fdaeb6e4 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:45.742273 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b554e-b593-4628-a4c7-bf79020672cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:45.743138 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b554e-b593-4628-a4c7-bf79020672cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:45.743415 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b554e-b593-4628-a4c7-bf79020672cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:45.743688 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b554e-b593-4628-a4c7-bf79020672cb admin admin] PATH_INFO: `/v3/projects/0960ce7f12aa456fac81720c15298429/users/df8c1870f47f4c4abf8ddd6d3a740bb3/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:45.759776 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b554e-b593-4628-a4c7-bf79020672cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0960ce7f12aa456fac81720c15298429, user_id=df8c1870f47f4c4abf8ddd6d3a740bb3, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:45.762503 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b554e-b593-4628-a4c7-bf79020672cb admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:45.860106 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1415/2829] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:13:45 2022] PUT /identity/v3/projects/0960ce7f12aa456fac81720c15298429/users/df8c1870f47f4c4abf8ddd6d3a740bb3/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:45.864487 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938adf95-df6d-4551-8a0a-e5dc4d1ffd76 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:45.875809 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938adf95-df6d-4551-8a0a-e5dc4d1ffd76 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:45.933719 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05de062-91ab-4f88-8ae5-ae505c016a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:45.934395 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05de062-91ab-4f88-8ae5-ae505c016a5e admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:45.934679 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05de062-91ab-4f88-8ae5-ae505c016a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:45.934959 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05de062-91ab-4f88-8ae5-ae505c016a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:45.936193 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05de062-91ab-4f88-8ae5-ae505c016a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:45.938064 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05de062-91ab-4f88-8ae5-ae505c016a5e admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:45.948082 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1415/2830] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:13:45.952891 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b554e-b593-4628-a4c7-bf79020672cb admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:45.963196 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b554e-b593-4628-a4c7-bf79020672cb admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:45.968191 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cf7b9-b7e3-40d1-b575-9355cd4b8cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:45.969744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cf7b9-b7e3-40d1-b575-9355cd4b8cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:45.969744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cf7b9-b7e3-40d1-b575-9355cd4b8cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:45.969744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cf7b9-b7e3-40d1-b575-9355cd4b8cdc admin admin] PATH_INFO: `/v3/projects/0960ce7f12aa456fac81720c15298429/users/df8c1870f47f4c4abf8ddd6d3a740bb3/roles/aa032515dce047fbb4cf1651e0d95979` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:45.973225 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cf7b9-b7e3-40d1-b575-9355cd4b8cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0960ce7f12aa456fac81720c15298429, user_id=df8c1870f47f4c4abf8ddd6d3a740bb3, role_id=aa032515dce047fbb4cf1651e0d95979)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:45.976055 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cf7b9-b7e3-40d1-b575-9355cd4b8cdc admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:45.987833 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1416/2831] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:13:45 2022] PUT /identity/v3/projects/0960ce7f12aa456fac81720c15298429/users/df8c1870f47f4c4abf8ddd6d3a740bb3/roles/aa032515dce047fbb4cf1651e0d95979 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:46.004138 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02bc38-c0e0-40d1-baf8-b3f4fdc07110 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:46.004422 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02bc38-c0e0-40d1-baf8-b3f4fdc07110 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:46.004769 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02bc38-c0e0-40d1-baf8-b3f4fdc07110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:46.039810 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-9c02bc38-c0e0-40d1-baf8-b3f4fdc07110 None None] MFA Rules not processed for user `df8c1870f47f4c4abf8ddd6d3a740bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:46.041057 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-9c02bc38-c0e0-40d1-baf8-b3f4fdc07110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:46.115611 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1416/2832] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:46 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:13:46.129315 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cf7b9-b7e3-40d1-b575-9355cd4b8cdc admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:46.131010 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-740cf7b9-b7e3-40d1-b575-9355cd4b8cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:46.202122 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cf7b9-b7e3-40d1-b575-9355cd4b8cdc admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:46.208521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b521853-fb52-419b-ad5d-a1ca63e4ac7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:46.209193 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b521853-fb52-419b-ad5d-a1ca63e4ac7b service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:46.209472 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b521853-fb52-419b-ad5d-a1ca63e4ac7b service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:46.209742 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b521853-fb52-419b-ad5d-a1ca63e4ac7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:46.220312 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b521853-fb52-419b-ad5d-a1ca63e4ac7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:46.222022 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b521853-fb52-419b-ad5d-a1ca63e4ac7b service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:46.234632 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1417/2833] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:13:46 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:13:46.467225 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02bc38-c0e0-40d1-baf8-b3f4fdc07110 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:46.477186 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02bc38-c0e0-40d1-baf8-b3f4fdc07110 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:46.480726 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd91cb-8591-43b6-b33c-2705b48ab04f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:46.481357 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd91cb-8591-43b6-b33c-2705b48ab04f service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:46.481633 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd91cb-8591-43b6-b33c-2705b48ab04f service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:46.481930 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd91cb-8591-43b6-b33c-2705b48ab04f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:46.538415 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd91cb-8591-43b6-b33c-2705b48ab04f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:46.539840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd91cb-8591-43b6-b33c-2705b48ab04f service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:46.549491 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1417/2834] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:13:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:13:51.949119 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b521853-fb52-419b-ad5d-a1ca63e4ac7b service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:52.010331 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b521853-fb52-419b-ad5d-a1ca63e4ac7b service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:52.015843 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e294d8-7c97-4dac-988c-71ee39bd54e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:52.016742 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e294d8-7c97-4dac-988c-71ee39bd54e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:52.017027 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e294d8-7c97-4dac-988c-71ee39bd54e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:52.017326 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e294d8-7c97-4dac-988c-71ee39bd54e6 admin admin] PATH_INFO: `/v3/users/809698633e814b4b9ef1a52caef24be0` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:52.018518 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e294d8-7c97-4dac-988c-71ee39bd54e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=809698633e814b4b9ef1a52caef24be0)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:52.020435 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e294d8-7c97-4dac-988c-71ee39bd54e6 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:52.270902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-98e294d8-7c97-4dac-988c-71ee39bd54e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '809698633e814b4b9ef1a52caef24be0'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:52.271596 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-98e294d8-7c97-4dac-988c-71ee39bd54e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '809698633e814b4b9ef1a52caef24be0'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:52.287592 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-98e294d8-7c97-4dac-988c-71ee39bd54e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '809698633e814b4b9ef1a52caef24be0'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:52.294069 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-98e294d8-7c97-4dac-988c-71ee39bd54e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '809698633e814b4b9ef1a52caef24be0'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:52.294825 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-98e294d8-7c97-4dac-988c-71ee39bd54e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '809698633e814b4b9ef1a52caef24be0'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:52.399498 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1418/2835] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:13:51 2022] DELETE /identity/v3/users/809698633e814b4b9ef1a52caef24be0 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:52.404895 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50237e3b-a087-40af-88b8-b22859ae2295 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:52.405381 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50237e3b-a087-40af-88b8-b22859ae2295 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:52.405510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50237e3b-a087-40af-88b8-b22859ae2295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:52.422227 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-50237e3b-a087-40af-88b8-b22859ae2295 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:52.423434 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-50237e3b-a087-40af-88b8-b22859ae2295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:52.480874 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1418/2836] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:13:52.490816 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e294d8-7c97-4dac-988c-71ee39bd54e6 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:52.492264 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-98e294d8-7c97-4dac-988c-71ee39bd54e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:52.549775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e294d8-7c97-4dac-988c-71ee39bd54e6 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:52.553288 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411046d-5e6c-46cb-b70e-395ce5521e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:52.556175 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411046d-5e6c-46cb-b70e-395ce5521e5f service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:52.556175 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411046d-5e6c-46cb-b70e-395ce5521e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:52.556175 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411046d-5e6c-46cb-b70e-395ce5521e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:52.564235 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411046d-5e6c-46cb-b70e-395ce5521e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:52.565744 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411046d-5e6c-46cb-b70e-395ce5521e5f service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:52.576603 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1419/2837] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:13:53.036357 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50237e3b-a087-40af-88b8-b22859ae2295 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:53.037863 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-50237e3b-a087-40af-88b8-b22859ae2295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:53.051115 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50237e3b-a087-40af-88b8-b22859ae2295 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:53.055782 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b379d-fff8-4038-b98c-2e195af8da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:53.056770 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b379d-fff8-4038-b98c-2e195af8da99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:53.056983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b379d-fff8-4038-b98c-2e195af8da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:53.057929 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b379d-fff8-4038-b98c-2e195af8da99 admin admin] PATH_INFO: `/v3/projects/e9a8785963a4460fae7a629df7308a91` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:53.059555 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b379d-fff8-4038-b98c-2e195af8da99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a8785963a4460fae7a629df7308a91)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:53.062599 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b379d-fff8-4038-b98c-2e195af8da99 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:53.173584 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-4a9b379d-fff8-4038-b98c-2e195af8da99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a8785963a4460fae7a629df7308a91', 'request_id': 'req-4a9b379d-fff8-4038-b98c-2e195af8da99'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:53.311170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-4a9b379d-fff8-4038-b98c-2e195af8da99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a8785963a4460fae7a629df7308a91', 'request_id': 'req-4a9b379d-fff8-4038-b98c-2e195af8da99'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:53.318474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-4a9b379d-fff8-4038-b98c-2e195af8da99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a8785963a4460fae7a629df7308a91', 'request_id': 'req-4a9b379d-fff8-4038-b98c-2e195af8da99'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:53.329170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-4a9b379d-fff8-4038-b98c-2e195af8da99 admin admin] The token cache is being invalidate because project e9a8785963a4460fae7a629df7308a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:13:53.329554 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-4a9b379d-fff8-4038-b98c-2e195af8da99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:53.330433 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-4a9b379d-fff8-4038-b98c-2e195af8da99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:53.332143 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1419/2838] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:13:53 2022] DELETE /identity/v3/projects/e9a8785963a4460fae7a629df7308a91 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:53.335977 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411046d-5e6c-46cb-b70e-395ce5521e5f service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:53.347317 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411046d-5e6c-46cb-b70e-395ce5521e5f service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:53.403241 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade3867-885c-4f72-929e-7f7597727b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:53.405032 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade3867-885c-4f72-929e-7f7597727b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:53.405319 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade3867-885c-4f72-929e-7f7597727b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:53.405597 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade3867-885c-4f72-929e-7f7597727b1a admin admin] PATH_INFO: `/v3/users/df8c1870f47f4c4abf8ddd6d3a740bb3` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:53.407346 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade3867-885c-4f72-929e-7f7597727b1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=df8c1870f47f4c4abf8ddd6d3a740bb3)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:53.409348 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade3867-885c-4f72-929e-7f7597727b1a admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:53.676990 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3ade3867-885c-4f72-929e-7f7597727b1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df8c1870f47f4c4abf8ddd6d3a740bb3'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:53.677848 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3ade3867-885c-4f72-929e-7f7597727b1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df8c1870f47f4c4abf8ddd6d3a740bb3'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:53.689580 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3ade3867-885c-4f72-929e-7f7597727b1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df8c1870f47f4c4abf8ddd6d3a740bb3'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:53.696325 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3ade3867-885c-4f72-929e-7f7597727b1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df8c1870f47f4c4abf8ddd6d3a740bb3'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:53.697030 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-3ade3867-885c-4f72-929e-7f7597727b1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df8c1870f47f4c4abf8ddd6d3a740bb3'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:53.822595 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1420/2839] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:13:53 2022] DELETE /identity/v3/users/df8c1870f47f4c4abf8ddd6d3a740bb3 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:54.243974 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b379d-fff8-4038-b98c-2e195af8da99 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:54.245568 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-4a9b379d-fff8-4038-b98c-2e195af8da99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:54.260135 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b379d-fff8-4038-b98c-2e195af8da99 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:54.323497 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a34c34-cd62-4d72-aae4-13d7d2d6e450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:54.324612 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a34c34-cd62-4d72-aae4-13d7d2d6e450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:54.324895 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a34c34-cd62-4d72-aae4-13d7d2d6e450 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:54.325170 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a34c34-cd62-4d72-aae4-13d7d2d6e450 admin admin] PATH_INFO: `/v3/projects/0960ce7f12aa456fac81720c15298429` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:54.326506 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a34c34-cd62-4d72-aae4-13d7d2d6e450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0960ce7f12aa456fac81720c15298429)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:54.328473 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a34c34-cd62-4d72-aae4-13d7d2d6e450 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:54.453724 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d5a34c34-cd62-4d72-aae4-13d7d2d6e450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0960ce7f12aa456fac81720c15298429', 'request_id': 'req-d5a34c34-cd62-4d72-aae4-13d7d2d6e450'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:54.542500 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d5a34c34-cd62-4d72-aae4-13d7d2d6e450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0960ce7f12aa456fac81720c15298429', 'request_id': 'req-d5a34c34-cd62-4d72-aae4-13d7d2d6e450'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:54.550470 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d5a34c34-cd62-4d72-aae4-13d7d2d6e450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0960ce7f12aa456fac81720c15298429', 'request_id': 'req-d5a34c34-cd62-4d72-aae4-13d7d2d6e450'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:54.567738 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d5a34c34-cd62-4d72-aae4-13d7d2d6e450 admin admin] The token cache is being invalidate because project 0960ce7f12aa456fac81720c15298429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:13:54.568878 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d5a34c34-cd62-4d72-aae4-13d7d2d6e450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:54.570102 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-d5a34c34-cd62-4d72-aae4-13d7d2d6e450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:13:54.573510 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1420/2840] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:13:54 2022] DELETE /identity/v3/projects/0960ce7f12aa456fac81720c15298429 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:54.579053 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e582ef-0888-4826-ba00-f4d9e8f54902 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:54.579563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e582ef-0888-4826-ba00-f4d9e8f54902 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:54.579672 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e582ef-0888-4826-ba00-f4d9e8f54902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:54.600373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-f2e582ef-0888-4826-ba00-f4d9e8f54902 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:54.601681 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-f2e582ef-0888-4826-ba00-f4d9e8f54902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:54.676764 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1421/2841] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:13:54.681873 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed80eda-cd69-42e4-8b07-9b903097e092 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:54.682166 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed80eda-cd69-42e4-8b07-9b903097e092 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:54.682446 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed80eda-cd69-42e4-8b07-9b903097e092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:54.707011 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-fed80eda-cd69-42e4-8b07-9b903097e092 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:54.708252 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-fed80eda-cd69-42e4-8b07-9b903097e092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:54.721988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1421/2842] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:13:54.723234 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e582ef-0888-4826-ba00-f4d9e8f54902 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:54.734735 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e582ef-0888-4826-ba00-f4d9e8f54902 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:54.740497 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa0573-b2d4-44d2-9c0c-82073ea7c44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:54.741610 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa0573-b2d4-44d2-9c0c-82073ea7c44f admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:54.742051 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa0573-b2d4-44d2-9c0c-82073ea7c44f admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:54.742482 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa0573-b2d4-44d2-9c0c-82073ea7c44f admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:54.743421 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa0573-b2d4-44d2-9c0c-82073ea7c44f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:13:54.743891 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa0573-b2d4-44d2-9c0c-82073ea7c44f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:54.745842 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa0573-b2d4-44d2-9c0c-82073ea7c44f admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:54.767918 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1422/2843] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 14 22:13:54.772592 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed80eda-cd69-42e4-8b07-9b903097e092 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:54.784426 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed80eda-cd69-42e4-8b07-9b903097e092 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:54.791284 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d45e50-a3bc-4b73-8d07-182d50f86736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:54.799692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d45e50-a3bc-4b73-8d07-182d50f86736 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:54.799692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d45e50-a3bc-4b73-8d07-182d50f86736 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:54.799692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d45e50-a3bc-4b73-8d07-182d50f86736 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:54.799692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d45e50-a3bc-4b73-8d07-182d50f86736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:54.799692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d45e50-a3bc-4b73-8d07-182d50f86736 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:54.913796 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1422/2844] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:13:54 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:13:54.917764 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa0573-b2d4-44d2-9c0c-82073ea7c44f admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:54.936104 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa0573-b2d4-44d2-9c0c-82073ea7c44f admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:55.004213 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d02f89-fb52-4f65-af11-21a447a352ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:55.005105 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d02f89-fb52-4f65-af11-21a447a352ac admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:55.005392 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d02f89-fb52-4f65-af11-21a447a352ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:55.005671 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d02f89-fb52-4f65-af11-21a447a352ac admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:55.006482 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d02f89-fb52-4f65-af11-21a447a352ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:55.008458 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d02f89-fb52-4f65-af11-21a447a352ac admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:55.122853 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1423/2845] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:13:54 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:13:55.126860 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d45e50-a3bc-4b73-8d07-182d50f86736 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:55.138093 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d45e50-a3bc-4b73-8d07-182d50f86736 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:55.143546 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e53bd-8064-4cfa-a037-f584ed69ccf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:55.144217 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e53bd-8064-4cfa-a037-f584ed69ccf6 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:55.144549 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e53bd-8064-4cfa-a037-f584ed69ccf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:55.144884 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e53bd-8064-4cfa-a037-f584ed69ccf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:55.145609 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e53bd-8064-4cfa-a037-f584ed69ccf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:55.147267 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e53bd-8064-4cfa-a037-f584ed69ccf6 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:55.159455 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1423/2846] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 14 22:13:55.164093 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d02f89-fb52-4f65-af11-21a447a352ac admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:55.175977 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d02f89-fb52-4f65-af11-21a447a352ac admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:55.182441 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cc12d-a973-4b15-8555-818a15c46ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:55.183119 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cc12d-a973-4b15-8555-818a15c46ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:55.183408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cc12d-a973-4b15-8555-818a15c46ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:55.183697 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cc12d-a973-4b15-8555-818a15c46ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:55.184408 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cc12d-a973-4b15-8555-818a15c46ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:55.186113 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cc12d-a973-4b15-8555-818a15c46ea7 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:55.196423 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1424/2847] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:13:55.201168 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e53bd-8064-4cfa-a037-f584ed69ccf6 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:55.211481 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e53bd-8064-4cfa-a037-f584ed69ccf6 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:55.218559 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7b610-4879-459a-97b0-3d47f8323df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:55.218559 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7b610-4879-459a-97b0-3d47f8323df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:55.218559 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7b610-4879-459a-97b0-3d47f8323df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:55.218559 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7b610-4879-459a-97b0-3d47f8323df6 admin admin] PATH_INFO: `/v3/projects/c17d2d2abe3f4ea8854c2c174dfbaaf0/users/90e14ccc7ab1464a94ab7903c6f2c015/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:55.239381 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7b610-4879-459a-97b0-3d47f8323df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c17d2d2abe3f4ea8854c2c174dfbaaf0, user_id=90e14ccc7ab1464a94ab7903c6f2c015, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:55.242220 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7b610-4879-459a-97b0-3d47f8323df6 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:55.352882 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1424/2848] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:13:55 2022] PUT /identity/v3/projects/c17d2d2abe3f4ea8854c2c174dfbaaf0/users/90e14ccc7ab1464a94ab7903c6f2c015/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:13:55.363604 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbda540-7c99-44ea-919c-f0cce94182a2 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:55.363894 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbda540-7c99-44ea-919c-f0cce94182a2 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:55.364173 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbda540-7c99-44ea-919c-f0cce94182a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:55.394693 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-bbbda540-7c99-44ea-919c-f0cce94182a2 None None] MFA Rules not processed for user `90e14ccc7ab1464a94ab7903c6f2c015`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:13:55.395968 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-bbbda540-7c99-44ea-919c-f0cce94182a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:55.481539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1425/2849] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:13:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:13:55.492131 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7b610-4879-459a-97b0-3d47f8323df6 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:13:55.493520 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-f2f7b610-4879-459a-97b0-3d47f8323df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:13:55.587988 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7b610-4879-459a-97b0-3d47f8323df6 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:13:55.592182 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab195fa-4a7f-4614-ad87-1d5a49b8a29b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d261ec6e42f4be08c4d584fd3d00850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:13:55.592888 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab195fa-4a7f-4614-ad87-1d5a49b8a29b service glance] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:13:55.593360 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab195fa-4a7f-4614-ad87-1d5a49b8a29b service glance] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:13:55.593643 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab195fa-4a7f-4614-ad87-1d5a49b8a29b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:13:55.603611 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab195fa-4a7f-4614-ad87-1d5a49b8a29b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:13:55.605146 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab195fa-4a7f-4614-ad87-1d5a49b8a29b service glance] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:13:55.617653 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1425/2850] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:13:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:14:09.728070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbda540-7c99-44ea-919c-f0cce94182a2 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:09.729547 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-bbbda540-7c99-44ea-919c-f0cce94182a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:09.794640 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbda540-7c99-44ea-919c-f0cce94182a2 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:09.798536 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feadaf9c-1e32-437b-ad74-6dbe157b0681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:09.799204 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feadaf9c-1e32-437b-ad74-6dbe157b0681 service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:09.799483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feadaf9c-1e32-437b-ad74-6dbe157b0681 service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:09.799755 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feadaf9c-1e32-437b-ad74-6dbe157b0681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:09.801622 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-feadaf9c-1e32-437b-ad74-6dbe157b0681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:09.873087 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feadaf9c-1e32-437b-ad74-6dbe157b0681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:09.874553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feadaf9c-1e32-437b-ad74-6dbe157b0681 service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:09.891193 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1426/2851] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:14:18.928475 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab195fa-4a7f-4614-ad87-1d5a49b8a29b service glance] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:18.932784 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-aab195fa-4a7f-4614-ad87-1d5a49b8a29b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:18.944325 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab195fa-4a7f-4614-ad87-1d5a49b8a29b service glance] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:18.948855 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c63cc-be60-4bdc-9933-05b041d190cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:18.949834 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c63cc-be60-4bdc-9933-05b041d190cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:18.950107 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c63cc-be60-4bdc-9933-05b041d190cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:18.950379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c63cc-be60-4bdc-9933-05b041d190cf admin admin] PATH_INFO: `/v3/users/8066cbf7602941abbe345006dac52359` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:18.951563 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c63cc-be60-4bdc-9933-05b041d190cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8066cbf7602941abbe345006dac52359)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:18.953526 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c63cc-be60-4bdc-9933-05b041d190cf admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:19.232647 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e35c63cc-be60-4bdc-9933-05b041d190cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8066cbf7602941abbe345006dac52359'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:19.233556 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e35c63cc-be60-4bdc-9933-05b041d190cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8066cbf7602941abbe345006dac52359'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:19.247182 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e35c63cc-be60-4bdc-9933-05b041d190cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8066cbf7602941abbe345006dac52359'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:19.253895 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e35c63cc-be60-4bdc-9933-05b041d190cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8066cbf7602941abbe345006dac52359'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:19.254594 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-e35c63cc-be60-4bdc-9933-05b041d190cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8066cbf7602941abbe345006dac52359'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:19.337835 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1426/2852] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:14:18 2022] DELETE /identity/v3/users/8066cbf7602941abbe345006dac52359 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:14:19.609243 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feadaf9c-1e32-437b-ad74-6dbe157b0681 service neutron] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:19.619118 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feadaf9c-1e32-437b-ad74-6dbe157b0681 service neutron] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:19.677322 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:19.678169 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:19.678446 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:19.678713 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02 admin admin] PATH_INFO: `/v3/projects/40579fb10b2242a9a17aef3f68c7248d` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:19.679877 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40579fb10b2242a9a17aef3f68c7248d)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:19.681791 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:19.827519 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40579fb10b2242a9a17aef3f68c7248d', 'request_id': 'req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:19.967178 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40579fb10b2242a9a17aef3f68c7248d', 'request_id': 'req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:19.974711 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40579fb10b2242a9a17aef3f68c7248d', 'request_id': 'req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:19.990087 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02 admin admin] The token cache is being invalidate because project 40579fb10b2242a9a17aef3f68c7248d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:14:19.990383 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:19.991065 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:19.992646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1427/2853] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:14:19 2022] DELETE /identity/v3/projects/40579fb10b2242a9a17aef3f68c7248d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:14:19.996914 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c63cc-be60-4bdc-9933-05b041d190cf admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:19.998445 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-e35c63cc-be60-4bdc-9933-05b041d190cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:20.011359 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c63cc-be60-4bdc-9933-05b041d190cf admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:20.070053 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda828b-c0a8-4805-9ff4-fc94a153a4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:20.070927 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda828b-c0a8-4805-9ff4-fc94a153a4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:20.071222 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda828b-c0a8-4805-9ff4-fc94a153a4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:20.071497 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda828b-c0a8-4805-9ff4-fc94a153a4c8 admin admin] PATH_INFO: `/v3/users/fcce48cd367e480a9ee146ea0a1488d5` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:20.072716 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda828b-c0a8-4805-9ff4-fc94a153a4c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcce48cd367e480a9ee146ea0a1488d5)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:20.075549 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda828b-c0a8-4805-9ff4-fc94a153a4c8 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:20.297785 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-5fda828b-c0a8-4805-9ff4-fc94a153a4c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcce48cd367e480a9ee146ea0a1488d5'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:20.298434 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-5fda828b-c0a8-4805-9ff4-fc94a153a4c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcce48cd367e480a9ee146ea0a1488d5'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:20.310439 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-5fda828b-c0a8-4805-9ff4-fc94a153a4c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcce48cd367e480a9ee146ea0a1488d5'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:20.318124 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-5fda828b-c0a8-4805-9ff4-fc94a153a4c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcce48cd367e480a9ee146ea0a1488d5'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:20.318804 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-5fda828b-c0a8-4805-9ff4-fc94a153a4c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcce48cd367e480a9ee146ea0a1488d5'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:20.439675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1427/2854] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:14:19 2022] DELETE /identity/v3/users/fcce48cd367e480a9ee146ea0a1488d5 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:14:20.743389 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:20.745568 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:20.760237 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55b0b7-98d7-46cf-bf79-5ce6e40a6d02 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:20.821629 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d36e6e-7b89-41da-971e-8aa17e90d1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:20.822500 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d36e6e-7b89-41da-971e-8aa17e90d1ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:20.822780 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d36e6e-7b89-41da-971e-8aa17e90d1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:20.823057 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d36e6e-7b89-41da-971e-8aa17e90d1ea admin admin] PATH_INFO: `/v3/projects/1642a7a3568f42bb8ce42be2630feb05` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:20.824805 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d36e6e-7b89-41da-971e-8aa17e90d1ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1642a7a3568f42bb8ce42be2630feb05)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:20.826809 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d36e6e-7b89-41da-971e-8aa17e90d1ea admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:20.936361 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e9d36e6e-7b89-41da-971e-8aa17e90d1ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1642a7a3568f42bb8ce42be2630feb05', 'request_id': 'req-e9d36e6e-7b89-41da-971e-8aa17e90d1ea'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:21.027218 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e9d36e6e-7b89-41da-971e-8aa17e90d1ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1642a7a3568f42bb8ce42be2630feb05', 'request_id': 'req-e9d36e6e-7b89-41da-971e-8aa17e90d1ea'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:21.034920 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e9d36e6e-7b89-41da-971e-8aa17e90d1ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1642a7a3568f42bb8ce42be2630feb05', 'request_id': 'req-e9d36e6e-7b89-41da-971e-8aa17e90d1ea'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:21.045840 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e9d36e6e-7b89-41da-971e-8aa17e90d1ea admin admin] The token cache is being invalidate because project 1642a7a3568f42bb8ce42be2630feb05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:14:21.046125 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e9d36e6e-7b89-41da-971e-8aa17e90d1ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:21.046775 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-e9d36e6e-7b89-41da-971e-8aa17e90d1ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:21.048324 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1428/2855] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:14:20 2022] DELETE /identity/v3/projects/1642a7a3568f42bb8ce42be2630feb05 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:14:21.534824 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda828b-c0a8-4805-9ff4-fc94a153a4c8 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:21.536258 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5fda828b-c0a8-4805-9ff4-fc94a153a4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:21.552485 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda828b-c0a8-4805-9ff4-fc94a153a4c8 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:21.657544 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c563a4b-1a0b-415a-9588-f5a314334fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:21.658415 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c563a4b-1a0b-415a-9588-f5a314334fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:21.658714 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c563a4b-1a0b-415a-9588-f5a314334fba admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:21.658987 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c563a4b-1a0b-415a-9588-f5a314334fba admin admin] PATH_INFO: `/v3/users/90e14ccc7ab1464a94ab7903c6f2c015` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:21.660154 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c563a4b-1a0b-415a-9588-f5a314334fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e14ccc7ab1464a94ab7903c6f2c015)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:21.662094 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c563a4b-1a0b-415a-9588-f5a314334fba admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:21.880856 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6c563a4b-1a0b-415a-9588-f5a314334fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e14ccc7ab1464a94ab7903c6f2c015'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:21.881491 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6c563a4b-1a0b-415a-9588-f5a314334fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e14ccc7ab1464a94ab7903c6f2c015'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:21.894127 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6c563a4b-1a0b-415a-9588-f5a314334fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e14ccc7ab1464a94ab7903c6f2c015'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:21.900684 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6c563a4b-1a0b-415a-9588-f5a314334fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e14ccc7ab1464a94ab7903c6f2c015'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:21.901341 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6c563a4b-1a0b-415a-9588-f5a314334fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e14ccc7ab1464a94ab7903c6f2c015'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:21.972845 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1428/2856] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:14:21 2022] DELETE /identity/v3/users/90e14ccc7ab1464a94ab7903c6f2c015 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:14:21.977474 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9cea5-64c2-4173-b746-5c15f4221466 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:21.977970 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9cea5-64c2-4173-b746-5c15f4221466 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:21.978087 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9cea5-64c2-4173-b746-5c15f4221466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:21.997247 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-adb9cea5-64c2-4173-b746-5c15f4221466 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:14:21.998449 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-adb9cea5-64c2-4173-b746-5c15f4221466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:22.055382 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1429/2857] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:14:22.065575 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c563a4b-1a0b-415a-9588-f5a314334fba admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:22.066968 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-6c563a4b-1a0b-415a-9588-f5a314334fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:22.123335 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c563a4b-1a0b-415a-9588-f5a314334fba admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:22.126897 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366de1c4-85e3-40d6-a4d1-3f91bbb93935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:22.127536 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366de1c4-85e3-40d6-a4d1-3f91bbb93935 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:22.127815 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366de1c4-85e3-40d6-a4d1-3f91bbb93935 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:22.128088 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366de1c4-85e3-40d6-a4d1-3f91bbb93935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:22.137665 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366de1c4-85e3-40d6-a4d1-3f91bbb93935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:22.138991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366de1c4-85e3-40d6-a4d1-3f91bbb93935 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:22.148223 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1429/2858] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:14:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:14:22.561717 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9cea5-64c2-4173-b746-5c15f4221466 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:22.563136 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-adb9cea5-64c2-4173-b746-5c15f4221466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:22.576351 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9cea5-64c2-4173-b746-5c15f4221466 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:22.581515 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b9077-b397-4d61-908c-2aaca1b2498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:22.582415 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9077-b397-4d61-908c-2aaca1b2498a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:22.582693 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9077-b397-4d61-908c-2aaca1b2498a admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:22.582968 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9077-b397-4d61-908c-2aaca1b2498a admin admin] PATH_INFO: `/v3/projects/c17d2d2abe3f4ea8854c2c174dfbaaf0` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:22.584155 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b9077-b397-4d61-908c-2aaca1b2498a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c17d2d2abe3f4ea8854c2c174dfbaaf0)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:22.586115 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b9077-b397-4d61-908c-2aaca1b2498a admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:22.709094 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9c8b9077-b397-4d61-908c-2aaca1b2498a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c17d2d2abe3f4ea8854c2c174dfbaaf0', 'request_id': 'req-9c8b9077-b397-4d61-908c-2aaca1b2498a'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:22.789646 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9c8b9077-b397-4d61-908c-2aaca1b2498a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c17d2d2abe3f4ea8854c2c174dfbaaf0', 'request_id': 'req-9c8b9077-b397-4d61-908c-2aaca1b2498a'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:22.796635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9c8b9077-b397-4d61-908c-2aaca1b2498a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c17d2d2abe3f4ea8854c2c174dfbaaf0', 'request_id': 'req-9c8b9077-b397-4d61-908c-2aaca1b2498a'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:22.806653 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9c8b9077-b397-4d61-908c-2aaca1b2498a admin admin] The token cache is being invalidate because project c17d2d2abe3f4ea8854c2c174dfbaaf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:14:22.806939 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9c8b9077-b397-4d61-908c-2aaca1b2498a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:22.807566 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-9c8b9077-b397-4d61-908c-2aaca1b2498a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:22.809822 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1430/2859] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:14:22 2022] DELETE /identity/v3/projects/c17d2d2abe3f4ea8854c2c174dfbaaf0 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:14:22.814675 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ef9f5-2c6f-4d94-aa4c-3d19c7731a1e None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:22.815175 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ef9f5-2c6f-4d94-aa4c-3d19c7731a1e None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:22.815277 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ef9f5-2c6f-4d94-aa4c-3d19c7731a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:22.833238 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-4b6ef9f5-2c6f-4d94-aa4c-3d19c7731a1e None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:14:22.834435 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-4b6ef9f5-2c6f-4d94-aa4c-3d19c7731a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:22.893608 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1430/2860] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:14:22.901335 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93ccb9-54f3-489f-bd54-1b97e1b41a53 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:22.901621 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93ccb9-54f3-489f-bd54-1b97e1b41a53 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:22.901897 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93ccb9-54f3-489f-bd54-1b97e1b41a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:22.920655 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-9a93ccb9-54f3-489f-bd54-1b97e1b41a53 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:14:22.921890 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-9a93ccb9-54f3-489f-bd54-1b97e1b41a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:22.930237 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1431/2861] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:14:22.935016 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ef9f5-2c6f-4d94-aa4c-3d19c7731a1e None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:22.944986 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ef9f5-2c6f-4d94-aa4c-3d19c7731a1e None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:22.949888 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f962b4-50a2-4f24-9a87-4e403d656ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:22.950554 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f962b4-50a2-4f24-9a87-4e403d656ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:22.950858 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f962b4-50a2-4f24-9a87-4e403d656ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:22.951142 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f962b4-50a2-4f24-9a87-4e403d656ac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:22.951874 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f962b4-50a2-4f24-9a87-4e403d656ac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:14:22.952188 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f962b4-50a2-4f24-9a87-4e403d656ac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:22.953828 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f962b4-50a2-4f24-9a87-4e403d656ac3 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:22.965548 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1431/2862] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:14:22.970025 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93ccb9-54f3-489f-bd54-1b97e1b41a53 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:22.979668 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93ccb9-54f3-489f-bd54-1b97e1b41a53 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:22.985497 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92052d50-a4d3-4079-bcb6-4a41ddc63cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:22.986158 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92052d50-a4d3-4079-bcb6-4a41ddc63cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:22.986439 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92052d50-a4d3-4079-bcb6-4a41ddc63cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:22.986713 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92052d50-a4d3-4079-bcb6-4a41ddc63cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:22.987676 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92052d50-a4d3-4079-bcb6-4a41ddc63cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:22.989353 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92052d50-a4d3-4079-bcb6-4a41ddc63cd2 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:23.075945 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1432/2863] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:14:22 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:14:23.080094 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f962b4-50a2-4f24-9a87-4e403d656ac3 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:23.090333 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f962b4-50a2-4f24-9a87-4e403d656ac3 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:23.147782 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d394b-7f83-4842-95d1-c8c6f3688e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:23.148456 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d394b-7f83-4842-95d1-c8c6f3688e19 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:23.148770 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d394b-7f83-4842-95d1-c8c6f3688e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:23.149049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d394b-7f83-4842-95d1-c8c6f3688e19 admin admin] PATH_INFO: `/v3/users` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:23.149787 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d394b-7f83-4842-95d1-c8c6f3688e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:23.151690 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d394b-7f83-4842-95d1-c8c6f3688e19 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:23.258087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1432/2864] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:14:23 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:14:23.262410 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92052d50-a4d3-4079-bcb6-4a41ddc63cd2 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:23.273133 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92052d50-a4d3-4079-bcb6-4a41ddc63cd2 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:23.278803 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce05234-8102-42b2-a1f7-cfe56434a742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:23.279471 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce05234-8102-42b2-a1f7-cfe56434a742 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:23.279753 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce05234-8102-42b2-a1f7-cfe56434a742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:23.280029 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce05234-8102-42b2-a1f7-cfe56434a742 admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:23.280799 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce05234-8102-42b2-a1f7-cfe56434a742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:23.282431 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce05234-8102-42b2-a1f7-cfe56434a742 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:23.293285 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1433/2865] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:14:23.297453 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d394b-7f83-4842-95d1-c8c6f3688e19 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:23.307621 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d394b-7f83-4842-95d1-c8c6f3688e19 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:23.313149 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcf52c-82c6-4b75-a573-96e5795a1e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:23.313803 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcf52c-82c6-4b75-a573-96e5795a1e40 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:23.314085 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcf52c-82c6-4b75-a573-96e5795a1e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:23.314363 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcf52c-82c6-4b75-a573-96e5795a1e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:23.315087 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcf52c-82c6-4b75-a573-96e5795a1e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:23.316708 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcf52c-82c6-4b75-a573-96e5795a1e40 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:23.326719 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1433/2866] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:14:23.330742 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce05234-8102-42b2-a1f7-cfe56434a742 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:23.341149 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce05234-8102-42b2-a1f7-cfe56434a742 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:23.346583 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b43538-cfdb-4611-b272-1687c9df8764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:23.347453 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b43538-cfdb-4611-b272-1687c9df8764 admin admin] REQUEST_METHOD: `PUT` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:23.347739 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b43538-cfdb-4611-b272-1687c9df8764 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:23.348011 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b43538-cfdb-4611-b272-1687c9df8764 admin admin] PATH_INFO: `/v3/projects/464d725fab6b423ea243512e7021920d/users/0c5e209ca05742b0a46088364937b921/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:23.362798 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b43538-cfdb-4611-b272-1687c9df8764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=464d725fab6b423ea243512e7021920d, user_id=0c5e209ca05742b0a46088364937b921, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:23.365481 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b43538-cfdb-4611-b272-1687c9df8764 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:23.435704 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1434/2867] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:14:23 2022] PUT /identity/v3/projects/464d725fab6b423ea243512e7021920d/users/0c5e209ca05742b0a46088364937b921/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:14:23.497963 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03bf20-776d-439f-91b6-750ae7a8eee4 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:23.498243 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03bf20-776d-439f-91b6-750ae7a8eee4 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:23.498518 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03bf20-776d-439f-91b6-750ae7a8eee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:23.524429 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-4b03bf20-776d-439f-91b6-750ae7a8eee4 None None] MFA Rules not processed for user `0c5e209ca05742b0a46088364937b921`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:14:23.525800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-4b03bf20-776d-439f-91b6-750ae7a8eee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:23.595347 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1434/2868] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:14:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:14:23.606489 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b43538-cfdb-4611-b272-1687c9df8764 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:23.608186 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-08b43538-cfdb-4611-b272-1687c9df8764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:23.666909 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b43538-cfdb-4611-b272-1687c9df8764 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:23.671730 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254b73-2a11-4773-9a72-748caa69c640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:23.672375 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254b73-2a11-4773-9a72-748caa69c640 service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:23.672681 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254b73-2a11-4773-9a72-748caa69c640 service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:23.672957 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254b73-2a11-4773-9a72-748caa69c640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:23.681457 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254b73-2a11-4773-9a72-748caa69c640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:23.682907 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254b73-2a11-4773-9a72-748caa69c640 service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:23.692162 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1435/2869] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:14:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 14 22:14:25.207610 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03bf20-776d-439f-91b6-750ae7a8eee4 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:25.209086 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-4b03bf20-776d-439f-91b6-750ae7a8eee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:25.277951 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03bf20-776d-439f-91b6-750ae7a8eee4 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:25.283600 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec6cdc-1976-45bd-9a8a-0ba4a82b7f89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e166c6b0e5542f7b912cbefa88bb5f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:25.284247 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec6cdc-1976-45bd-9a8a-0ba4a82b7f89 service placement] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:25.284526 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec6cdc-1976-45bd-9a8a-0ba4a82b7f89 service placement] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:25.284928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec6cdc-1976-45bd-9a8a-0ba4a82b7f89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:25.286689 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-edec6cdc-1976-45bd-9a8a-0ba4a82b7f89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:25.298579 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec6cdc-1976-45bd-9a8a-0ba4a82b7f89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:25.300156 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec6cdc-1976-45bd-9a8a-0ba4a82b7f89 service placement] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:25.310727 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1435/2870] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:14:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:14:34.817127 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254b73-2a11-4773-9a72-748caa69c640 service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:34.877552 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254b73-2a11-4773-9a72-748caa69c640 service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:34.882189 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ea611-e950-47f8-801b-c70883356d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:34.883045 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ea611-e950-47f8-801b-c70883356d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:34.883352 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ea611-e950-47f8-801b-c70883356d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:34.883626 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ea611-e950-47f8-801b-c70883356d54 admin admin] PATH_INFO: `/v3/users/0c5e209ca05742b0a46088364937b921` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:34.884827 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ea611-e950-47f8-801b-c70883356d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5e209ca05742b0a46088364937b921)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:34.887065 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ea611-e950-47f8-801b-c70883356d54 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:35.100103 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-0b4ea611-e950-47f8-801b-c70883356d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5e209ca05742b0a46088364937b921'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:35.105624 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-0b4ea611-e950-47f8-801b-c70883356d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5e209ca05742b0a46088364937b921'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:35.112423 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-0b4ea611-e950-47f8-801b-c70883356d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5e209ca05742b0a46088364937b921'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:35.118902 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-0b4ea611-e950-47f8-801b-c70883356d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5e209ca05742b0a46088364937b921'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:35.119546 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-0b4ea611-e950-47f8-801b-c70883356d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5e209ca05742b0a46088364937b921'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:35.188787 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1436/2871] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:14:34 2022] DELETE /identity/v3/users/0c5e209ca05742b0a46088364937b921 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:14:35.193242 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7853e6f-f200-4552-8a02-b3d6aeedfc25 None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:35.197169 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7853e6f-f200-4552-8a02-b3d6aeedfc25 None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:35.197169 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7853e6f-f200-4552-8a02-b3d6aeedfc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:35.211883 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-c7853e6f-f200-4552-8a02-b3d6aeedfc25 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:14:35.213125 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c7853e6f-f200-4552-8a02-b3d6aeedfc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:35.270474 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1436/2872] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:14:35.281112 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ea611-e950-47f8-801b-c70883356d54 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:35.282532 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-0b4ea611-e950-47f8-801b-c70883356d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:35.337911 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ea611-e950-47f8-801b-c70883356d54 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:35.342782 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebc203-2e7a-4ef6-89c0-feef3a909bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:35.343453 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebc203-2e7a-4ef6-89c0-feef3a909bdd service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:35.343732 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebc203-2e7a-4ef6-89c0-feef3a909bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:35.344003 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebc203-2e7a-4ef6-89c0-feef3a909bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:35.353125 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebc203-2e7a-4ef6-89c0-feef3a909bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:35.354482 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebc203-2e7a-4ef6-89c0-feef3a909bdd service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:35.364737 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1437/2873] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:14:35.762733 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7853e6f-f200-4552-8a02-b3d6aeedfc25 None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:35.764151 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-c7853e6f-f200-4552-8a02-b3d6aeedfc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:35.780017 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7853e6f-f200-4552-8a02-b3d6aeedfc25 None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:35.784634 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804a5ca-ad41-459e-9daf-d1d57b6f90cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:35.785501 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804a5ca-ad41-459e-9daf-d1d57b6f90cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:35.785810 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804a5ca-ad41-459e-9daf-d1d57b6f90cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:35.786928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804a5ca-ad41-459e-9daf-d1d57b6f90cb admin admin] PATH_INFO: `/v3/projects/464d725fab6b423ea243512e7021920d` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:35.788521 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804a5ca-ad41-459e-9daf-d1d57b6f90cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=464d725fab6b423ea243512e7021920d)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:35.790398 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804a5ca-ad41-459e-9daf-d1d57b6f90cb admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:35.940519 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6804a5ca-ad41-459e-9daf-d1d57b6f90cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '464d725fab6b423ea243512e7021920d', 'request_id': 'req-6804a5ca-ad41-459e-9daf-d1d57b6f90cb'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:36.006144 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6804a5ca-ad41-459e-9daf-d1d57b6f90cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '464d725fab6b423ea243512e7021920d', 'request_id': 'req-6804a5ca-ad41-459e-9daf-d1d57b6f90cb'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:36.013340 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6804a5ca-ad41-459e-9daf-d1d57b6f90cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '464d725fab6b423ea243512e7021920d', 'request_id': 'req-6804a5ca-ad41-459e-9daf-d1d57b6f90cb'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:36.023640 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6804a5ca-ad41-459e-9daf-d1d57b6f90cb admin admin] The token cache is being invalidate because project 464d725fab6b423ea243512e7021920d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:14:36.023924 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6804a5ca-ad41-459e-9daf-d1d57b6f90cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:36.024652 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-6804a5ca-ad41-459e-9daf-d1d57b6f90cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:36.026206 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1437/2874] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:14:35 2022] DELETE /identity/v3/projects/464d725fab6b423ea243512e7021920d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:14:36.031833 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88c51e-001d-4139-ba49-3585c0b057fc None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:36.032330 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88c51e-001d-4139-ba49-3585c0b057fc None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:36.032443 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88c51e-001d-4139-ba49-3585c0b057fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:36.050889 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-8d88c51e-001d-4139-ba49-3585c0b057fc None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:14:36.052151 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-8d88c51e-001d-4139-ba49-3585c0b057fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:36.121249 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1438/2875] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:14:36.130065 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b70d0e-fcaf-4bc7-a4ac-62d6fb2f8b3d None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:36.130425 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b70d0e-fcaf-4bc7-a4ac-62d6fb2f8b3d None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:36.130753 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b70d0e-fcaf-4bc7-a4ac-62d6fb2f8b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:36.151169 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-04b70d0e-fcaf-4bc7-a4ac-62d6fb2f8b3d None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:14:36.152612 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-04b70d0e-fcaf-4bc7-a4ac-62d6fb2f8b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:36.161795 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1438/2876] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:14:36.166644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88c51e-001d-4139-ba49-3585c0b057fc None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:36.178164 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88c51e-001d-4139-ba49-3585c0b057fc None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:36.205718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d9dd2-750f-440f-9c96-b1db3249a07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:36.205718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d9dd2-750f-440f-9c96-b1db3249a07e admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:36.205718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d9dd2-750f-440f-9c96-b1db3249a07e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:36.205718 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d9dd2-750f-440f-9c96-b1db3249a07e admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:36.206193 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d9dd2-750f-440f-9c96-b1db3249a07e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:14:36.206193 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d9dd2-750f-440f-9c96-b1db3249a07e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:36.206193 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d9dd2-750f-440f-9c96-b1db3249a07e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:36.206193 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1439/2877] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:14:36.208845 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b70d0e-fcaf-4bc7-a4ac-62d6fb2f8b3d None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:36.218965 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b70d0e-fcaf-4bc7-a4ac-62d6fb2f8b3d None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:36.224008 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118d91e-8a74-4685-8315-849aba9a9ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:36.224697 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d91e-8a74-4685-8315-849aba9a9ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:36.224983 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d91e-8a74-4685-8315-849aba9a9ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:36.225261 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d91e-8a74-4685-8315-849aba9a9ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:36.225957 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118d91e-8a74-4685-8315-849aba9a9ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:36.227917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118d91e-8a74-4685-8315-849aba9a9ca6 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:36.316655 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1439/2878] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:14:36 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:14:36.320800 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d9dd2-750f-440f-9c96-b1db3249a07e admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:36.331355 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d9dd2-750f-440f-9c96-b1db3249a07e admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:36.388553 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c1633-3556-42c7-9598-df99fd3d29da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:36.389240 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c1633-3556-42c7-9598-df99fd3d29da admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:36.389521 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c1633-3556-42c7-9598-df99fd3d29da admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:36.389791 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c1633-3556-42c7-9598-df99fd3d29da admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:36.390487 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c1633-3556-42c7-9598-df99fd3d29da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:36.392444 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c1633-3556-42c7-9598-df99fd3d29da admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:36.476100 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1440/2879] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:14:36 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 14 22:14:36.480934 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118d91e-8a74-4685-8315-849aba9a9ca6 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:36.491268 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118d91e-8a74-4685-8315-849aba9a9ca6 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:36.497049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53673d0d-5ca7-46c5-bede-4dfc4a703e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:36.497708 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53673d0d-5ca7-46c5-bede-4dfc4a703e89 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:36.497991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53673d0d-5ca7-46c5-bede-4dfc4a703e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:36.498270 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53673d0d-5ca7-46c5-bede-4dfc4a703e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:36.498991 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53673d0d-5ca7-46c5-bede-4dfc4a703e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:36.500601 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53673d0d-5ca7-46c5-bede-4dfc4a703e89 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:36.510263 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1440/2880] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:14:36.514212 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c1633-3556-42c7-9598-df99fd3d29da admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:36.524149 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c1633-3556-42c7-9598-df99fd3d29da admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:36.529138 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83434f-f6bb-4c88-a675-1a90588e763e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:36.543413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83434f-f6bb-4c88-a675-1a90588e763e admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:36.543413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83434f-f6bb-4c88-a675-1a90588e763e admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:36.543413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83434f-f6bb-4c88-a675-1a90588e763e admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:36.543413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83434f-f6bb-4c88-a675-1a90588e763e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:36.543413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83434f-f6bb-4c88-a675-1a90588e763e admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:36.543413 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1441/2881] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:14:36.547215 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53673d0d-5ca7-46c5-bede-4dfc4a703e89 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:36.557532 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53673d0d-5ca7-46c5-bede-4dfc4a703e89 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:36.563031 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd93507-d378-49d4-8bc5-795cf65ecd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:36.563909 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93507-d378-49d4-8bc5-795cf65ecd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:36.564188 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93507-d378-49d4-8bc5-795cf65ecd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:36.564464 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93507-d378-49d4-8bc5-795cf65ecd2c admin admin] PATH_INFO: `/v3/projects/0236d89b4d474f2c867121285597eb6f/users/fcc891a371764e06bfb9d6c2d90e50dd/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:36.578925 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd93507-d378-49d4-8bc5-795cf65ecd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0236d89b4d474f2c867121285597eb6f, user_id=fcc891a371764e06bfb9d6c2d90e50dd, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:36.581692 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd93507-d378-49d4-8bc5-795cf65ecd2c admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:36.669902 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1441/2882] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:14:36 2022] PUT /identity/v3/projects/0236d89b4d474f2c867121285597eb6f/users/fcc891a371764e06bfb9d6c2d90e50dd/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:14:36.681295 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7d57b-56e8-4dd0-8186-11968bc859cc None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:36.681587 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7d57b-56e8-4dd0-8186-11968bc859cc None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:36.681868 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7d57b-56e8-4dd0-8186-11968bc859cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:36.709371 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-61a7d57b-56e8-4dd0-8186-11968bc859cc None None] MFA Rules not processed for user `fcc891a371764e06bfb9d6c2d90e50dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:14:36.710601 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-61a7d57b-56e8-4dd0-8186-11968bc859cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:36.773136 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1442/2883] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:14:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 14 22:14:36.784417 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd93507-d378-49d4-8bc5-795cf65ecd2c admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:36.786075 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5bd93507-d378-49d4-8bc5-795cf65ecd2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:36.842937 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd93507-d378-49d4-8bc5-795cf65ecd2c admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:36.846757 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645b0c1-de93-4939-bd82-cc529c19095f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:36.847392 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645b0c1-de93-4939-bd82-cc529c19095f service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:36.847665 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645b0c1-de93-4939-bd82-cc529c19095f service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:36.847935 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645b0c1-de93-4939-bd82-cc529c19095f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:36.857454 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645b0c1-de93-4939-bd82-cc529c19095f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:36.858854 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645b0c1-de93-4939-bd82-cc529c19095f service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:36.867505 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1442/2884] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:14:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:14:39.867418 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7d57b-56e8-4dd0-8186-11968bc859cc None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:39.926495 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7d57b-56e8-4dd0-8186-11968bc859cc None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:39.931269 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb78adc-4aa5-4436-a0d1-1bac77f45b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:39.932120 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78adc-4aa5-4436-a0d1-1bac77f45b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:39.932397 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78adc-4aa5-4436-a0d1-1bac77f45b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:39.932815 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78adc-4aa5-4436-a0d1-1bac77f45b16 admin admin] PATH_INFO: `/v3/users/fcc891a371764e06bfb9d6c2d90e50dd` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:39.933989 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb78adc-4aa5-4436-a0d1-1bac77f45b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc891a371764e06bfb9d6c2d90e50dd)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:39.935901 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb78adc-4aa5-4436-a0d1-1bac77f45b16 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:40.155070 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-afb78adc-4aa5-4436-a0d1-1bac77f45b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc891a371764e06bfb9d6c2d90e50dd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:40.155651 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-afb78adc-4aa5-4436-a0d1-1bac77f45b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc891a371764e06bfb9d6c2d90e50dd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:40.167698 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-afb78adc-4aa5-4436-a0d1-1bac77f45b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc891a371764e06bfb9d6c2d90e50dd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:40.174207 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-afb78adc-4aa5-4436-a0d1-1bac77f45b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc891a371764e06bfb9d6c2d90e50dd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:40.174837 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-afb78adc-4aa5-4436-a0d1-1bac77f45b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc891a371764e06bfb9d6c2d90e50dd'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:40.268768 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1443/2885] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:14:39 2022] DELETE /identity/v3/users/fcc891a371764e06bfb9d6c2d90e50dd => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:14:40.273387 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1beb98-459a-4d46-af70-b231611291cb None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:40.273890 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1beb98-459a-4d46-af70-b231611291cb None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:40.274036 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1beb98-459a-4d46-af70-b231611291cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:40.291031 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-cf1beb98-459a-4d46-af70-b231611291cb None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:14:40.292764 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-cf1beb98-459a-4d46-af70-b231611291cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:40.349672 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1443/2886] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:14:40.360194 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb78adc-4aa5-4436-a0d1-1bac77f45b16 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:40.361644 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-afb78adc-4aa5-4436-a0d1-1bac77f45b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:40.418214 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb78adc-4aa5-4436-a0d1-1bac77f45b16 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:40.421900 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8f05d-e6fe-48ac-a6db-6c61e372fcdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:40.422545 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8f05d-e6fe-48ac-a6db-6c61e372fcdb service neutron] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:40.422824 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8f05d-e6fe-48ac-a6db-6c61e372fcdb service neutron] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:40.423094 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8f05d-e6fe-48ac-a6db-6c61e372fcdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:40.432158 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8f05d-e6fe-48ac-a6db-6c61e372fcdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:40.434364 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8f05d-e6fe-48ac-a6db-6c61e372fcdb service neutron] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:40.443681 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1444/2887] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:14:41.133049 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1beb98-459a-4d46-af70-b231611291cb None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:41.134454 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-cf1beb98-459a-4d46-af70-b231611291cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:41.147545 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1beb98-459a-4d46-af70-b231611291cb None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:41.163950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a37e52-a0f0-4dcf-a806-eed1f579aced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:41.163950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a37e52-a0f0-4dcf-a806-eed1f579aced admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:41.163950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a37e52-a0f0-4dcf-a806-eed1f579aced admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:41.163950 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a37e52-a0f0-4dcf-a806-eed1f579aced admin admin] PATH_INFO: `/v3/projects/0236d89b4d474f2c867121285597eb6f` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:41.164806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a37e52-a0f0-4dcf-a806-eed1f579aced admin admin] RBAC: Authorizing `identity:delete_project(project_id=0236d89b4d474f2c867121285597eb6f)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:41.164806 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a37e52-a0f0-4dcf-a806-eed1f579aced admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:41.274098 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-82a37e52-a0f0-4dcf-a806-eed1f579aced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0236d89b4d474f2c867121285597eb6f', 'request_id': 'req-82a37e52-a0f0-4dcf-a806-eed1f579aced'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:41.400103 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-82a37e52-a0f0-4dcf-a806-eed1f579aced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0236d89b4d474f2c867121285597eb6f', 'request_id': 'req-82a37e52-a0f0-4dcf-a806-eed1f579aced'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:41.406792 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-82a37e52-a0f0-4dcf-a806-eed1f579aced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0236d89b4d474f2c867121285597eb6f', 'request_id': 'req-82a37e52-a0f0-4dcf-a806-eed1f579aced'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:41.417130 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-82a37e52-a0f0-4dcf-a806-eed1f579aced admin admin] The token cache is being invalidate because project 0236d89b4d474f2c867121285597eb6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:14:41.417418 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-82a37e52-a0f0-4dcf-a806-eed1f579aced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:41.418054 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-82a37e52-a0f0-4dcf-a806-eed1f579aced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:14:41.419737 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1444/2888] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:14:41 2022] DELETE /identity/v3/projects/0236d89b4d474f2c867121285597eb6f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:14:41.424663 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ac955-ab01-474a-9135-eb9c91aeb634 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:41.425180 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ac955-ab01-474a-9135-eb9c91aeb634 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:41.425305 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ac955-ab01-474a-9135-eb9c91aeb634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:41.444827 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-d27ac955-ab01-474a-9135-eb9c91aeb634 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:14:41.446007 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-d27ac955-ab01-474a-9135-eb9c91aeb634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:41.504969 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1445/2889] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:14:41.513840 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1618f3-c0db-403b-b278-4c56485a572b None None] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:41.514130 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1618f3-c0db-403b-b278-4c56485a572b None None] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:41.514418 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1618f3-c0db-403b-b278-4c56485a572b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:41.533633 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.auth.core [None req-5f1618f3-c0db-403b-b278-4c56485a572b None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:14:41.541257 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5f1618f3-c0db-403b-b278-4c56485a572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:41.542848 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1445/2890] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:14:41.546962 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ac955-ab01-474a-9135-eb9c91aeb634 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:41.556539 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ac955-ab01-474a-9135-eb9c91aeb634 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:41.562483 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd911dd-021a-4890-b94f-1955c93db8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:41.563135 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd911dd-021a-4890-b94f-1955c93db8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:41.563411 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd911dd-021a-4890-b94f-1955c93db8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:41.563680 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd911dd-021a-4890-b94f-1955c93db8d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:41.564403 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd911dd-021a-4890-b94f-1955c93db8d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 14 22:14:41.564776 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd911dd-021a-4890-b94f-1955c93db8d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:41.566360 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd911dd-021a-4890-b94f-1955c93db8d9 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:41.578916 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1446/2891] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Apr 14 22:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 14 22:14:41.583291 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1618f3-c0db-403b-b278-4c56485a572b None None] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:41.593317 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1618f3-c0db-403b-b278-4c56485a572b None None] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:41.598459 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6d367-ec40-4203-a211-13808d981166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:41.599118 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6d367-ec40-4203-a211-13808d981166 admin admin] REQUEST_METHOD: `POST` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:41.599400 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6d367-ec40-4203-a211-13808d981166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:41.599705 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6d367-ec40-4203-a211-13808d981166 admin admin] PATH_INFO: `/v3/projects` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:41.600412 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6d367-ec40-4203-a211-13808d981166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:41.602384 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6d367-ec40-4203-a211-13808d981166 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:41.698506 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1446/2892] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Apr 14 22:14:41 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:14:41.703177 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd911dd-021a-4890-b94f-1955c93db8d9 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:41.713305 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd911dd-021a-4890-b94f-1955c93db8d9 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:41.769872 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b58b5-5609-456e-b947-a438f8267c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:41.770567 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b58b5-5609-456e-b947-a438f8267c24 admin admin] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:41.770848 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b58b5-5609-456e-b947-a438f8267c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:41.771125 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b58b5-5609-456e-b947-a438f8267c24 admin admin] PATH_INFO: `/v3/users` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:41.771819 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b58b5-5609-456e-b947-a438f8267c24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:41.773794 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b58b5-5609-456e-b947-a438f8267c24 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:41.857495 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1447/2893] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Apr 14 22:14:41 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 14 22:14:41.861685 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6d367-ec40-4203-a211-13808d981166 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:41.873058 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6d367-ec40-4203-a211-13808d981166 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:41.877760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c9720-7d96-4198-85ee-608df6239c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:41.881931 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c9720-7d96-4198-85ee-608df6239c89 admin admin] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:41.881931 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c9720-7d96-4198-85ee-608df6239c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:41.881931 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c9720-7d96-4198-85ee-608df6239c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:41.881931 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c9720-7d96-4198-85ee-608df6239c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:41.881931 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c9720-7d96-4198-85ee-608df6239c89 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:41.891706 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1447/2894] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:14:41.895594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b58b5-5609-456e-b947-a438f8267c24 admin admin] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:41.905424 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b58b5-5609-456e-b947-a438f8267c24 admin admin] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:41.909986 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8882a31-fe4a-44aa-a721-13af45fa8c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:41.910630 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882a31-fe4a-44aa-a721-13af45fa8c3d admin admin] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:41.910907 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882a31-fe4a-44aa-a721-13af45fa8c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:41.911183 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882a31-fe4a-44aa-a721-13af45fa8c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:41.911892 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8882a31-fe4a-44aa-a721-13af45fa8c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:41.913518 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8882a31-fe4a-44aa-a721-13af45fa8c3d admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:41.923880 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1448/2895] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Apr 14 22:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 14 22:14:41.927993 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c9720-7d96-4198-85ee-608df6239c89 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:41.938502 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c9720-7d96-4198-85ee-608df6239c89 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:41.943113 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa531b0-bbc1-447c-abd7-f36b2e2206c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:41.943973 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa531b0-bbc1-447c-abd7-f36b2e2206c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:41.944248 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa531b0-bbc1-447c-abd7-f36b2e2206c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:41.944515 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa531b0-bbc1-447c-abd7-f36b2e2206c3 admin admin] PATH_INFO: `/v3/projects/3b0851ab52d241a6934c5cd5bfbddc62/users/25a5ab0d6e7744b89c90bba4feb4d7d7/roles/4a3588df731c452fba80b071fc342f78` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:41.958795 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa531b0-bbc1-447c-abd7-f36b2e2206c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0851ab52d241a6934c5cd5bfbddc62, user_id=25a5ab0d6e7744b89c90bba4feb4d7d7, role_id=4a3588df731c452fba80b071fc342f78)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:41.961395 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa531b0-bbc1-447c-abd7-f36b2e2206c3 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:42.032629 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1448/2896] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Apr 14 22:14:41 2022] PUT /identity/v3/projects/3b0851ab52d241a6934c5cd5bfbddc62/users/25a5ab0d6e7744b89c90bba4feb4d7d7/roles/4a3588df731c452fba80b071fc342f78 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 14 22:14:42.037846 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7d7f6-ebea-4416-a7c5-055b6f195b15 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:42.038137 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7d7f6-ebea-4416-a7c5-055b6f195b15 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:42.038419 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7d7f6-ebea-4416-a7c5-055b6f195b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:42.058143 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-58b7d7f6-ebea-4416-a7c5-055b6f195b15 None None] MFA Rules not processed for user `251b9783da7b448e9c5a7980e4095700`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:14:42.059351 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-58b7d7f6-ebea-4416-a7c5-055b6f195b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:42.115529 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1449/2897] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:14:42.125221 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa531b0-bbc1-447c-abd7-f36b2e2206c3 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:42.127020 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-1fa531b0-bbc1-447c-abd7-f36b2e2206c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:42.185042 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa531b0-bbc1-447c-abd7-f36b2e2206c3 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:42.189369 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7babdb-74a7-4387-802b-91e879a2d0d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:42.190007 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7babdb-74a7-4387-802b-91e879a2d0d5 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:42.190284 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7babdb-74a7-4387-802b-91e879a2d0d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:42.190565 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7babdb-74a7-4387-802b-91e879a2d0d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:42.200190 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7babdb-74a7-4387-802b-91e879a2d0d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:42.201780 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7babdb-74a7-4387-802b-91e879a2d0d5 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:42.211605 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1449/2898] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:14:43.509110 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21b4d3-4377-43d1-a121-693b8509ffd0 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:43.509658 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21b4d3-4377-43d1-a121-693b8509ffd0 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:43.509658 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21b4d3-4377-43d1-a121-693b8509ffd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:43.538212 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-dc21b4d3-4377-43d1-a121-693b8509ffd0 None None] MFA Rules not processed for user `25a5ab0d6e7744b89c90bba4feb4d7d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:14:43.539438 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-dc21b4d3-4377-43d1-a121-693b8509ffd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:43.609068 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1450/2899] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:14:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:14:43.620625 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7babdb-74a7-4387-802b-91e879a2d0d5 service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:43.622151 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-3f7babdb-74a7-4387-802b-91e879a2d0d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:43.679961 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7babdb-74a7-4387-802b-91e879a2d0d5 service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:43.684272 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc6cda-dcdc-426d-ae51-dcb0e8a649d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:43.684935 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc6cda-dcdc-426d-ae51-dcb0e8a649d0 service cinder] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:43.685220 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc6cda-dcdc-426d-ae51-dcb0e8a649d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:43.685497 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc6cda-dcdc-426d-ae51-dcb0e8a649d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:43.693928 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc6cda-dcdc-426d-ae51-dcb0e8a649d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:43.695384 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc6cda-dcdc-426d-ae51-dcb0e8a649d0 service cinder] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:43.708081 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1450/2900] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:14:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:14:46.546579 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e75d8e-8aef-4c73-960e-ad8d7c5f1d31 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:46.547108 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e75d8e-8aef-4c73-960e-ad8d7c5f1d31 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:46.547238 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e75d8e-8aef-4c73-960e-ad8d7c5f1d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:46.565027 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-01e75d8e-8aef-4c73-960e-ad8d7c5f1d31 None None] MFA Rules not processed for user `25a5ab0d6e7744b89c90bba4feb4d7d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:14:46.566227 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-01e75d8e-8aef-4c73-960e-ad8d7c5f1d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:46.573771 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1451/2901] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:14:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:14:46.825644 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc6cda-dcdc-426d-ae51-dcb0e8a649d0 service cinder] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:46.825644 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-37bc6cda-dcdc-426d-ae51-dcb0e8a649d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:46.829208 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc6cda-dcdc-426d-ae51-dcb0e8a649d0 service cinder] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:46.832938 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4ad70-afb2-447a-b16b-2a677d9af657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:46.833603 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4ad70-afb2-447a-b16b-2a677d9af657 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:46.833889 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4ad70-afb2-447a-b16b-2a677d9af657 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:46.834165 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4ad70-afb2-447a-b16b-2a677d9af657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:46.836043 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-82a4ad70-afb2-447a-b16b-2a677d9af657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:46.846821 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4ad70-afb2-447a-b16b-2a677d9af657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:46.848267 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4ad70-afb2-447a-b16b-2a677d9af657 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:46.857163 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1451/2902] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:14:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:14:47.258927 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e75d8e-8aef-4c73-960e-ad8d7c5f1d31 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:47.260813 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-01e75d8e-8aef-4c73-960e-ad8d7c5f1d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:47.331858 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e75d8e-8aef-4c73-960e-ad8d7c5f1d31 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:47.336731 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbea8f-750c-419b-b188-f36944cf1fe0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e166c6b0e5542f7b912cbefa88bb5f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:47.337373 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbea8f-750c-419b-b188-f36944cf1fe0 service placement] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:47.337648 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbea8f-750c-419b-b188-f36944cf1fe0 service placement] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:47.337915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbea8f-750c-419b-b188-f36944cf1fe0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:47.340504 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-c6cbea8f-750c-419b-b188-f36944cf1fe0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:47.351941 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbea8f-750c-419b-b188-f36944cf1fe0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:47.353541 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbea8f-750c-419b-b188-f36944cf1fe0 service placement] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:47.363898 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1452/2903] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:14:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:14:59.514286 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4ad70-afb2-447a-b16b-2a677d9af657 service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:14:59.515734 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-82a4ad70-afb2-447a-b16b-2a677d9af657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:59.589451 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4ad70-afb2-447a-b16b-2a677d9af657 service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:14:59.595702 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f939190-a458-4f1d-8c7d-64f2be5b004e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7f3ea629181433eb8c6d5dbc354c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:14:59.598917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f939190-a458-4f1d-8c7d-64f2be5b004e service nova] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:14:59.598917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f939190-a458-4f1d-8c7d-64f2be5b004e service nova] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:14:59.598917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f939190-a458-4f1d-8c7d-64f2be5b004e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:14:59.598917 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-5f939190-a458-4f1d-8c7d-64f2be5b004e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:14:59.612992 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f939190-a458-4f1d-8c7d-64f2be5b004e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:14:59.614588 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f939190-a458-4f1d-8c7d-64f2be5b004e service nova] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:14:59.627767 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1452/2904] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:14:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:16:15.826691 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e52d2a-bedc-45a9-95f7-391b35b5f0c7 None None] REQUEST_METHOD: `POST` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:16:15.827274 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e52d2a-bedc-45a9-95f7-391b35b5f0c7 None None] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:16:15.827274 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e52d2a-bedc-45a9-95f7-391b35b5f0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:16:15.844515 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.auth.core [None req-94e52d2a-bedc-45a9-95f7-391b35b5f0c7 None None] MFA Rules not processed for user `25a5ab0d6e7744b89c90bba4feb4d7d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 14 22:16:15.846008 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-94e52d2a-bedc-45a9-95f7-391b35b5f0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:16:15.853563 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1453/2905] 10.222.0.52 () {58 vars in 957 bytes} [Thu Apr 14 22:16:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 14 22:16:30.279289 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f939190-a458-4f1d-8c7d-64f2be5b004e service nova] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:16:30.290651 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f939190-a458-4f1d-8c7d-64f2be5b004e service nova] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:16:30.294434 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdec946-e281-4dc4-b9ac-526b13197aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfbd6a387e44037a58e521230783347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:16:30.295080 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdec946-e281-4dc4-b9ac-526b13197aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:16:30.295404 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdec946-e281-4dc4-b9ac-526b13197aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:16:30.295743 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdec946-e281-4dc4-b9ac-526b13197aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:16:30.298497 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-bfdec946-e281-4dc4-b9ac-526b13197aa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:16:30.313643 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdec946-e281-4dc4-b9ac-526b13197aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:16:30.315354 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdec946-e281-4dc4-b9ac-526b13197aa4 service neutron] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:16:30.327022 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1453/2906] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:16:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:16:30.498510 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e52d2a-bedc-45a9-95f7-391b35b5f0c7 None None] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:16:30.508382 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e52d2a-bedc-45a9-95f7-391b35b5f0c7 None None] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:16:30.511923 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108adf1b-254b-44e7-ab0d-d4d2ebdcfc5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f96ebcce204c729bf8e59d21dcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:16:30.512561 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108adf1b-254b-44e7-ab0d-d4d2ebdcfc5a service cinder] REQUEST_METHOD: `GET` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:16:30.512879 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108adf1b-254b-44e7-ab0d-d4d2ebdcfc5a service cinder] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:16:30.513155 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108adf1b-254b-44e7-ab0d-d4d2ebdcfc5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:16:30.514888 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.fernet_utils [None req-108adf1b-254b-44e7-ab0d-d4d2ebdcfc5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:16:30.529594 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108adf1b-254b-44e7-ab0d-d4d2ebdcfc5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:16:30.531055 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108adf1b-254b-44e7-ab0d-d4d2ebdcfc5a service cinder] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:16:30.542922 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1454/2907] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:16:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 14 22:17:30.773054 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdec946-e281-4dc4-b9ac-526b13197aa4 service neutron] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:17:30.784996 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdec946-e281-4dc4-b9ac-526b13197aa4 service neutron] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:17:30.790102 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e8da5-b141-41dc-8be3-c46bb8223259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:17:30.791096 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e8da5-b141-41dc-8be3-c46bb8223259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:17:30.791250 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e8da5-b141-41dc-8be3-c46bb8223259 admin admin] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:17:30.791533 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e8da5-b141-41dc-8be3-c46bb8223259 admin admin] PATH_INFO: `/v3/users/25a5ab0d6e7744b89c90bba4feb4d7d7` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:17:30.792805 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e8da5-b141-41dc-8be3-c46bb8223259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a5ab0d6e7744b89c90bba4feb4d7d7)` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:17:30.794760 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e8da5-b141-41dc-8be3-c46bb8223259 admin admin] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:17:31.002383 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ee9e8da5-b141-41dc-8be3-c46bb8223259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a5ab0d6e7744b89c90bba4feb4d7d7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:17:31.003027 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ee9e8da5-b141-41dc-8be3-c46bb8223259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a5ab0d6e7744b89c90bba4feb4d7d7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:17:31.014660 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ee9e8da5-b141-41dc-8be3-c46bb8223259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a5ab0d6e7744b89c90bba4feb4d7d7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:17:31.022279 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ee9e8da5-b141-41dc-8be3-c46bb8223259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a5ab0d6e7744b89c90bba4feb4d7d7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:17:31.022960 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.notifications [None req-ee9e8da5-b141-41dc-8be3-c46bb8223259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a5ab0d6e7744b89c90bba4feb4d7d7'} {{(pid=86771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:17:31.118719 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1454/2908] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Apr 14 22:17:30 2022] DELETE /identity/v3/users/25a5ab0d6e7744b89c90bba4feb4d7d7 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:17:31.380348 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108adf1b-254b-44e7-ab0d-d4d2ebdcfc5a service cinder] Authenticating user token {{(pid=86770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:17:31.395242 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108adf1b-254b-44e7-ab0d-d4d2ebdcfc5a service cinder] Validating token access rules against request {{(pid=86770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:17:31.452756 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c144aa-e690-4743-a5a7-1b51fbcaed08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b9783da7b448e9c5a7980e4095700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a4691b0f66431db71e4f1cd4001c61', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:17:31.453635 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c144aa-e690-4743-a5a7-1b51fbcaed08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:17:31.453915 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c144aa-e690-4743-a5a7-1b51fbcaed08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:17:31.454191 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c144aa-e690-4743-a5a7-1b51fbcaed08 admin admin] PATH_INFO: `/v3/projects/3b0851ab52d241a6934c5cd5bfbddc62` {{(pid=86770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:17:31.455986 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c144aa-e690-4743-a5a7-1b51fbcaed08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b0851ab52d241a6934c5cd5bfbddc62)` {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:17:31.457956 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c144aa-e690-4743-a5a7-1b51fbcaed08 admin admin] RBAC: Authorization granted {{(pid=86770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:17:31.576557 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-56c144aa-e690-4743-a5a7-1b51fbcaed08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b0851ab52d241a6934c5cd5bfbddc62', 'request_id': 'req-56c144aa-e690-4743-a5a7-1b51fbcaed08'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:17:31.675195 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-56c144aa-e690-4743-a5a7-1b51fbcaed08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b0851ab52d241a6934c5cd5bfbddc62', 'request_id': 'req-56c144aa-e690-4743-a5a7-1b51fbcaed08'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:17:31.682141 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-56c144aa-e690-4743-a5a7-1b51fbcaed08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b0851ab52d241a6934c5cd5bfbddc62', 'request_id': 'req-56c144aa-e690-4743-a5a7-1b51fbcaed08'} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:17:31.693147 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-56c144aa-e690-4743-a5a7-1b51fbcaed08 admin admin] The token cache is being invalidate because project 3b0851ab52d241a6934c5cd5bfbddc62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 14 22:17:31.693430 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-56c144aa-e690-4743-a5a7-1b51fbcaed08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:17:31.694059 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: DEBUG keystone.notifications [None req-56c144aa-e690-4743-a5a7-1b51fbcaed08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 14 22:17:31.695616 dv-cinder-813229-9-iscsi devstack@keystone.service[86770]: [pid: 86770|app: 0|req: 1455/2909] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Apr 14 22:17:31 2022] DELETE /identity/v3/projects/3b0851ab52d241a6934c5cd5bfbddc62 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 14 22:19:31.176994 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e8da5-b141-41dc-8be3-c46bb8223259 admin admin] Authenticating user token {{(pid=86771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 14 22:19:31.178379 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-ee9e8da5-b141-41dc-8be3-c46bb8223259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:19:31.319665 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e8da5-b141-41dc-8be3-c46bb8223259 admin admin] Validating token access rules against request {{(pid=86771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 14 22:19:31.379589 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d81aa9-60e3-41e1-9926-666cbfff366f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e166c6b0e5542f7b912cbefa88bb5f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3c1bb37aa1c407782b2f5501ae1f10a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 14 22:19:31.380649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81aa9-60e3-41e1-9926-666cbfff366f service placement] REQUEST_METHOD: `GET` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 14 22:19:31.380649 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81aa9-60e3-41e1-9926-666cbfff366f service placement] SCRIPT_NAME: `/identity` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 14 22:19:31.380907 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81aa9-60e3-41e1-9926-666cbfff366f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 14 22:19:31.382698 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.fernet_utils [None req-b5d81aa9-60e3-41e1-9926-666cbfff366f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 14 22:19:31.395800 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d81aa9-60e3-41e1-9926-666cbfff366f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 14 22:19:31.397464 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d81aa9-60e3-41e1-9926-666cbfff366f service placement] RBAC: Authorization granted {{(pid=86771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 14 22:19:31.408947 dv-cinder-813229-9-iscsi devstack@keystone.service[86771]: [pid: 86771|app: 0|req: 1455/2910] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Apr 14 22:19:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)